orcaLog in

Runs · run 3437

load_day 2025-01-15, attempt 1 succeeded

Host
73ccef5e07c2:238298
Started
2026-11-08T09:49:52Z
Ended
2026-11-08T09:51:52Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
868 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
193.2 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3437/load_day/2025-01-15/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:49:52Z [load_day 2025-01-15] attempt 1 started
2026-11-08T09:49:53Z [load_day 2025-01-15] 2025-01-15: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:50:03Z [load_day 2025-01-15] 2025-01-15 hour 0: 199440 events in 0 files, snapshot none (task 8548 ms: download 5129 ms overlapping gunzip 1226 ms, parse 5582 ms, sort 0 ms, write 0 ms, index 986 ms: 3 candidates, 94633 repo-hours, 1257 releases; waiting 512 ms; commit 0 ms)
2026-11-08T09:50:03Z [load_day 2025-01-15] 2025-01-15 hour 1: 210620 events in 0 files, snapshot none (task 9002 ms: download 5539 ms overlapping gunzip 1339 ms, parse 5862 ms, sort 0 ms, write 0 ms, index 1069 ms: 7 candidates, 112122 repo-hours, 1025 releases; waiting 484 ms; commit 0 ms)
2026-11-08T09:50:10Z [load_day 2025-01-15] 2025-01-15 hour 2: 185346 events in 0 files, snapshot none (task 7046 ms: download 4077 ms overlapping gunzip 1039 ms, parse 4189 ms, sort 0 ms, write 0 ms, index 1000 ms: 5 candidates, 80871 repo-hours, 1031 releases; waiting 454 ms; commit 0 ms)
2026-11-08T09:50:11Z [load_day 2025-01-15] 2025-01-15 hour 3: 192259 events in 0 files, snapshot none (task 7337 ms: download 4723 ms overlapping gunzip 1058 ms, parse 4622 ms, sort 0 ms, write 0 ms, index 623 ms: 5 candidates, 77657 repo-hours, 3942 releases; waiting 740 ms; commit 0 ms)
2026-11-08T09:50:17Z [load_day 2025-01-15] 2025-01-15 hour 4: 178509 events in 0 files, snapshot none (task 6557 ms: download 4048 ms overlapping gunzip 978 ms, parse 4273 ms, sort 0 ms, write 0 ms, index 538 ms: 4 candidates, 65815 repo-hours, 684 releases; waiting 500 ms; commit 0 ms)
2026-11-08T09:50:18Z [load_day 2025-01-15] 2025-01-15 hour 5: 185917 events in 0 files, snapshot none (task 6600 ms: download 3869 ms overlapping gunzip 1052 ms, parse 4236 ms, sort 0 ms, write 0 ms, index 621 ms: 3 candidates, 70391 repo-hours, 873 releases; waiting 271 ms; commit 0 ms)
2026-11-08T09:50:26Z [load_day 2025-01-15] 2025-01-15 hour 6: 212927 events in 0 files, snapshot none (task 8373 ms: download 5522 ms overlapping gunzip 1332 ms, parse 5759 ms, sort 0 ms, write 0 ms, index 768 ms: 4 candidates, 93633 repo-hours, 966 releases; waiting 292 ms; commit 0 ms)
2026-11-08T09:50:27Z [load_day 2025-01-15] 2025-01-15 hour 7: 209276 events in 0 files, snapshot none (task 8189 ms: download 5557 ms overlapping gunzip 1269 ms, parse 5735 ms, sort 0 ms, write 0 ms, index 616 ms: 4 candidates, 81127 repo-hours, 939 releases; waiting 313 ms; commit 0 ms)
2026-11-08T09:50:36Z [load_day 2025-01-15] 2025-01-15 hour 8: 225913 events in 0 files, snapshot none (task 9183 ms: download 6435 ms overlapping gunzip 1412 ms, parse 6237 ms, sort 0 ms, write 0 ms, index 706 ms: 2 candidates, 91760 repo-hours, 1331 releases; waiting 522 ms; commit 0 ms)
2026-11-08T09:50:37Z [load_day 2025-01-15] 2025-01-15 hour 9: 241888 events in 0 files, snapshot none (task 9328 ms: download 6604 ms overlapping gunzip 1442 ms, parse 6349 ms, sort 0 ms, write 0 ms, index 806 ms: 5 candidates, 101504 repo-hours, 1368 releases; waiting 445 ms; commit 0 ms)
2026-11-08T09:50:43Z [load_day 2025-01-15] 2025-01-15 hour 10: 238383 events in 0 files, snapshot none (task 7050 ms: download 4574 ms overlapping gunzip 1177 ms, parse 4975 ms, sort 0 ms, write 0 ms, index 707 ms: 4 candidates, 96449 repo-hours, 1204 releases; waiting 6 ms; commit 0 ms)
2026-11-08T09:50:44Z [load_day 2025-01-15] 2025-01-15 hour 11: 224818 events in 0 files, snapshot none (task 6464 ms: download 4025 ms overlapping gunzip 1077 ms, parse 4534 ms, sort 0 ms, write 0 ms, index 624 ms: 8 candidates, 89616 repo-hours, 1089 releases; waiting 10 ms; commit 0 ms)
2026-11-08T09:50:51Z [load_day 2025-01-15] 2025-01-15 hour 12: 270553 events in 0 files, snapshot none (task 7561 ms: download 4637 ms overlapping gunzip 1189 ms, parse 5090 ms, sort 0 ms, write 0 ms, index 1062 ms: 11 candidates, 135602 repo-hours, 1286 releases; waiting 19 ms; commit 0 ms)
2026-11-08T09:50:51Z [load_day 2025-01-15] 2025-01-15 hour 13: 258798 events in 0 files, snapshot none (task 7294 ms: download 4672 ms overlapping gunzip 1230 ms, parse 5039 ms, sort 0 ms, write 0 ms, index 807 ms: 8 candidates, 117750 repo-hours, 1181 releases; waiting 0 ms; commit 0 ms)
2026-11-08T09:51:02Z [load_day 2025-01-15] 2025-01-15 hour 14: 251755 events in 0 files, snapshot none (task 10713 ms: download 8063 ms overlapping gunzip 1809 ms, parse 7832 ms, sort 0 ms, write 0 ms, index 844 ms: 8 candidates, 105686 repo-hours, 1355 releases; waiting 33 ms; commit 0 ms)
2026-11-08T09:51:02Z [load_day 2025-01-15] 2025-01-15 hour 15: 260318 events in 0 files, snapshot none (task 10366 ms: download 7502 ms overlapping gunzip 1710 ms, parse 7463 ms, sort 0 ms, write 0 ms, index 990 ms: 8 candidates, 112691 repo-hours, 1590 releases; waiting 14 ms; commit 0 ms)
2026-11-08T09:51:14Z [load_day 2025-01-15] 2025-01-15 hour 16: 250826 events in 0 files, snapshot none (task 10285 ms: download 7185 ms overlapping gunzip 1647 ms, parse 7057 ms, sort 0 ms, write 0 ms, index 839 ms: 6 candidates, 105503 repo-hours, 1277 releases; waiting 468 ms; commit 0 ms)
2026-11-08T09:51:14Z [load_day 2025-01-15] 2025-01-15 hour 17: 238378 events in 0 files, snapshot none (task 9309 ms: download 5899 ms overlapping gunzip 1622 ms, parse 6655 ms, sort 0 ms, write 0 ms, index 820 ms: 16 candidates, 96972 repo-hours, 1209 releases; waiting 10 ms; commit 0 ms)
2026-11-08T09:51:24Z [load_day 2025-01-15] 2025-01-15 hour 18: 243183 events in 0 files, snapshot none (task 9581 ms: download 6738 ms overlapping gunzip 1565 ms, parse 6488 ms, sort 0 ms, write 0 ms, index 777 ms: 6 candidates, 107097 repo-hours, 1385 releases; waiting 495 ms; commit 0 ms)
2026-11-08T09:51:24Z [load_day 2025-01-15] 2025-01-15 hour 19: 218943 events in 0 files, snapshot none (task 8555 ms: download 5374 ms overlapping gunzip 1480 ms, parse 6134 ms, sort 0 ms, write 0 ms, index 730 ms: 4 candidates, 84168 repo-hours, 1084 releases; waiting 12 ms; commit 0 ms)
2026-11-08T09:51:33Z [load_day 2025-01-15] 2025-01-15 hour 20: 217275 events in 0 files, snapshot none (task 8957 ms: download 6138 ms overlapping gunzip 1463 ms, parse 6062 ms, sort 0 ms, write 0 ms, index 688 ms: 11 candidates, 85888 repo-hours, 1126 releases; waiting 518 ms; commit 0 ms)
2026-11-08T09:51:33Z [load_day 2025-01-15] 2025-01-15 hour 21: 216802 events in 0 files, snapshot none (task 8215 ms: download 5521 ms overlapping gunzip 1360 ms, parse 5944 ms, sort 0 ms, write 0 ms, index 676 ms: 16 candidates, 86862 repo-hours, 1263 releases; waiting 19 ms; commit 0 ms)
2026-11-08T09:51:41Z [load_day 2025-01-15] 2025-01-15 hour 22: 194196 events in 0 files, snapshot none (task 7312 ms: download 4540 ms overlapping gunzip 1306 ms, parse 5244 ms, sort 0 ms, write 0 ms, index 555 ms: 5 candidates, 71778 repo-hours, 1264 releases; waiting 14 ms; commit 0 ms)
2026-11-08T09:51:41Z [load_day 2025-01-15] 2025-01-15 hour 23: 181284 events in 0 files, snapshot none (task 6716 ms: download 3752 ms overlapping gunzip 1145 ms, parse 4722 ms, sort 0 ms, write 0 ms, index 627 ms: 8 candidates, 65393 repo-hours, 1018 releases; waiting 18 ms; commit 0 ms)
2026-11-08T09:51:50Z [load_day 2025-01-15] 2025-01-15: repo_hour merged from 24 files to 1 (2230968 rows, 9084 ms)
2026-11-08T09:51:52Z [load_day 2025-01-15] 2025-01-15: index committed in 11633 ms (24 + 1 + 24 files)
2026-11-08T09:51:52Z [load_day 2025-01-15] 2025-01-15: 5307607 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:51:52Z [load_day 2025-01-15] attempt 1 succeeded