orcaLog in

Runs · run 3879

load_day 2025-05-09, attempt 1 succeeded

Host
73ccef5e07c2:301539
Started
2026-11-08T11:51:18Z
Ended
2026-11-08T11:53:33Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
766 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
205.2 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3879/load_day/2025-05-09/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:51:19Z [load_day 2025-05-09] attempt 1 started
2026-11-08T11:51:19Z [load_day 2025-05-09] 2025-05-09: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:51:27Z [load_day 2025-05-09] 2025-05-09 hour 0: 197907 events in 0 files, snapshot none (task 7705 ms: download 5025 ms overlapping gunzip 1230 ms, parse 5221 ms, sort 0 ms, write 0 ms, index 667 ms: 6 candidates, 91512 repo-hours, 1630 releases; waiting 239 ms; commit 0 ms)
2026-11-08T11:51:27Z [load_day 2025-05-09] 2025-05-09 hour 1: 223925 events in 0 files, snapshot none (task 7564 ms: download 4741 ms overlapping gunzip 1097 ms, parse 4894 ms, sort 0 ms, write 0 ms, index 801 ms: 11 candidates, 121679 repo-hours, 1032 releases; waiting 476 ms; commit 0 ms)
2026-11-08T11:51:34Z [load_day 2025-05-09] 2025-05-09 hour 2: 198621 events in 0 files, snapshot none (task 6360 ms: download 3734 ms overlapping gunzip 893 ms, parse 3961 ms, sort 0 ms, write 0 ms, index 676 ms: 7 candidates, 88647 repo-hours, 996 releases; waiting 497 ms; commit 0 ms)
2026-11-08T11:51:36Z [load_day 2025-05-09] 2025-05-09 hour 3: 207486 events in 0 files, snapshot none (task 7557 ms: download 4670 ms overlapping gunzip 999 ms, parse 4040 ms, sort 0 ms, write 0 ms, index 874 ms: 12 candidates, 88166 repo-hours, 2947 releases; waiting 1328 ms; commit 0 ms)
2026-11-08T11:51:41Z [load_day 2025-05-09] 2025-05-09 hour 4: 191957 events in 0 files, snapshot none (task 6223 ms: download 3961 ms overlapping gunzip 835 ms, parse 3604 ms, sort 0 ms, write 0 ms, index 565 ms: 8 candidates, 74526 repo-hours, 952 releases; waiting 905 ms; commit 0 ms)
2026-11-08T11:51:42Z [load_day 2025-05-09] 2025-05-09 hour 5: 200938 events in 0 files, snapshot none (task 5921 ms: download 3464 ms overlapping gunzip 904 ms, parse 3592 ms, sort 0 ms, write 0 ms, index 600 ms: 6 candidates, 79957 repo-hours, 927 releases; waiting 569 ms; commit 0 ms)
2026-11-08T11:51:51Z [load_day 2025-05-09] 2025-05-09 hour 6: 228888 events in 0 files, snapshot none (task 9019 ms: download 6061 ms overlapping gunzip 1357 ms, parse 6062 ms, sort 0 ms, write 0 ms, index 762 ms: 5 candidates, 103121 repo-hours, 1145 releases; waiting 508 ms; commit 0 ms)
2026-11-08T11:51:54Z [load_day 2025-05-09] 2025-05-09 hour 7: 234778 events in 0 files, snapshot none (task 11548 ms: download 6842 ms overlapping gunzip 1502 ms, parse 6796 ms, sort 0 ms, write 0 ms, index 2818 ms: 9 candidates, 94942 repo-hours, 1044 releases; waiting 180 ms; commit 0 ms)
2026-11-08T11:52:00Z [load_day 2025-05-09] 2025-05-09 hour 8: 247408 events in 0 files, snapshot none (task 8871 ms: download 5885 ms overlapping gunzip 1405 ms, parse 5853 ms, sort 0 ms, write 0 ms, index 1014 ms: 9 candidates, 101938 repo-hours, 1287 releases; waiting 318 ms; commit 0 ms)
2026-11-08T11:52:03Z [load_day 2025-05-09] 2025-05-09 hour 9: 249453 events in 0 files, snapshot none (task 7998 ms: download 5211 ms overlapping gunzip 1276 ms, parse 5331 ms, sort 0 ms, write 0 ms, index 910 ms: 6 candidates, 106072 repo-hours, 1345 releases; waiting 184 ms; commit 0 ms)
2026-11-08T11:52:11Z [load_day 2025-05-09] 2025-05-09 hour 10: 240333 events in 0 files, snapshot none (task 10311 ms: download 7101 ms overlapping gunzip 1494 ms, parse 6576 ms, sort 0 ms, write 0 ms, index 937 ms: 3 candidates, 101038 repo-hours, 1252 releases; waiting 982 ms; commit 0 ms)
2026-11-08T11:52:12Z [load_day 2025-05-09] 2025-05-09 hour 11: 240666 events in 0 files, snapshot none (task 8419 ms: download 5719 ms overlapping gunzip 1323 ms, parse 5699 ms, sort 0 ms, write 0 ms, index 696 ms: 5 candidates, 95382 repo-hours, 1114 releases; waiting 396 ms; commit 0 ms)
2026-11-08T11:52:22Z [load_day 2025-05-09] 2025-05-09 hour 12: 279097 events in 0 files, snapshot none (task 10801 ms: download 6859 ms overlapping gunzip 1535 ms, parse 6862 ms, sort 0 ms, write 0 ms, index 1374 ms: 17 candidates, 139597 repo-hours, 1307 releases; waiting 545 ms; commit 0 ms)
2026-11-08T11:52:23Z [load_day 2025-05-09] 2025-05-09 hour 13: 273259 events in 0 files, snapshot none (task 10523 ms: download 7340 ms overlapping gunzip 1643 ms, parse 7051 ms, sort 0 ms, write 0 ms, index 965 ms: 8 candidates, 128350 repo-hours, 1281 releases; waiting 503 ms; commit 0 ms)
2026-11-08T11:52:34Z [load_day 2025-05-09] 2025-05-09 hour 14: 262267 events in 0 files, snapshot none (task 11665 ms: download 8473 ms overlapping gunzip 1851 ms, parse 7852 ms, sort 0 ms, write 0 ms, index 1162 ms: 9 candidates, 110950 repo-hours, 1303 releases; waiting 550 ms; commit 0 ms)
2026-11-08T11:52:35Z [load_day 2025-05-09] 2025-05-09 hour 15: 263601 events in 0 files, snapshot none (task 11564 ms: download 7710 ms overlapping gunzip 1873 ms, parse 7510 ms, sort 0 ms, write 0 ms, index 1360 ms: 19 candidates, 111070 repo-hours, 1331 releases; waiting 493 ms; commit 0 ms)
2026-11-08T11:52:45Z [load_day 2025-05-09] 2025-05-09 hour 16: 250163 events in 0 files, snapshot none (task 10121 ms: download 7127 ms overlapping gunzip 1663 ms, parse 6967 ms, sort 0 ms, write 0 ms, index 810 ms: 10 candidates, 106354 repo-hours, 1249 releases; waiting 349 ms; commit 0 ms)
2026-11-08T11:52:45Z [load_day 2025-05-09] 2025-05-09 hour 17: 240514 events in 0 files, snapshot none (task 10120 ms: download 7086 ms overlapping gunzip 1612 ms, parse 6724 ms, sort 0 ms, write 0 ms, index 909 ms: 14 candidates, 95760 repo-hours, 1091 releases; waiting 516 ms; commit 0 ms)
2026-11-08T11:52:56Z [load_day 2025-05-09] 2025-05-09 hour 18: 244610 events in 0 files, snapshot none (task 10041 ms: download 6917 ms overlapping gunzip 1635 ms, parse 6927 ms, sort 0 ms, write 0 ms, index 918 ms: 13 candidates, 105217 repo-hours, 1239 releases; waiting 246 ms; commit 0 ms)
2026-11-08T11:52:56Z [load_day 2025-05-09] 2025-05-09 hour 19: 231564 events in 0 files, snapshot none (task 9644 ms: download 6607 ms overlapping gunzip 1489 ms, parse 6446 ms, sort 0 ms, write 0 ms, index 864 ms: 11 candidates, 88366 repo-hours, 1120 releases; waiting 546 ms; commit 0 ms)
2026-11-08T11:53:06Z [load_day 2025-05-09] 2025-05-09 hour 20: 219314 events in 0 files, snapshot none (task 9529 ms: download 6797 ms overlapping gunzip 1545 ms, parse 6521 ms, sort 0 ms, write 0 ms, index 632 ms: 13 candidates, 85210 repo-hours, 1111 releases; waiting 537 ms; commit 0 ms)
2026-11-08T11:53:06Z [load_day 2025-05-09] 2025-05-09 hour 21: 201735 events in 0 files, snapshot none (task 8526 ms: download 5522 ms overlapping gunzip 1278 ms, parse 5644 ms, sort 0 ms, write 0 ms, index 681 ms: 16 candidates, 77574 repo-hours, 1248 releases; waiting 535 ms; commit 0 ms)
2026-11-08T11:53:13Z [load_day 2025-05-09] 2025-05-09 hour 22: 187256 events in 0 files, snapshot none (task 7211 ms: download 4737 ms overlapping gunzip 1073 ms, parse 4688 ms, sort 0 ms, write 0 ms, index 725 ms: 8 candidates, 70005 repo-hours, 1104 releases; waiting 496 ms; commit 0 ms)
2026-11-08T11:53:13Z [load_day 2025-05-09] 2025-05-09 hour 23: 174632 events in 0 files, snapshot none (task 6371 ms: download 3959 ms overlapping gunzip 1016 ms, parse 4346 ms, sort 0 ms, write 0 ms, index 456 ms: 1 candidates, 64458 repo-hours, 1080 releases; waiting 221 ms; commit 0 ms)
2026-11-08T11:53:24Z [load_day 2025-05-09] 2025-05-09: repo_hour merged from 24 files to 1 (2329891 rows, 10167 ms)
2026-11-08T11:53:33Z [load_day 2025-05-09] 2025-05-09: index committed in 19547 ms (24 + 1 + 24 files)
2026-11-08T11:53:33Z [load_day 2025-05-09] 2025-05-09: 5490372 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:53:33Z [load_day 2025-05-09] attempt 1 succeeded