orcaLog in

Runs · run 3386

load_day 2025-01-01, attempt 1 succeeded

Host
73ccef5e07c2:231163
Started
2026-11-08T09:37:20Z
Ended
2026-11-08T09:38:45Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
631 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
122.9 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3386/load_day/2025-01-01/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:37:20Z [load_day 2025-01-01] attempt 1 started
2026-11-08T09:37:21Z [load_day 2025-01-01] 2025-01-01: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:37:28Z [load_day 2025-01-01] 2025-01-01 hour 0: 142347 events in 0 files, snapshot none (task 6140 ms: download 3639 ms overlapping gunzip 1061 ms, parse 4111 ms, sort 0 ms, write 0 ms, index 525 ms: 3 candidates, 66708 repo-hours, 1192 releases; waiting 191 ms; commit 0 ms)
2026-11-08T09:37:28Z [load_day 2025-01-01] 2025-01-01 hour 1: 170960 events in 0 files, snapshot none (task 6977 ms: download 4052 ms overlapping gunzip 1060 ms, parse 4331 ms, sort 0 ms, write 0 ms, index 821 ms: 4 candidates, 95398 repo-hours, 991 releases; waiting 428 ms; commit 0 ms)
2026-11-08T09:37:33Z [load_day 2025-01-01] 2025-01-01 hour 2: 130358 events in 0 files, snapshot none (task 5233 ms: download 2938 ms overlapping gunzip 849 ms, parse 3175 ms, sort 0 ms, write 0 ms, index 379 ms: 3 candidates, 53250 repo-hours, 925 releases; waiting 529 ms; commit 0 ms)
2026-11-08T09:37:35Z [load_day 2025-01-01] 2025-01-01 hour 3: 155887 events in 0 files, snapshot none (task 6011 ms: download 3563 ms overlapping gunzip 978 ms, parse 3786 ms, sort 0 ms, write 0 ms, index 483 ms: 1 candidates, 56852 repo-hours, 3941 releases; waiting 446 ms; commit 0 ms)
2026-11-08T09:37:39Z [load_day 2025-01-01] 2025-01-01 hour 4: 141011 events in 0 files, snapshot none (task 4702 ms: download 2432 ms overlapping gunzip 651 ms, parse 2841 ms, sort 0 ms, write 0 ms, index 360 ms: 4 candidates, 49211 repo-hours, 606 releases; waiting 487 ms; commit 0 ms)
2026-11-08T09:37:40Z [load_day 2025-01-01] 2025-01-01 hour 5: 140309 events in 0 files, snapshot none (task 4304 ms: download 2323 ms overlapping gunzip 625 ms, parse 2424 ms, sort 0 ms, write 0 ms, index 358 ms: 5 candidates, 49863 repo-hours, 656 releases; waiting 512 ms; commit 0 ms)
2026-11-08T09:37:44Z [load_day 2025-01-01] 2025-01-01 hour 6: 160133 events in 0 files, snapshot none (task 4872 ms: download 2508 ms overlapping gunzip 689 ms, parse 2750 ms, sort 0 ms, write 0 ms, index 618 ms: 6 candidates, 68299 repo-hours, 740 releases; waiting 541 ms; commit 0 ms)
2026-11-08T09:37:45Z [load_day 2025-01-01] 2025-01-01 hour 7: 149305 events in 0 files, snapshot none (task 4577 ms: download 2254 ms overlapping gunzip 633 ms, parse 2584 ms, sort 0 ms, write 0 ms, index 432 ms: 3 candidates, 52290 repo-hours, 483 releases; waiting 592 ms; commit 0 ms)
2026-11-08T09:37:49Z [load_day 2025-01-01] 2025-01-01 hour 8: 147528 events in 0 files, snapshot none (task 4290 ms: download 2315 ms overlapping gunzip 598 ms, parse 2328 ms, sort 0 ms, write 0 ms, index 403 ms: 5 candidates, 56310 repo-hours, 610 releases; waiting 692 ms; commit 0 ms)
2026-11-08T09:37:50Z [load_day 2025-01-01] 2025-01-01 hour 9: 158104 events in 0 files, snapshot none (task 4293 ms: download 2496 ms overlapping gunzip 622 ms, parse 2556 ms, sort 0 ms, write 0 ms, index 435 ms: 2 candidates, 60569 repo-hours, 779 releases; waiting 360 ms; commit 0 ms)
2026-11-08T09:37:54Z [load_day 2025-01-01] 2025-01-01 hour 10: 155750 events in 0 files, snapshot none (task 4808 ms: download 2105 ms overlapping gunzip 739 ms, parse 3076 ms, sort 0 ms, write 0 ms, index 450 ms: 1 candidates, 58267 repo-hours, 596 releases; waiting 252 ms; commit 0 ms)
2026-11-08T09:37:55Z [load_day 2025-01-01] 2025-01-01 hour 11: 158512 events in 0 files, snapshot none (task 5101 ms: download 2724 ms overlapping gunzip 818 ms, parse 3232 ms, sort 0 ms, write 0 ms, index 414 ms: 2 candidates, 55657 repo-hours, 637 releases; waiting 350 ms; commit 0 ms)
2026-11-08T09:38:01Z [load_day 2025-01-01] 2025-01-01 hour 12: 223540 events in 0 files, snapshot none (task 6180 ms: download 3217 ms overlapping gunzip 882 ms, parse 3898 ms, sort 0 ms, write 0 ms, index 879 ms: 6 candidates, 109141 repo-hours, 838 releases; waiting 181 ms; commit 0 ms)
2026-11-08T09:38:02Z [load_day 2025-01-01] 2025-01-01 hour 13: 197224 events in 0 files, snapshot none (task 6177 ms: download 3432 ms overlapping gunzip 877 ms, parse 3800 ms, sort 0 ms, write 0 ms, index 674 ms: 4 candidates, 89895 repo-hours, 713 releases; waiting 526 ms; commit 0 ms)
2026-11-08T09:38:08Z [load_day 2025-01-01] 2025-01-01 hour 14: 175304 events in 0 files, snapshot none (task 6152 ms: download 3688 ms overlapping gunzip 921 ms, parse 3818 ms, sort 0 ms, write 0 ms, index 591 ms: 6 candidates, 66910 repo-hours, 758 releases; waiting 514 ms; commit 0 ms)
2026-11-08T09:38:08Z [load_day 2025-01-01] 2025-01-01 hour 15: 185049 events in 0 files, snapshot none (task 6404 ms: download 3601 ms overlapping gunzip 982 ms, parse 4066 ms, sort 0 ms, write 0 ms, index 556 ms: 9 candidates, 75893 repo-hours, 982 releases; waiting 211 ms; commit 0 ms)
2026-11-08T09:38:14Z [load_day 2025-01-01] 2025-01-01 hour 16: 178036 events in 0 files, snapshot none (task 5937 ms: download 3254 ms overlapping gunzip 924 ms, parse 3992 ms, sort 0 ms, write 0 ms, index 496 ms: 7 candidates, 68797 repo-hours, 878 releases; waiting 206 ms; commit 0 ms)
2026-11-08T09:38:15Z [load_day 2025-01-01] 2025-01-01 hour 17: 175988 events in 0 files, snapshot none (task 6316 ms: download 3763 ms overlapping gunzip 951 ms, parse 4048 ms, sort 0 ms, write 0 ms, index 543 ms: 8 candidates, 67995 repo-hours, 753 releases; waiting 494 ms; commit 0 ms)
2026-11-08T09:38:22Z [load_day 2025-01-01] 2025-01-01 hour 18: 188459 events in 0 files, snapshot none (task 7764 ms: download 3955 ms overlapping gunzip 1216 ms, parse 4983 ms, sort 0 ms, write 0 ms, index 789 ms: 10 candidates, 81176 repo-hours, 895 releases; waiting 510 ms; commit 0 ms)
2026-11-08T09:38:23Z [load_day 2025-01-01] 2025-01-01 hour 19: 167103 events in 0 files, snapshot none (task 7528 ms: download 4504 ms overlapping gunzip 1206 ms, parse 5179 ms, sort 0 ms, write 0 ms, index 500 ms: 5 candidates, 56984 repo-hours, 819 releases; waiting 287 ms; commit 0 ms)
2026-11-08T09:38:29Z [load_day 2025-01-01] 2025-01-01 hour 20: 162106 events in 0 files, snapshot none (task 6669 ms: download 3181 ms overlapping gunzip 1041 ms, parse 4266 ms, sort 0 ms, write 0 ms, index 530 ms: 1 candidates, 57814 repo-hours, 745 releases; waiting 515 ms; commit 0 ms)
2026-11-08T09:38:31Z [load_day 2025-01-01] 2025-01-01 hour 21: 160796 events in 0 files, snapshot none (task 6660 ms: download 3884 ms overlapping gunzip 1112 ms, parse 4278 ms, sort 0 ms, write 0 ms, index 472 ms: 2 candidates, 59638 repo-hours, 938 releases; waiting 503 ms; commit 0 ms)
2026-11-08T09:38:35Z [load_day 2025-01-01] 2025-01-01 hour 22: 145196 events in 0 files, snapshot none (task 4932 ms: download 2888 ms overlapping gunzip 701 ms, parse 2827 ms, sort 0 ms, write 0 ms, index 447 ms: 5 candidates, 51039 repo-hours, 1008 releases; waiting 616 ms; commit 0 ms)
2026-11-08T09:38:35Z [load_day 2025-01-01] 2025-01-01 hour 23: 140988 events in 0 files, snapshot none (task 4391 ms: download 2274 ms overlapping gunzip 641 ms, parse 2667 ms, sort 0 ms, write 0 ms, index 364 ms: 3 candidates, 48941 repo-hours, 759 releases; waiting 478 ms; commit 0 ms)
2026-11-08T09:38:42Z [load_day 2025-01-01] 2025-01-01: repo_hour merged from 24 files to 1 (1556897 rows, 6755 ms)
2026-11-08T09:38:45Z [load_day 2025-01-01] 2025-01-01: index committed in 9808 ms (24 + 1 + 24 files)
2026-11-08T09:38:45Z [load_day 2025-01-01] 2025-01-01: 3909993 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:38:45Z [load_day 2025-01-01] attempt 1 succeeded