orcaLog in

Runs · run 3942

load_day 2025-05-24, attempt 1 succeeded

Host
73ccef5e07c2:311208
Started
2026-11-08T12:07:11Z
Ended
2026-11-08T12:08:33Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
639 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
111.3 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3942/load_day/2025-05-24/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:07:11Z [load_day 2025-05-24] attempt 1 started
2026-11-08T12:07:12Z [load_day 2025-05-24] 2025-05-24: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:07:18Z [load_day 2025-05-24] 2025-05-24 hour 0: 136470 events in 0 files, snapshot none (task 4866 ms: download 2041 ms overlapping gunzip 678 ms, parse 2929 ms, sort 0 ms, write 0 ms, index 838 ms: 9 candidates, 69272 repo-hours, 992 releases; waiting 198 ms; commit 0 ms)
2026-11-08T12:07:18Z [load_day 2025-05-24] 2025-05-24 hour 1: 142615 events in 0 files, snapshot none (task 5235 ms: download 2504 ms overlapping gunzip 611 ms, parse 2955 ms, sort 0 ms, write 0 ms, index 899 ms: 7 candidates, 84610 repo-hours, 746 releases; waiting 528 ms; commit 0 ms)
2026-11-08T12:07:24Z [load_day 2025-05-24] 2025-05-24 hour 2: 131409 events in 0 files, snapshot none (task 5950 ms: download 3206 ms overlapping gunzip 826 ms, parse 3632 ms, sort 0 ms, write 0 ms, index 664 ms: 6 candidates, 60630 repo-hours, 726 releases; waiting 461 ms; commit 0 ms)
2026-11-08T12:07:24Z [load_day 2025-05-24] 2025-05-24 hour 3: 136745 events in 0 files, snapshot none (task 5662 ms: download 2664 ms overlapping gunzip 845 ms, parse 3430 ms, sort 0 ms, write 0 ms, index 527 ms: 1 candidates, 61097 repo-hours, 2300 releases; waiting 489 ms; commit 0 ms)
2026-11-08T12:07:30Z [load_day 2025-05-24] 2025-05-24 hour 4: 128825 events in 0 files, snapshot none (task 5089 ms: download 2868 ms overlapping gunzip 693 ms, parse 3085 ms, sort 0 ms, write 0 ms, index 527 ms: 7 candidates, 56200 repo-hours, 561 releases; waiting 496 ms; commit 0 ms)
2026-11-08T12:07:30Z [load_day 2025-05-24] 2025-05-24 hour 5: 134160 events in 0 files, snapshot none (task 5171 ms: download 2273 ms overlapping gunzip 923 ms, parse 3304 ms, sort 0 ms, write 0 ms, index 507 ms: 2 candidates, 57039 repo-hours, 601 releases; waiting 185 ms; commit 0 ms)
2026-11-08T12:07:36Z [load_day 2025-05-24] 2025-05-24 hour 6: 138491 events in 0 files, snapshot none (task 5529 ms: download 2998 ms overlapping gunzip 802 ms, parse 3262 ms, sort 0 ms, write 0 ms, index 631 ms: 4 candidates, 68073 repo-hours, 799 releases; waiting 504 ms; commit 0 ms)
2026-11-08T12:07:36Z [load_day 2025-05-24] 2025-05-24 hour 7: 136827 events in 0 files, snapshot none (task 5427 ms: download 2736 ms overlapping gunzip 855 ms, parse 3438 ms, sort 0 ms, write 0 ms, index 503 ms: 12 candidates, 60612 repo-hours, 706 releases; waiting 340 ms; commit 0 ms)
2026-11-08T12:07:42Z [load_day 2025-05-24] 2025-05-24 hour 8: 144590 events in 0 files, snapshot none (task 5697 ms: download 2883 ms overlapping gunzip 873 ms, parse 3433 ms, sort 0 ms, write 0 ms, index 518 ms: 9 candidates, 64389 repo-hours, 753 releases; waiting 569 ms; commit 0 ms)
2026-11-08T12:07:42Z [load_day 2025-05-24] 2025-05-24 hour 9: 147005 events in 0 files, snapshot none (task 5509 ms: download 2338 ms overlapping gunzip 826 ms, parse 3462 ms, sort 0 ms, write 0 ms, index 652 ms: 6 candidates, 66811 repo-hours, 904 releases; waiting 270 ms; commit 0 ms)
2026-11-08T12:07:48Z [load_day 2025-05-24] 2025-05-24 hour 10: 144802 events in 0 files, snapshot none (task 5508 ms: download 2659 ms overlapping gunzip 789 ms, parse 3398 ms, sort 0 ms, write 0 ms, index 521 ms: 4 candidates, 64898 repo-hours, 730 releases; waiting 517 ms; commit 0 ms)
2026-11-08T12:07:49Z [load_day 2025-05-24] 2025-05-24 hour 11: 148376 events in 0 files, snapshot none (task 5865 ms: download 2984 ms overlapping gunzip 899 ms, parse 3693 ms, sort 0 ms, write 0 ms, index 477 ms: 5 candidates, 64246 repo-hours, 688 releases; waiting 380 ms; commit 0 ms)
2026-11-08T12:07:55Z [load_day 2025-05-24] 2025-05-24 hour 12: 162150 events in 0 files, snapshot none (task 5717 ms: download 2419 ms overlapping gunzip 797 ms, parse 3625 ms, sort 0 ms, write 0 ms, index 762 ms: 8 candidates, 90725 repo-hours, 782 releases; waiting 237 ms; commit 0 ms)
2026-11-08T12:07:56Z [load_day 2025-05-24] 2025-05-24 hour 13: 157595 events in 0 files, snapshot none (task 6450 ms: download 3199 ms overlapping gunzip 944 ms, parse 4084 ms, sort 0 ms, write 0 ms, index 705 ms: 11 candidates, 79592 repo-hours, 638 releases; waiting 468 ms; commit 0 ms)
2026-11-08T12:08:00Z [load_day 2025-05-24] 2025-05-24 hour 14: 149400 events in 0 files, snapshot none (task 4849 ms: download 2729 ms overlapping gunzip 618 ms, parse 2597 ms, sort 0 ms, write 0 ms, index 827 ms: 11 candidates, 68825 repo-hours, 700 releases; waiting 576 ms; commit 0 ms)
2026-11-08T12:08:02Z [load_day 2025-05-24] 2025-05-24 hour 15: 151735 events in 0 files, snapshot none (task 5559 ms: download 3161 ms overlapping gunzip 690 ms, parse 2924 ms, sort 0 ms, write 0 ms, index 938 ms: 7 candidates, 73200 repo-hours, 812 releases; waiting 720 ms; commit 0 ms)
2026-11-08T12:08:06Z [load_day 2025-05-24] 2025-05-24 hour 16: 148808 events in 0 files, snapshot none (task 4925 ms: download 2518 ms overlapping gunzip 657 ms, parse 2893 ms, sort 0 ms, write 0 ms, index 535 ms: 7 candidates, 70385 repo-hours, 653 releases; waiting 466 ms; commit 0 ms)
2026-11-08T12:08:07Z [load_day 2025-05-24] 2025-05-24 hour 17: 146825 events in 0 files, snapshot none (task 4461 ms: download 2560 ms overlapping gunzip 598 ms, parse 2459 ms, sort 0 ms, write 0 ms, index 591 ms: 10 candidates, 66227 repo-hours, 634 releases; waiting 434 ms; commit 0 ms)
2026-11-08T12:08:11Z [load_day 2025-05-24] 2025-05-24 hour 18: 150636 events in 0 files, snapshot none (task 5292 ms: download 2684 ms overlapping gunzip 730 ms, parse 3200 ms, sort 0 ms, write 0 ms, index 590 ms: 6 candidates, 71290 repo-hours, 780 releases; waiting 509 ms; commit 0 ms)
2026-11-08T12:08:12Z [load_day 2025-05-24] 2025-05-24 hour 19: 143378 events in 0 files, snapshot none (task 4512 ms: download 2270 ms overlapping gunzip 583 ms, parse 2652 ms, sort 0 ms, write 0 ms, index 472 ms: 10 candidates, 60778 repo-hours, 693 releases; waiting 478 ms; commit 0 ms)
2026-11-08T12:08:17Z [load_day 2025-05-24] 2025-05-24 hour 20: 141885 events in 0 files, snapshot none (task 5586 ms: download 2629 ms overlapping gunzip 782 ms, parse 3405 ms, sort 0 ms, write 0 ms, index 629 ms: 3 candidates, 59667 repo-hours, 676 releases; waiting 523 ms; commit 0 ms)
2026-11-08T12:08:18Z [load_day 2025-05-24] 2025-05-24 hour 21: 140740 events in 0 files, snapshot none (task 5337 ms: download 2927 ms overlapping gunzip 858 ms, parse 3541 ms, sort 0 ms, write 0 ms, index 485 ms: 5 candidates, 59312 repo-hours, 741 releases; waiting 238 ms; commit 0 ms)
2026-11-08T12:08:22Z [load_day 2025-05-24] 2025-05-24 hour 22: 131645 events in 0 files, snapshot none (task 4080 ms: download 2676 ms overlapping gunzip 480 ms, parse 2109 ms, sort 0 ms, write 0 ms, index 427 ms: 6 candidates, 51925 repo-hours, 786 releases; waiting 782 ms; commit 0 ms)
2026-11-08T12:08:23Z [load_day 2025-05-24] 2025-05-24 hour 23: 128827 events in 0 files, snapshot none (task 4418 ms: download 2969 ms overlapping gunzip 515 ms, parse 2178 ms, sort 0 ms, write 0 ms, index 381 ms: 7 candidates, 51953 repo-hours, 700 releases; waiting 1058 ms; commit 0 ms)
2026-11-08T12:08:30Z [load_day 2025-05-24] 2025-05-24: repo_hour merged from 24 files to 1 (1581756 rows, 7265 ms)
2026-11-08T12:08:33Z [load_day 2025-05-24] 2025-05-24: index committed in 10053 ms (24 + 1 + 24 files)
2026-11-08T12:08:33Z [load_day 2025-05-24] 2025-05-24: 3423939 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:08:33Z [load_day 2025-05-24] attempt 1 succeeded