orcaLog in

Runs · run 3945

load_day 2025-05-25, attempt 1 succeeded

Host
73ccef5e07c2:311702
Started
2026-11-08T12:08:31Z
Ended
2026-11-08T12:09:51Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
632 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
110.7 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3945/load_day/2025-05-25/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:08:31Z [load_day 2025-05-25] attempt 1 started
2026-11-08T12:08:32Z [load_day 2025-05-25] 2025-05-25: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:08:36Z [load_day 2025-05-25] 2025-05-25 hour 0: 126762 events in 0 files, snapshot none (task 4015 ms: download 1855 ms overlapping gunzip 528 ms, parse 2248 ms, sort 0 ms, write 0 ms, index 659 ms: 10 candidates, 59497 repo-hours, 964 releases; waiting 305 ms; commit 0 ms)
2026-11-08T12:08:37Z [load_day 2025-05-25] 2025-05-25 hour 1: 140607 events in 0 files, snapshot none (task 4729 ms: download 2448 ms overlapping gunzip 542 ms, parse 2412 ms, sort 0 ms, write 0 ms, index 999 ms: 13 candidates, 81575 repo-hours, 684 releases; waiting 511 ms; commit 0 ms)
2026-11-08T12:08:42Z [load_day 2025-05-25] 2025-05-25 hour 2: 129980 events in 0 files, snapshot none (task 4697 ms: download 2447 ms overlapping gunzip 665 ms, parse 2810 ms, sort 0 ms, write 0 ms, index 417 ms: 1 candidates, 63694 repo-hours, 817 releases; waiting 513 ms; commit 0 ms)
2026-11-08T12:08:42Z [load_day 2025-05-25] 2025-05-25 hour 3: 134664 events in 0 files, snapshot none (task 4924 ms: download 2731 ms overlapping gunzip 742 ms, parse 2900 ms, sort 0 ms, write 0 ms, index 463 ms: 5 candidates, 60712 repo-hours, 2169 releases; waiting 511 ms; commit 0 ms)
2026-11-08T12:08:47Z [load_day 2025-05-25] 2025-05-25 hour 4: 132215 events in 0 files, snapshot none (task 4874 ms: download 2519 ms overlapping gunzip 692 ms, parse 3021 ms, sort 0 ms, write 0 ms, index 394 ms: 3 candidates, 54326 repo-hours, 743 releases; waiting 486 ms; commit 0 ms)
2026-11-08T12:08:48Z [load_day 2025-05-25] 2025-05-25 hour 5: 134829 events in 0 files, snapshot none (task 5035 ms: download 2620 ms overlapping gunzip 772 ms, parse 3077 ms, sort 0 ms, write 0 ms, index 416 ms: 10 candidates, 55732 repo-hours, 682 releases; waiting 453 ms; commit 0 ms)
2026-11-08T12:08:53Z [load_day 2025-05-25] 2025-05-25 hour 6: 141342 events in 0 files, snapshot none (task 5345 ms: download 2431 ms overlapping gunzip 726 ms, parse 3089 ms, sort 0 ms, write 0 ms, index 704 ms: 3 candidates, 66242 repo-hours, 766 releases; waiting 492 ms; commit 0 ms)
2026-11-08T12:08:54Z [load_day 2025-05-25] 2025-05-25 hour 7: 142795 events in 0 files, snapshot none (task 5661 ms: download 2689 ms overlapping gunzip 832 ms, parse 3512 ms, sort 0 ms, write 0 ms, index 468 ms: 7 candidates, 61148 repo-hours, 623 releases; waiting 513 ms; commit 0 ms)
2026-11-08T12:08:59Z [load_day 2025-05-25] 2025-05-25 hour 8: 142378 events in 0 files, snapshot none (task 5676 ms: download 2826 ms overlapping gunzip 727 ms, parse 3078 ms, sort 0 ms, write 0 ms, index 612 ms: 7 candidates, 64339 repo-hours, 652 releases; waiting 883 ms; commit 0 ms)
2026-11-08T12:09:00Z [load_day 2025-05-25] 2025-05-25 hour 9: 144714 events in 0 files, snapshot none (task 5322 ms: download 3561 ms overlapping gunzip 716 ms, parse 3174 ms, sort 0 ms, write 0 ms, index 520 ms: 11 candidates, 65533 repo-hours, 693 releases; waiting 584 ms; commit 0 ms)
2026-11-08T12:09:05Z [load_day 2025-05-25] 2025-05-25 hour 10: 144702 events in 0 files, snapshot none (task 4865 ms: download 2346 ms overlapping gunzip 607 ms, parse 2569 ms, sort 0 ms, write 0 ms, index 788 ms: 2 candidates, 66347 repo-hours, 602 releases; waiting 524 ms; commit 0 ms)
2026-11-08T12:09:05Z [load_day 2025-05-25] 2025-05-25 hour 11: 146383 events in 0 files, snapshot none (task 4491 ms: download 2533 ms overlapping gunzip 651 ms, parse 2861 ms, sort 0 ms, write 0 ms, index 487 ms: 5 candidates, 63015 repo-hours, 614 releases; waiting 197 ms; commit 0 ms)
2026-11-08T12:09:10Z [load_day 2025-05-25] 2025-05-25 hour 12: 161926 events in 0 files, snapshot none (task 4956 ms: download 2088 ms overlapping gunzip 597 ms, parse 2754 ms, sort 0 ms, write 0 ms, index 880 ms: 6 candidates, 93196 repo-hours, 731 releases; waiting 373 ms; commit 0 ms)
2026-11-08T12:09:11Z [load_day 2025-05-25] 2025-05-25 hour 13: 157663 events in 0 files, snapshot none (task 5837 ms: download 2648 ms overlapping gunzip 726 ms, parse 3340 ms, sort 0 ms, write 0 ms, index 863 ms: 4 candidates, 81418 repo-hours, 634 releases; waiting 503 ms; commit 0 ms)
2026-11-08T12:09:16Z [load_day 2025-05-25] 2025-05-25 hour 14: 151719 events in 0 files, snapshot none (task 5146 ms: download 2467 ms overlapping gunzip 709 ms, parse 3115 ms, sort 0 ms, write 0 ms, index 654 ms: 9 candidates, 71953 repo-hours, 724 releases; waiting 381 ms; commit 0 ms)
2026-11-08T12:09:17Z [load_day 2025-05-25] 2025-05-25 hour 15: 155336 events in 0 files, snapshot none (task 5303 ms: download 2635 ms overlapping gunzip 703 ms, parse 3058 ms, sort 0 ms, write 0 ms, index 716 ms: 10 candidates, 74433 repo-hours, 827 releases; waiting 501 ms; commit 0 ms)
2026-11-08T12:09:22Z [load_day 2025-05-25] 2025-05-25 hour 16: 154886 events in 0 files, snapshot none (task 5640 ms: download 3011 ms overlapping gunzip 797 ms, parse 3308 ms, sort 0 ms, write 0 ms, index 700 ms: 3 candidates, 73656 repo-hours, 685 releases; waiting 531 ms; commit 0 ms)
2026-11-08T12:09:23Z [load_day 2025-05-25] 2025-05-25 hour 17: 151265 events in 0 files, snapshot none (task 5410 ms: download 2865 ms overlapping gunzip 795 ms, parse 3192 ms, sort 0 ms, write 0 ms, index 563 ms: 8 candidates, 68136 repo-hours, 656 releases; waiting 533 ms; commit 0 ms)
2026-11-08T12:09:29Z [load_day 2025-05-25] 2025-05-25 hour 18: 157397 events in 0 files, snapshot none (task 6416 ms: download 2635 ms overlapping gunzip 934 ms, parse 3780 ms, sort 0 ms, write 0 ms, index 893 ms: 7 candidates, 78873 repo-hours, 781 releases; waiting 502 ms; commit 0 ms)
2026-11-08T12:09:30Z [load_day 2025-05-25] 2025-05-25 hour 19: 144512 events in 0 files, snapshot none (task 5647 ms: download 2733 ms overlapping gunzip 863 ms, parse 3754 ms, sort 0 ms, write 0 ms, index 518 ms: 3 candidates, 63895 repo-hours, 681 releases; waiting 208 ms; commit 0 ms)
2026-11-08T12:09:35Z [load_day 2025-05-25] 2025-05-25 hour 20: 141782 events in 0 files, snapshot none (task 6144 ms: download 2711 ms overlapping gunzip 796 ms, parse 3390 ms, sort 0 ms, write 0 ms, index 1249 ms: 5 candidates, 65392 repo-hours, 729 releases; waiting 456 ms; commit 0 ms)
2026-11-08T12:09:36Z [load_day 2025-05-25] 2025-05-25 hour 21: 140226 events in 0 files, snapshot none (task 6053 ms: download 3108 ms overlapping gunzip 825 ms, parse 3686 ms, sort 0 ms, write 0 ms, index 457 ms: 1 candidates, 60853 repo-hours, 886 releases; waiting 533 ms; commit 0 ms)
2026-11-08T12:09:40Z [load_day 2025-05-25] 2025-05-25 hour 22: 132295 events in 0 files, snapshot none (task 4052 ms: download 2134 ms overlapping gunzip 524 ms, parse 2343 ms, sort 0 ms, write 0 ms, index 470 ms: 6 candidates, 55837 repo-hours, 736 releases; waiting 337 ms; commit 0 ms)
2026-11-08T12:09:41Z [load_day 2025-05-25] 2025-05-25 hour 23: 131326 events in 0 files, snapshot none (task 4198 ms: download 1891 ms overlapping gunzip 577 ms, parse 2561 ms, sort 0 ms, write 0 ms, index 466 ms: 9 candidates, 54105 repo-hours, 569 releases; waiting 266 ms; commit 0 ms)
2026-11-08T12:09:48Z [load_day 2025-05-25] 2025-05-25: repo_hour merged from 24 files to 1 (1603907 rows, 7711 ms)
2026-11-08T12:09:51Z [load_day 2025-05-25] 2025-05-25: index committed in 10499 ms (24 + 1 + 24 files)
2026-11-08T12:09:51Z [load_day 2025-05-25] 2025-05-25: 3441704 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:09:51Z [load_day 2025-05-25] attempt 1 succeeded