orcaLog in

Runs · run 4224

load_day 2025-08-02, attempt 1 succeeded

Host
73ccef5e07c2:354074
Started
2026-11-08T13:12:22Z
Ended
2026-11-08T13:13:48Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
611 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
114.4 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4224/load_day/2025-08-02/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:12:22Z [load_day 2025-08-02] attempt 1 started
2026-11-08T13:12:23Z [load_day 2025-08-02] 2025-08-02: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:12:31Z [load_day 2025-08-02] 2025-08-02 hour 0: 138581 events in 0 files, snapshot none (task 7306 ms: download 3871 ms overlapping gunzip 1130 ms, parse 4743 ms, sort 0 ms, write 0 ms, index 819 ms: 5 candidates, 62979 repo-hours, 1168 releases; waiting 301 ms; commit 0 ms)
2026-11-08T13:12:31Z [load_day 2025-08-02] 2025-08-02 hour 1: 148952 events in 0 files, snapshot none (task 7451 ms: download 3474 ms overlapping gunzip 1144 ms, parse 4992 ms, sort 0 ms, write 0 ms, index 829 ms: 5 candidates, 81951 repo-hours, 843 releases; waiting 196 ms; commit 0 ms)
2026-11-08T13:12:37Z [load_day 2025-08-02] 2025-08-02 hour 2: 138860 events in 0 files, snapshot none (task 5709 ms: download 2226 ms overlapping gunzip 762 ms, parse 3249 ms, sort 0 ms, write 0 ms, index 1137 ms: 6 candidates, 63046 repo-hours, 867 releases; waiting 317 ms; commit 0 ms)
2026-11-08T13:12:38Z [load_day 2025-08-02] 2025-08-02 hour 3: 136060 events in 0 files, snapshot none (task 5882 ms: download 3051 ms overlapping gunzip 875 ms, parse 3675 ms, sort 0 ms, write 0 ms, index 531 ms: 8 candidates, 56211 repo-hours, 954 releases; waiting 510 ms; commit 0 ms)
2026-11-08T13:12:42Z [load_day 2025-08-02] 2025-08-02 hour 4: 138710 events in 0 files, snapshot none (task 4474 ms: download 2243 ms overlapping gunzip 593 ms, parse 2678 ms, sort 0 ms, write 0 ms, index 505 ms: 4 candidates, 58177 repo-hours, 1912 releases; waiting 374 ms; commit 0 ms)
2026-11-08T13:12:43Z [load_day 2025-08-02] 2025-08-02 hour 5: 136766 events in 0 files, snapshot none (task 4815 ms: download 2427 ms overlapping gunzip 652 ms, parse 2737 ms, sort 0 ms, write 0 ms, index 462 ms: 6 candidates, 55768 repo-hours, 598 releases; waiting 642 ms; commit 0 ms)
2026-11-08T13:12:48Z [load_day 2025-08-02] 2025-08-02 hour 6: 144872 events in 0 files, snapshot none (task 5326 ms: download 2568 ms overlapping gunzip 789 ms, parse 3367 ms, sort 0 ms, write 0 ms, index 487 ms: 4 candidates, 65156 repo-hours, 920 releases; waiting 450 ms; commit 0 ms)
2026-11-08T13:12:49Z [load_day 2025-08-02] 2025-08-02 hour 7: 148221 events in 0 files, snapshot none (task 5403 ms: download 3500 ms overlapping gunzip 824 ms, parse 3333 ms, sort 0 ms, write 0 ms, index 479 ms: 11 candidates, 59574 repo-hours, 889 releases; waiting 500 ms; commit 0 ms)
2026-11-08T13:12:54Z [load_day 2025-08-02] 2025-08-02 hour 8: 146744 events in 0 files, snapshot none (task 4941 ms: download 2810 ms overlapping gunzip 673 ms, parse 2880 ms, sort 0 ms, write 0 ms, index 524 ms: 5 candidates, 62041 repo-hours, 802 releases; waiting 565 ms; commit 0 ms)
2026-11-08T13:12:54Z [load_day 2025-08-02] 2025-08-02 hour 9: 150839 events in 0 files, snapshot none (task 5064 ms: download 2832 ms overlapping gunzip 721 ms, parse 2992 ms, sort 0 ms, write 0 ms, index 514 ms: 7 candidates, 63381 repo-hours, 1002 releases; waiting 551 ms; commit 0 ms)
2026-11-08T13:12:58Z [load_day 2025-08-02] 2025-08-02 hour 10: 145167 events in 0 files, snapshot none (task 4143 ms: download 2627 ms overlapping gunzip 546 ms, parse 2308 ms, sort 0 ms, write 0 ms, index 496 ms: 7 candidates, 63173 repo-hours, 771 releases; waiting 507 ms; commit 0 ms)
2026-11-08T13:12:59Z [load_day 2025-08-02] 2025-08-02 hour 11: 148137 events in 0 files, snapshot none (task 4325 ms: download 2515 ms overlapping gunzip 578 ms, parse 2419 ms, sort 0 ms, write 0 ms, index 507 ms: 11 candidates, 60551 repo-hours, 701 releases; waiting 509 ms; commit 0 ms)
2026-11-08T13:13:05Z [load_day 2025-08-02] 2025-08-02 hour 12: 156224 events in 0 files, snapshot none (task 6056 ms: download 2734 ms overlapping gunzip 692 ms, parse 2974 ms, sort 0 ms, write 0 ms, index 803 ms: 5 candidates, 86328 repo-hours, 717 releases; waiting 1225 ms; commit 0 ms)
2026-11-08T13:13:05Z [load_day 2025-08-02] 2025-08-02 hour 13: 152485 events in 0 files, snapshot none (task 4635 ms: download 2030 ms overlapping gunzip 597 ms, parse 2706 ms, sort 0 ms, write 0 ms, index 806 ms: 2 candidates, 76998 repo-hours, 724 releases; waiting 232 ms; commit 0 ms)
2026-11-08T13:13:11Z [load_day 2025-08-02] 2025-08-02 hour 14: 152258 events in 0 files, snapshot none (task 5368 ms: download 2957 ms overlapping gunzip 774 ms, parse 3330 ms, sort 0 ms, write 0 ms, index 606 ms: 7 candidates, 67068 repo-hours, 754 releases; waiting 348 ms; commit 0 ms)
2026-11-08T13:13:11Z [load_day 2025-08-02] 2025-08-02 hour 15: 153349 events in 0 files, snapshot none (task 5711 ms: download 3296 ms overlapping gunzip 844 ms, parse 3390 ms, sort 0 ms, write 0 ms, index 569 ms: 4 candidates, 69397 repo-hours, 845 releases; waiting 649 ms; commit 0 ms)
2026-11-08T13:13:17Z [load_day 2025-08-02] 2025-08-02 hour 16: 152675 events in 0 files, snapshot none (task 6182 ms: download 3530 ms overlapping gunzip 895 ms, parse 3964 ms, sort 0 ms, write 0 ms, index 504 ms: 4 candidates, 67901 repo-hours, 798 releases; waiting 526 ms; commit 0 ms)
2026-11-08T13:13:17Z [load_day 2025-08-02] 2025-08-02 hour 17: 153167 events in 0 files, snapshot none (task 5449 ms: download 2920 ms overlapping gunzip 828 ms, parse 3312 ms, sort 0 ms, write 0 ms, index 522 ms: 9 candidates, 64571 repo-hours, 729 releases; waiting 463 ms; commit 0 ms)
2026-11-08T13:13:24Z [load_day 2025-08-02] 2025-08-02 hour 18: 152888 events in 0 files, snapshot none (task 5908 ms: download 3166 ms overlapping gunzip 860 ms, parse 3582 ms, sort 0 ms, write 0 ms, index 684 ms: 8 candidates, 71836 repo-hours, 750 releases; waiting 541 ms; commit 0 ms)
2026-11-08T13:13:24Z [load_day 2025-08-02] 2025-08-02 hour 19: 146886 events in 0 files, snapshot none (task 6142 ms: download 3630 ms overlapping gunzip 968 ms, parse 3945 ms, sort 0 ms, write 0 ms, index 459 ms: 6 candidates, 57069 repo-hours, 637 releases; waiting 460 ms; commit 0 ms)
2026-11-08T13:13:30Z [load_day 2025-08-02] 2025-08-02 hour 20: 143510 events in 0 files, snapshot none (task 5953 ms: download 3350 ms overlapping gunzip 880 ms, parse 3664 ms, sort 0 ms, write 0 ms, index 443 ms: 7 candidates, 58939 repo-hours, 762 releases; waiting 663 ms; commit 0 ms)
2026-11-08T13:13:30Z [load_day 2025-08-02] 2025-08-02 hour 21: 136946 events in 0 files, snapshot none (task 5600 ms: download 2738 ms overlapping gunzip 844 ms, parse 3420 ms, sort 0 ms, write 0 ms, index 435 ms: 5 candidates, 53561 repo-hours, 902 releases; waiting 515 ms; commit 0 ms)
2026-11-08T13:13:37Z [load_day 2025-08-02] 2025-08-02 hour 22: 130120 events in 0 files, snapshot none (task 6012 ms: download 2833 ms overlapping gunzip 936 ms, parse 3830 ms, sort 0 ms, write 0 ms, index 461 ms: 3 candidates, 49883 repo-hours, 810 releases; waiting 473 ms; commit 0 ms)
2026-11-08T13:13:37Z [load_day 2025-08-02] 2025-08-02 hour 23: 127089 events in 0 files, snapshot none (task 5779 ms: download 3143 ms overlapping gunzip 793 ms, parse 3629 ms, sort 0 ms, write 0 ms, index 509 ms: 2 candidates, 48024 repo-hours, 677 releases; waiting 505 ms; commit 0 ms)
2026-11-08T13:13:44Z [load_day 2025-08-02] 2025-08-02: repo_hour merged from 24 files to 1 (1523583 rows, 7734 ms)
2026-11-08T13:13:48Z [load_day 2025-08-02] 2025-08-02: index committed in 11054 ms (24 + 1 + 24 files)
2026-11-08T13:13:48Z [load_day 2025-08-02] 2025-08-02: 3479506 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:13:48Z [load_day 2025-08-02] attempt 1 succeeded