orcaLog in

Runs · run 4158

load_day 2025-07-17, attempt 1 succeeded

Host
73ccef5e07c2:343987
Started
2026-11-08T12:58:10Z
Ended
2026-11-08T12:59:56Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
734 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
155.7 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4158/load_day/2025-07-17/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:58:10Z [load_day 2025-07-17] attempt 1 started
2026-11-08T12:58:11Z [load_day 2025-07-17] 2025-07-17: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:58:17Z [load_day 2025-07-17] 2025-07-17 hour 0: 143210 events in 0 files, snapshot none (task 5859 ms: download 3584 ms overlapping gunzip 740 ms, parse 3087 ms, sort 0 ms, write 0 ms, index 895 ms: 10 candidates, 68353 repo-hours, 1203 releases; waiting 799 ms; commit 0 ms)
2026-11-08T12:58:17Z [load_day 2025-07-17] 2025-07-17 hour 1: 152504 events in 0 files, snapshot none (task 5326 ms: download 2907 ms overlapping gunzip 669 ms, parse 3050 ms, sort 0 ms, write 0 ms, index 744 ms: 5 candidates, 87578 repo-hours, 880 releases; waiting 530 ms; commit 0 ms)
2026-11-08T12:58:23Z [load_day 2025-07-17] 2025-07-17 hour 2: 152340 events in 0 files, snapshot none (task 5531 ms: download 3371 ms overlapping gunzip 777 ms, parse 3179 ms, sort 0 ms, write 0 ms, index 663 ms: 8 candidates, 77035 repo-hours, 858 releases; waiting 518 ms; commit 0 ms)
2026-11-08T12:58:24Z [load_day 2025-07-17] 2025-07-17 hour 3: 145799 events in 0 files, snapshot none (task 6187 ms: download 3225 ms overlapping gunzip 891 ms, parse 3536 ms, sort 0 ms, write 0 ms, index 664 ms: 5 candidates, 67911 repo-hours, 936 releases; waiting 658 ms; commit 0 ms)
2026-11-08T12:58:30Z [load_day 2025-07-17] 2025-07-17 hour 4: 149041 events in 0 files, snapshot none (task 6034 ms: download 3528 ms overlapping gunzip 897 ms, parse 3763 ms, sort 0 ms, write 0 ms, index 580 ms: 4 candidates, 67068 repo-hours, 2098 releases; waiting 576 ms; commit 0 ms)
2026-11-08T12:58:30Z [load_day 2025-07-17] 2025-07-17 hour 5: 150846 events in 0 files, snapshot none (task 5700 ms: download 3289 ms overlapping gunzip 888 ms, parse 3493 ms, sort 0 ms, write 0 ms, index 548 ms: 6 candidates, 67742 repo-hours, 850 releases; waiting 472 ms; commit 0 ms)
2026-11-08T12:58:38Z [load_day 2025-07-17] 2025-07-17 hour 6: 157947 events in 0 files, snapshot none (task 7633 ms: download 4572 ms overlapping gunzip 1121 ms, parse 4805 ms, sort 0 ms, write 0 ms, index 816 ms: 8 candidates, 80015 repo-hours, 933 releases; waiting 544 ms; commit 0 ms)
2026-11-08T12:58:39Z [load_day 2025-07-17] 2025-07-17 hour 7: 160507 events in 0 files, snapshot none (task 8264 ms: download 4968 ms overlapping gunzip 1282 ms, parse 5338 ms, sort 0 ms, write 0 ms, index 658 ms: 6 candidates, 77654 repo-hours, 949 releases; waiting 626 ms; commit 0 ms)
2026-11-08T12:58:48Z [load_day 2025-07-17] 2025-07-17 hour 8: 158401 events in 0 files, snapshot none (task 9866 ms: download 7088 ms overlapping gunzip 1200 ms, parse 5574 ms, sort 0 ms, write 0 ms, index 613 ms: 13 candidates, 79167 repo-hours, 920 releases; waiting 2166 ms; commit 0 ms)
2026-11-08T12:58:48Z [load_day 2025-07-17] 2025-07-17 hour 9: 159722 events in 0 files, snapshot none (task 7925 ms: download 4840 ms overlapping gunzip 1279 ms, parse 5006 ms, sort 0 ms, write 0 ms, index 882 ms: 12 candidates, 81245 repo-hours, 1039 releases; waiting 499 ms; commit 0 ms)
2026-11-08T12:58:56Z [load_day 2025-07-17] 2025-07-17 hour 10: 158738 events in 0 files, snapshot none (task 6860 ms: download 4003 ms overlapping gunzip 1045 ms, parse 4293 ms, sort 0 ms, write 0 ms, index 700 ms: 6 candidates, 77257 repo-hours, 829 releases; waiting 508 ms; commit 0 ms)
2026-11-08T12:58:56Z [load_day 2025-07-17] 2025-07-17 hour 11: 158158 events in 0 files, snapshot none (task 6952 ms: download 4316 ms overlapping gunzip 1033 ms, parse 4439 ms, sort 0 ms, write 0 ms, index 635 ms: 7 candidates, 76103 repo-hours, 775 releases; waiting 541 ms; commit 0 ms)
2026-11-08T12:59:03Z [load_day 2025-07-17] 2025-07-17 hour 12: 164305 events in 0 files, snapshot none (task 7083 ms: download 4390 ms overlapping gunzip 1063 ms, parse 4472 ms, sort 0 ms, write 0 ms, index 723 ms: 5 candidates, 95575 repo-hours, 815 releases; waiting 527 ms; commit 0 ms)
2026-11-08T12:59:03Z [load_day 2025-07-17] 2025-07-17 hour 13: 165298 events in 0 files, snapshot none (task 6414 ms: download 3958 ms overlapping gunzip 1001 ms, parse 4309 ms, sort 0 ms, write 0 ms, index 648 ms: 4 candidates, 90899 repo-hours, 887 releases; waiting 183 ms; commit 0 ms)
2026-11-08T12:59:10Z [load_day 2025-07-17] 2025-07-17 hour 14: 162049 events in 0 files, snapshot none (task 6552 ms: download 4113 ms overlapping gunzip 992 ms, parse 3969 ms, sort 0 ms, write 0 ms, index 630 ms: 8 candidates, 81993 repo-hours, 931 releases; waiting 673 ms; commit 0 ms)
2026-11-08T12:59:10Z [load_day 2025-07-17] 2025-07-17 hour 15: 162612 events in 0 files, snapshot none (task 5789 ms: download 3340 ms overlapping gunzip 930 ms, parse 3767 ms, sort 0 ms, write 0 ms, index 596 ms: 7 candidates, 82668 repo-hours, 943 releases; waiting 238 ms; commit 0 ms)
2026-11-08T12:59:16Z [load_day 2025-07-17] 2025-07-17 hour 16: 164977 events in 0 files, snapshot none (task 5710 ms: download 3694 ms overlapping gunzip 849 ms, parse 3392 ms, sort 0 ms, write 0 ms, index 580 ms: 9 candidates, 82248 repo-hours, 852 releases; waiting 550 ms; commit 0 ms)
2026-11-08T12:59:16Z [load_day 2025-07-17] 2025-07-17 hour 17: 159265 events in 0 files, snapshot none (task 5700 ms: download 3765 ms overlapping gunzip 832 ms, parse 3352 ms, sort 0 ms, write 0 ms, index 595 ms: 3 candidates, 75715 repo-hours, 929 releases; waiting 613 ms; commit 0 ms)
2026-11-08T12:59:25Z [load_day 2025-07-17] 2025-07-17 hour 18: 157774 events in 0 files, snapshot none (task 7783 ms: download 4603 ms overlapping gunzip 1162 ms, parse 4988 ms, sort 0 ms, write 0 ms, index 792 ms: 13 candidates, 80731 repo-hours, 991 releases; waiting 512 ms; commit 0 ms)
2026-11-08T12:59:25Z [load_day 2025-07-17] 2025-07-17 hour 19: 156887 events in 0 files, snapshot none (task 7662 ms: download 4630 ms overlapping gunzip 1228 ms, parse 4918 ms, sort 0 ms, write 0 ms, index 640 ms: 9 candidates, 70898 repo-hours, 996 releases; waiting 522 ms; commit 0 ms)
2026-11-08T12:59:31Z [load_day 2025-07-17] 2025-07-17 hour 20: 151280 events in 0 files, snapshot none (task 6293 ms: download 2745 ms overlapping gunzip 956 ms, parse 3787 ms, sort 0 ms, write 0 ms, index 1058 ms: 11 candidates, 70304 repo-hours, 990 releases; waiting 188 ms; commit 0 ms)
2026-11-08T12:59:32Z [load_day 2025-07-17] 2025-07-17 hour 21: 155827 events in 0 files, snapshot none (task 7375 ms: download 4614 ms overlapping gunzip 1303 ms, parse 4983 ms, sort 0 ms, write 0 ms, index 597 ms: 7 candidates, 74401 repo-hours, 1097 releases; waiting 186 ms; commit 0 ms)
2026-11-08T12:59:43Z [load_day 2025-07-17] 2025-07-17 hour 22: 159927 events in 0 files, snapshot none (task 11477 ms: download 8484 ms overlapping gunzip 1983 ms, parse 7486 ms, sort 0 ms, write 0 ms, index 699 ms: 10 candidates, 89147 repo-hours, 793 releases; waiting 873 ms; commit 0 ms)
2026-11-08T12:59:44Z [load_day 2025-07-17] 2025-07-17 hour 23: 154437 events in 0 files, snapshot none (task 10423 ms: download 7697 ms overlapping gunzip 1827 ms, parse 6894 ms, sort 0 ms, write 0 ms, index 793 ms: 2 candidates, 83345 repo-hours, 812 releases; waiting 516 ms; commit 0 ms)
2026-11-08T12:59:53Z [load_day 2025-07-17] 2025-07-17: repo_hour merged from 24 files to 1 (1885052 rows, 8890 ms)
2026-11-08T12:59:56Z [load_day 2025-07-17] 2025-07-17: index committed in 12149 ms (24 + 1 + 24 files)
2026-11-08T12:59:56Z [load_day 2025-07-17] 2025-07-17: 3761851 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:59:56Z [load_day 2025-07-17] attempt 1 succeeded