orcaLog in

Runs · run 3948

load_day 2025-05-26, attempt 1 succeeded

Host
73ccef5e07c2:311765
Started
2026-11-08T12:08:33Z
Ended
2026-11-08T12:10:09Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
685 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
138.4 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3948/load_day/2025-05-26/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:08:33Z [load_day 2025-05-26] attempt 1 started
2026-11-08T12:08:34Z [load_day 2025-05-26] 2025-05-26: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:08:41Z [load_day 2025-05-26] 2025-05-26 hour 0: 141729 events in 0 files, snapshot none (task 6447 ms: download 4395 ms overlapping gunzip 858 ms, parse 3493 ms, sort 0 ms, write 0 ms, index 533 ms: 11 candidates, 68777 repo-hours, 1076 releases; waiting 1230 ms; commit 0 ms)
2026-11-08T12:08:41Z [load_day 2025-05-26] 2025-05-26 hour 1: 153750 events in 0 files, snapshot none (task 5804 ms: download 2708 ms overlapping gunzip 835 ms, parse 3387 ms, sort 0 ms, write 0 ms, index 762 ms: 5 candidates, 90021 repo-hours, 755 releases; waiting 487 ms; commit 0 ms)
2026-11-08T12:08:48Z [load_day 2025-05-26] 2025-05-26 hour 2: 145828 events in 0 files, snapshot none (task 6421 ms: download 3883 ms overlapping gunzip 977 ms, parse 4020 ms, sort 0 ms, write 0 ms, index 559 ms: 10 candidates, 73222 repo-hours, 715 releases; waiting 553 ms; commit 0 ms)
2026-11-08T12:08:48Z [load_day 2025-05-26] 2025-05-26 hour 3: 146789 events in 0 files, snapshot none (task 6458 ms: download 3640 ms overlapping gunzip 1061 ms, parse 3998 ms, sort 0 ms, write 0 ms, index 614 ms: 11 candidates, 70851 repo-hours, 1778 releases; waiting 529 ms; commit 0 ms)
2026-11-08T12:08:55Z [load_day 2025-05-26] 2025-05-26 hour 4: 144671 events in 0 files, snapshot none (task 6393 ms: download 3913 ms overlapping gunzip 995 ms, parse 4101 ms, sort 0 ms, write 0 ms, index 506 ms: 3 candidates, 64415 repo-hours, 739 releases; waiting 501 ms; commit 0 ms)
2026-11-08T12:08:55Z [load_day 2025-05-26] 2025-05-26 hour 5: 148881 events in 0 files, snapshot none (task 6919 ms: download 4617 ms overlapping gunzip 1157 ms, parse 4398 ms, sort 0 ms, write 0 ms, index 550 ms: 4 candidates, 68269 repo-hours, 634 releases; waiting 505 ms; commit 0 ms)
2026-11-08T12:09:02Z [load_day 2025-05-26] 2025-05-26 hour 6: 146788 events in 0 files, snapshot none (task 6027 ms: download 3476 ms overlapping gunzip 879 ms, parse 3739 ms, sort 0 ms, write 0 ms, index 754 ms: 9 candidates, 76445 repo-hours, 759 releases; waiting 427 ms; commit 0 ms)
2026-11-08T12:09:02Z [load_day 2025-05-26] 2025-05-26 hour 7: 84509 events in 0 files, snapshot none (task 4518 ms: download 2354 ms overlapping gunzip 661 ms, parse 2541 ms, sort 0 ms, write 0 ms, index 387 ms: 3 candidates, 48320 repo-hours, 389 releases; waiting 567 ms; commit 0 ms)
2026-11-08T12:09:05Z [load_day 2025-05-26] 2025-05-26 hour 8: 57269 events in 0 files, snapshot none (task 3062 ms: download 1592 ms overlapping gunzip 363 ms, parse 1549 ms, sort 0 ms, write 0 ms, index 344 ms: 3 candidates, 37496 repo-hours, 244 releases; waiting 494 ms; commit 0 ms)
2026-11-08T12:09:07Z [load_day 2025-05-26] 2025-05-26 hour 9: 107291 events in 0 files, snapshot none (task 5261 ms: download 3015 ms overlapping gunzip 757 ms, parse 2898 ms, sort 0 ms, write 0 ms, index 762 ms: 4 candidates, 62226 repo-hours, 563 releases; waiting 518 ms; commit 0 ms)
2026-11-08T12:09:12Z [load_day 2025-05-26] 2025-05-26 hour 10: 159051 events in 0 files, snapshot none (task 6708 ms: download 4143 ms overlapping gunzip 1005 ms, parse 4231 ms, sort 0 ms, write 0 ms, index 726 ms: 10 candidates, 81192 repo-hours, 836 releases; waiting 512 ms; commit 0 ms)
2026-11-08T12:09:15Z [load_day 2025-05-26] 2025-05-26 hour 11: 162664 events in 0 files, snapshot none (task 6781 ms: download 3788 ms overlapping gunzip 1020 ms, parse 3975 ms, sort 0 ms, write 0 ms, index 919 ms: 7 candidates, 78564 repo-hours, 750 releases; waiting 515 ms; commit 0 ms)
2026-11-08T12:09:21Z [load_day 2025-05-26] 2025-05-26 hour 12: 168824 events in 0 files, snapshot none (task 7939 ms: download 3962 ms overlapping gunzip 1172 ms, parse 4641 ms, sort 0 ms, write 0 ms, index 1331 ms: 3 candidates, 100477 repo-hours, 777 releases; waiting 497 ms; commit 0 ms)
2026-11-08T12:09:23Z [load_day 2025-05-26] 2025-05-26 hour 13: 165755 events in 0 files, snapshot none (task 7567 ms: download 5024 ms overlapping gunzip 1048 ms, parse 4620 ms, sort 0 ms, write 0 ms, index 711 ms: 10 candidates, 91799 repo-hours, 888 releases; waiting 932 ms; commit 0 ms)
2026-11-08T12:09:30Z [load_day 2025-05-26] 2025-05-26 hour 14: 166210 events in 0 files, snapshot none (task 8169 ms: download 4841 ms overlapping gunzip 1254 ms, parse 5144 ms, sort 0 ms, write 0 ms, index 830 ms: 9 candidates, 86073 repo-hours, 862 releases; waiting 481 ms; commit 0 ms)
2026-11-08T12:09:31Z [load_day 2025-05-26] 2025-05-26 hour 15: 159936 events in 0 files, snapshot none (task 7182 ms: download 4553 ms overlapping gunzip 1173 ms, parse 4521 ms, sort 0 ms, write 0 ms, index 672 ms: 9 candidates, 82887 repo-hours, 819 releases; waiting 499 ms; commit 0 ms)
2026-11-08T12:09:37Z [load_day 2025-05-26] 2025-05-26 hour 16: 160127 events in 0 files, snapshot none (task 6926 ms: download 4191 ms overlapping gunzip 1113 ms, parse 4354 ms, sort 0 ms, write 0 ms, index 685 ms: 19 candidates, 82673 repo-hours, 763 releases; waiting 508 ms; commit 0 ms)
2026-11-08T12:09:38Z [load_day 2025-05-26] 2025-05-26 hour 17: 159402 events in 0 files, snapshot none (task 7226 ms: download 4123 ms overlapping gunzip 1107 ms, parse 4310 ms, sort 0 ms, write 0 ms, index 1024 ms: 13 candidates, 76278 repo-hours, 791 releases; waiting 444 ms; commit 0 ms)
2026-11-08T12:09:44Z [load_day 2025-05-26] 2025-05-26 hour 18: 162403 events in 0 files, snapshot none (task 5615 ms: download 3018 ms overlapping gunzip 797 ms, parse 3324 ms, sort 0 ms, write 0 ms, index 630 ms: 9 candidates, 84961 repo-hours, 869 releases; waiting 491 ms; commit 0 ms)
2026-11-08T12:09:44Z [load_day 2025-05-26] 2025-05-26 hour 19: 153982 events in 0 files, snapshot none (task 5328 ms: download 3151 ms overlapping gunzip 754 ms, parse 3091 ms, sort 0 ms, write 0 ms, index 552 ms: 4 candidates, 71012 repo-hours, 755 releases; waiting 659 ms; commit 0 ms)
2026-11-08T12:09:50Z [load_day 2025-05-26] 2025-05-26 hour 20: 157093 events in 0 files, snapshot none (task 5062 ms: download 2870 ms overlapping gunzip 780 ms, parse 3203 ms, sort 0 ms, write 0 ms, index 561 ms: 6 candidates, 73118 repo-hours, 785 releases; waiting 245 ms; commit 0 ms)
2026-11-08T12:09:50Z [load_day 2025-05-26] 2025-05-26 hour 21: 149213 events in 0 files, snapshot none (task 5084 ms: download 2786 ms overlapping gunzip 781 ms, parse 3219 ms, sort 0 ms, write 0 ms, index 575 ms: 9 candidates, 65727 repo-hours, 812 releases; waiting 273 ms; commit 0 ms)
2026-11-08T12:09:58Z [load_day 2025-05-26] 2025-05-26 hour 22: 145957 events in 0 files, snapshot none (task 7831 ms: download 5430 ms overlapping gunzip 834 ms, parse 3431 ms, sort 0 ms, write 0 ms, index 487 ms: 6 candidates, 62558 repo-hours, 762 releases; waiting 2760 ms; commit 0 ms)
2026-11-08T12:09:58Z [load_day 2025-05-26] 2025-05-26 hour 23: 139913 events in 0 files, snapshot none (task 5170 ms: download 2420 ms overlapping gunzip 695 ms, parse 2844 ms, sort 0 ms, write 0 ms, index 839 ms: 4 candidates, 59709 repo-hours, 722 releases; waiting 229 ms; commit 0 ms)
2026-11-08T12:10:06Z [load_day 2025-05-26] 2025-05-26: repo_hour merged from 24 files to 1 (1757070 rows, 8232 ms)
2026-11-08T12:10:09Z [load_day 2025-05-26] 2025-05-26: index committed in 11211 ms (24 + 1 + 24 files)
2026-11-08T12:10:09Z [load_day 2025-05-26] 2025-05-26: 3488035 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:10:09Z [load_day 2025-05-26] attempt 1 succeeded