orcaLog in

Runs · run 4430

load_day 2025-09-23, attempt 1 succeeded

Host
73ccef5e07c2:383438
Started
2026-11-08T13:57:17Z
Ended
2026-11-08T13:59:08Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
755 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
159.0 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4430/load_day/2025-09-23/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:57:17Z [load_day 2025-09-23] attempt 1 started
2026-11-08T13:57:18Z [load_day 2025-09-23] 2025-09-23: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:57:27Z [load_day 2025-09-23] 2025-09-23 hour 0: 153076 events in 0 files, snapshot none (task 8112 ms: download 3796 ms overlapping gunzip 1366 ms, parse 5091 ms, sort 0 ms, write 0 ms, index 830 ms: 11 candidates, 77744 repo-hours, 1016 releases; waiting 449 ms; commit 0 ms)
2026-11-08T13:57:27Z [load_day 2025-09-23] 2025-09-23 hour 1: 166768 events in 0 files, snapshot none (task 8125 ms: download 3671 ms overlapping gunzip 1218 ms, parse 4854 ms, sort 0 ms, write 0 ms, index 1284 ms: 9 candidates, 98283 repo-hours, 718 releases; waiting 477 ms; commit 0 ms)
2026-11-08T13:57:34Z [load_day 2025-09-23] 2025-09-23 hour 2: 150571 events in 0 files, snapshot none (task 6949 ms: download 3809 ms overlapping gunzip 1132 ms, parse 4250 ms, sort 0 ms, write 0 ms, index 714 ms: 14 candidates, 73093 repo-hours, 857 releases; waiting 499 ms; commit 0 ms)
2026-11-08T13:57:34Z [load_day 2025-09-23] 2025-09-23 hour 3: 158605 events in 0 files, snapshot none (task 7037 ms: download 3765 ms overlapping gunzip 1131 ms, parse 4314 ms, sort 0 ms, write 0 ms, index 743 ms: 20 candidates, 70883 repo-hours, 1968 releases; waiting 500 ms; commit 0 ms)
2026-11-08T13:57:41Z [load_day 2025-09-23] 2025-09-23 hour 4: 151900 events in 0 files, snapshot none (task 6215 ms: download 3699 ms overlapping gunzip 966 ms, parse 3878 ms, sort 0 ms, write 0 ms, index 510 ms: 18 candidates, 66564 repo-hours, 590 releases; waiting 498 ms; commit 0 ms)
2026-11-08T13:57:41Z [load_day 2025-09-23] 2025-09-23 hour 5: 158759 events in 0 files, snapshot none (task 6245 ms: download 3913 ms overlapping gunzip 1072 ms, parse 4171 ms, sort 0 ms, write 0 ms, index 534 ms: 13 candidates, 69304 repo-hours, 652 releases; waiting 241 ms; commit 0 ms)
2026-11-08T13:57:49Z [load_day 2025-09-23] 2025-09-23 hour 6: 161493 events in 0 files, snapshot none (task 7191 ms: download 4196 ms overlapping gunzip 1274 ms, parse 4723 ms, sort 0 ms, write 0 ms, index 698 ms: 30 candidates, 82913 repo-hours, 774 releases; waiting 209 ms; commit 0 ms)
2026-11-08T13:57:50Z [load_day 2025-09-23] 2025-09-23 hour 7: 166519 events in 0 files, snapshot none (task 8057 ms: download 5388 ms overlapping gunzip 1344 ms, parse 5371 ms, sort 0 ms, write 0 ms, index 651 ms: 17 candidates, 79208 repo-hours, 766 releases; waiting 459 ms; commit 0 ms)
2026-11-08T13:57:58Z [load_day 2025-09-23] 2025-09-23 hour 8: 170531 events in 0 files, snapshot none (task 8422 ms: download 5234 ms overlapping gunzip 1392 ms, parse 5240 ms, sort 0 ms, write 0 ms, index 770 ms: 14 candidates, 83324 repo-hours, 832 releases; waiting 640 ms; commit 0 ms)
2026-11-08T13:58:00Z [load_day 2025-09-23] 2025-09-23 hour 9: 170018 events in 0 files, snapshot none (task 9852 ms: download 7310 ms overlapping gunzip 1267 ms, parse 5101 ms, sort 0 ms, write 0 ms, index 695 ms: 10 candidates, 83422 repo-hours, 904 releases; waiting 2471 ms; commit 0 ms)
2026-11-08T13:58:08Z [load_day 2025-09-23] 2025-09-23 hour 10: 167358 events in 0 files, snapshot none (task 9569 ms: download 5176 ms overlapping gunzip 1567 ms, parse 6291 ms, sort 0 ms, write 0 ms, index 1060 ms: 11 candidates, 81622 repo-hours, 796 releases; waiting 425 ms; commit 0 ms)
2026-11-08T13:58:10Z [load_day 2025-09-23] 2025-09-23 hour 11: 169004 events in 0 files, snapshot none (task 9100 ms: download 5614 ms overlapping gunzip 1529 ms, parse 5907 ms, sort 0 ms, write 0 ms, index 901 ms: 7 candidates, 78440 repo-hours, 791 releases; waiting 454 ms; commit 0 ms)
2026-11-08T13:58:17Z [load_day 2025-09-23] 2025-09-23 hour 12: 171453 events in 0 files, snapshot none (task 8512 ms: download 3406 ms overlapping gunzip 1336 ms, parse 5694 ms, sort 0 ms, write 0 ms, index 922 ms: 13 candidates, 100836 repo-hours, 846 releases; waiting 327 ms; commit 0 ms)
2026-11-08T13:58:20Z [load_day 2025-09-23] 2025-09-23 hour 13: 172891 events in 0 files, snapshot none (task 9620 ms: download 5686 ms overlapping gunzip 1400 ms, parse 5991 ms, sort 0 ms, write 0 ms, index 1072 ms: 7 candidates, 94804 repo-hours, 857 releases; waiting 613 ms; commit 0 ms)
2026-11-08T13:58:25Z [load_day 2025-09-23] 2025-09-23 hour 14: 171146 events in 0 files, snapshot none (task 8017 ms: download 3922 ms overlapping gunzip 1280 ms, parse 5125 ms, sort 0 ms, write 0 ms, index 960 ms: 11 candidates, 87323 repo-hours, 836 releases; waiting 281 ms; commit 0 ms)
2026-11-08T13:58:28Z [load_day 2025-09-23] 2025-09-23 hour 15: 170954 events in 0 files, snapshot none (task 7952 ms: download 4783 ms overlapping gunzip 1176 ms, parse 4984 ms, sort 0 ms, write 0 ms, index 855 ms: 22 candidates, 86352 repo-hours, 866 releases; waiting 530 ms; commit 0 ms)
2026-11-08T13:58:33Z [load_day 2025-09-23] 2025-09-23 hour 16: 168950 events in 0 files, snapshot none (task 6623 ms: download 3670 ms overlapping gunzip 933 ms, parse 3923 ms, sort 0 ms, write 0 ms, index 1070 ms: 16 candidates, 85591 repo-hours, 767 releases; waiting 378 ms; commit 0 ms)
2026-11-08T13:58:36Z [load_day 2025-09-23] 2025-09-23 hour 17: 162841 events in 0 files, snapshot none (task 7397 ms: download 4202 ms overlapping gunzip 1089 ms, parse 4498 ms, sort 0 ms, write 0 ms, index 886 ms: 10 candidates, 79970 repo-hours, 747 releases; waiting 490 ms; commit 0 ms)
2026-11-08T13:58:43Z [load_day 2025-09-23] 2025-09-23 hour 18: 168638 events in 0 files, snapshot none (task 9601 ms: download 6230 ms overlapping gunzip 1286 ms, parse 5239 ms, sort 0 ms, write 0 ms, index 1051 ms: 10 candidates, 84699 repo-hours, 841 releases; waiting 1718 ms; commit 0 ms)
2026-11-08T13:58:44Z [load_day 2025-09-23] 2025-09-23 hour 19: 166258 events in 0 files, snapshot none (task 7071 ms: download 4009 ms overlapping gunzip 1041 ms, parse 4466 ms, sort 0 ms, write 0 ms, index 715 ms: 8 candidates, 74416 repo-hours, 801 releases; waiting 540 ms; commit 0 ms)
2026-11-08T13:58:50Z [load_day 2025-09-23] 2025-09-23 hour 20: 161044 events in 0 files, snapshot none (task 6957 ms: download 4733 ms overlapping gunzip 1151 ms, parse 4240 ms, sort 0 ms, write 0 ms, index 558 ms: 13 candidates, 73074 repo-hours, 832 releases; waiting 709 ms; commit 0 ms)
2026-11-08T13:58:51Z [load_day 2025-09-23] 2025-09-23 hour 21: 160015 events in 0 files, snapshot none (task 6310 ms: download 3763 ms overlapping gunzip 1002 ms, parse 3830 ms, sort 0 ms, write 0 ms, index 538 ms: 16 candidates, 68786 repo-hours, 791 releases; waiting 490 ms; commit 0 ms)
2026-11-08T13:58:57Z [load_day 2025-09-23] 2025-09-23 hour 22: 151107 events in 0 files, snapshot none (task 5810 ms: download 3906 ms overlapping gunzip 902 ms, parse 3500 ms, sort 0 ms, write 0 ms, index 458 ms: 8 candidates, 63653 repo-hours, 822 releases; waiting 533 ms; commit 0 ms)
2026-11-08T13:58:57Z [load_day 2025-09-23] 2025-09-23 hour 23: 152671 events in 0 files, snapshot none (task 5697 ms: download 3376 ms overlapping gunzip 887 ms, parse 3601 ms, sort 0 ms, write 0 ms, index 436 ms: 7 candidates, 62641 repo-hours, 815 releases; waiting 494 ms; commit 0 ms)
2026-11-08T13:59:05Z [load_day 2025-09-23] 2025-09-23: repo_hour merged from 24 files to 1 (1906945 rows, 8566 ms)
2026-11-08T13:59:08Z [load_day 2025-09-23] 2025-09-23: index committed in 11497 ms (24 + 1 + 24 files)
2026-11-08T13:59:08Z [load_day 2025-09-23] 2025-09-23: 3922570 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:59:08Z [load_day 2025-09-23] attempt 1 succeeded