orcaLog in

Runs · run 2042

load_day 2024-02-03, attempt 1 succeeded

Host
73ccef5e07c2:82533
Started
2026-11-08T04:28:27Z
Ended
2026-11-08T04:29:58Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
588 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
122.1 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2042/load_day/2024-02-03/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:28:27Z [load_day 2024-02-03] attempt 1 started
2026-11-08T04:28:28Z [load_day 2024-02-03] 2024-02-03: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:28:36Z [load_day 2024-02-03] 2024-02-03 hour 0: 223837 events in 0 files, snapshot none (task 7950 ms: download 4310 ms overlapping gunzip 1185 ms, parse 5288 ms, sort 0 ms, write 0 ms, index 726 ms: 9 candidates, 84223 repo-hours, 984 releases; waiting 476 ms; commit 0 ms)
2026-11-08T04:28:36Z [load_day 2024-02-03] 2024-02-03 hour 1: 211049 events in 0 files, snapshot none (task 7187 ms: download 3498 ms overlapping gunzip 978 ms, parse 4331 ms, sort 0 ms, write 0 ms, index 1167 ms: 7 candidates, 81137 repo-hours, 694 releases; waiting 494 ms; commit 0 ms)
2026-11-08T04:28:43Z [load_day 2024-02-03] 2024-02-03 hour 2: 180599 events in 0 files, snapshot none (task 6237 ms: download 3511 ms overlapping gunzip 930 ms, parse 3929 ms, sort 0 ms, write 0 ms, index 563 ms: 9 candidates, 45816 repo-hours, 642 releases; waiting 513 ms; commit 0 ms)
2026-11-08T04:28:43Z [load_day 2024-02-03] 2024-02-03 hour 3: 182225 events in 0 files, snapshot none (task 6329 ms: download 3220 ms overlapping gunzip 1010 ms, parse 4000 ms, sort 0 ms, write 0 ms, index 515 ms: 3 candidates, 47322 repo-hours, 850 releases; waiting 506 ms; commit 0 ms)
2026-11-08T04:28:49Z [load_day 2024-02-03] 2024-02-03 hour 4: 185163 events in 0 files, snapshot none (task 5952 ms: download 3346 ms overlapping gunzip 885 ms, parse 3905 ms, sort 0 ms, write 0 ms, index 434 ms: 2 candidates, 48846 repo-hours, 524 releases; waiting 475 ms; commit 0 ms)
2026-11-08T04:28:49Z [load_day 2024-02-03] 2024-02-03 hour 5: 190468 events in 0 files, snapshot none (task 5894 ms: download 3452 ms overlapping gunzip 885 ms, parse 3812 ms, sort 0 ms, write 0 ms, index 487 ms: 5 candidates, 50813 repo-hours, 658 releases; waiting 460 ms; commit 0 ms)
2026-11-08T04:28:56Z [load_day 2024-02-03] 2024-02-03 hour 6: 204634 events in 0 files, snapshot none (task 6108 ms: download 3470 ms overlapping gunzip 884 ms, parse 3980 ms, sort 0 ms, write 0 ms, index 527 ms: 3 candidates, 57061 repo-hours, 968 releases; waiting 479 ms; commit 0 ms)
2026-11-08T04:28:56Z [load_day 2024-02-03] 2024-02-03 hour 7: 197542 events in 0 files, snapshot none (task 6002 ms: download 3363 ms overlapping gunzip 858 ms, parse 3979 ms, sort 0 ms, write 0 ms, index 403 ms: 5 candidates, 51616 repo-hours, 817 releases; waiting 493 ms; commit 0 ms)
2026-11-08T04:29:01Z [load_day 2024-02-03] 2024-02-03 hour 8: 202461 events in 0 files, snapshot none (task 4754 ms: download 2358 ms overlapping gunzip 629 ms, parse 2841 ms, sort 0 ms, write 0 ms, index 506 ms: 3 candidates, 54064 repo-hours, 745 releases; waiting 515 ms; commit 0 ms)
2026-11-08T04:29:01Z [load_day 2024-02-03] 2024-02-03 hour 9: 203212 events in 0 files, snapshot none (task 5067 ms: download 2345 ms overlapping gunzip 693 ms, parse 3080 ms, sort 0 ms, write 0 ms, index 494 ms: 7 candidates, 54977 repo-hours, 820 releases; waiting 501 ms; commit 0 ms)
2026-11-08T04:29:07Z [load_day 2024-02-03] 2024-02-03 hour 10: 209642 events in 0 files, snapshot none (task 5139 ms: download 2758 ms overlapping gunzip 713 ms, parse 3171 ms, sort 0 ms, write 0 ms, index 432 ms: 4 candidates, 60425 repo-hours, 709 releases; waiting 546 ms; commit 0 ms)
2026-11-08T04:29:07Z [load_day 2024-02-03] 2024-02-03 hour 11: 208024 events in 0 files, snapshot none (task 4926 ms: download 2598 ms overlapping gunzip 689 ms, parse 3046 ms, sort 0 ms, write 0 ms, index 405 ms: 2 candidates, 55670 repo-hours, 644 releases; waiting 508 ms; commit 0 ms)
2026-11-08T04:29:14Z [load_day 2024-02-03] 2024-02-03 hour 12: 284783 events in 0 files, snapshot none (task 6410 ms: download 2912 ms overlapping gunzip 776 ms, parse 3788 ms, sort 0 ms, write 0 ms, index 1166 ms: 2 candidates, 89637 repo-hours, 1456 releases; waiting 244 ms; commit 0 ms)
2026-11-08T04:29:14Z [load_day 2024-02-03] 2024-02-03 hour 13: 232853 events in 0 files, snapshot none (task 6267 ms: download 3368 ms overlapping gunzip 822 ms, parse 3700 ms, sort 0 ms, write 0 ms, index 943 ms: 3 candidates, 78760 repo-hours, 702 releases; waiting 529 ms; commit 0 ms)
2026-11-08T04:29:22Z [load_day 2024-02-03] 2024-02-03 hour 14: 221391 events in 0 files, snapshot none (task 7205 ms: download 3853 ms overlapping gunzip 1009 ms, parse 4241 ms, sort 0 ms, write 0 ms, index 1112 ms: 2 candidates, 65539 repo-hours, 708 releases; waiting 535 ms; commit 0 ms)
2026-11-08T04:29:22Z [load_day 2024-02-03] 2024-02-03 hour 15: 224917 events in 0 files, snapshot none (task 7285 ms: download 3758 ms overlapping gunzip 1003 ms, parse 4728 ms, sort 0 ms, write 0 ms, index 805 ms: 2 candidates, 68792 repo-hours, 902 releases; waiting 476 ms; commit 0 ms)
2026-11-08T04:29:29Z [load_day 2024-02-03] 2024-02-03 hour 16: 224479 events in 0 files, snapshot none (task 7051 ms: download 3606 ms overlapping gunzip 1012 ms, parse 4532 ms, sort 0 ms, write 0 ms, index 781 ms: 4 candidates, 67890 repo-hours, 810 releases; waiting 465 ms; commit 0 ms)
2026-11-08T04:29:29Z [load_day 2024-02-03] 2024-02-03 hour 17: 216893 events in 0 files, snapshot none (task 6391 ms: download 2987 ms overlapping gunzip 955 ms, parse 4167 ms, sort 0 ms, write 0 ms, index 596 ms: 8 candidates, 65633 repo-hours, 756 releases; waiting 374 ms; commit 0 ms)
2026-11-08T04:29:36Z [load_day 2024-02-03] 2024-02-03 hour 18: 221269 events in 0 files, snapshot none (task 6529 ms: download 3535 ms overlapping gunzip 921 ms, parse 4291 ms, sort 0 ms, write 0 ms, index 547 ms: 10 candidates, 71398 repo-hours, 836 releases; waiting 465 ms; commit 0 ms)
2026-11-08T04:29:36Z [load_day 2024-02-03] 2024-02-03 hour 19: 206301 events in 0 files, snapshot none (task 6256 ms: download 3108 ms overlapping gunzip 866 ms, parse 4006 ms, sort 0 ms, write 0 ms, index 597 ms: 5 candidates, 58489 repo-hours, 720 releases; waiting 520 ms; commit 0 ms)
2026-11-08T04:29:43Z [load_day 2024-02-03] 2024-02-03 hour 20: 202827 events in 0 files, snapshot none (task 5948 ms: download 3244 ms overlapping gunzip 834 ms, parse 3783 ms, sort 0 ms, write 0 ms, index 469 ms: 5 candidates, 59141 repo-hours, 783 releases; waiting 569 ms; commit 0 ms)
2026-11-08T04:29:43Z [load_day 2024-02-03] 2024-02-03 hour 21: 193519 events in 0 files, snapshot none (task 5703 ms: download 3202 ms overlapping gunzip 817 ms, parse 3614 ms, sort 0 ms, write 0 ms, index 479 ms: 5 candidates, 54283 repo-hours, 821 releases; waiting 534 ms; commit 0 ms)
2026-11-08T04:29:49Z [load_day 2024-02-03] 2024-02-03 hour 22: 180718 events in 0 files, snapshot none (task 5249 ms: download 2550 ms overlapping gunzip 732 ms, parse 3233 ms, sort 0 ms, write 0 ms, index 583 ms: 3 candidates, 48945 repo-hours, 790 releases; waiting 455 ms; commit 0 ms)
2026-11-08T04:29:49Z [load_day 2024-02-03] 2024-02-03 hour 23: 176676 events in 0 files, snapshot none (task 5129 ms: download 2370 ms overlapping gunzip 795 ms, parse 3313 ms, sort 0 ms, write 0 ms, index 320 ms: 5 candidates, 46378 repo-hours, 558 releases; waiting 454 ms; commit 0 ms)
2026-11-08T04:29:56Z [load_day 2024-02-03] 2024-02-03: repo_hour merged from 24 files to 1 (1466855 rows, 7225 ms)
2026-11-08T04:29:58Z [load_day 2024-02-03] 2024-02-03: index committed in 9505 ms (24 + 1 + 24 files)
2026-11-08T04:29:58Z [load_day 2024-02-03] 2024-02-03: 4985482 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:29:58Z [load_day 2024-02-03] attempt 1 succeeded