orcaLog in

Runs · run 4471

load_day 2025-10-04, attempt 1 succeeded

Host
73ccef5e07c2:390246
Started
2026-11-08T14:07:52Z
Ended
2026-11-08T14:09:23Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
649 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
123.8 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4471/load_day/2025-10-04/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:07:52Z [load_day 2025-10-04] attempt 1 started
2026-11-08T14:07:53Z [load_day 2025-10-04] 2025-10-04: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:07:59Z [load_day 2025-10-04] 2025-10-04 hour 0: 148595 events in 0 files, snapshot none (task 6219 ms: download 3692 ms overlapping gunzip 952 ms, parse 3857 ms, sort 0 ms, write 0 ms, index 704 ms: 11 candidates, 75690 repo-hours, 991 releases; waiting 439 ms; commit 0 ms)
2026-11-08T14:07:59Z [load_day 2025-10-04] 2025-10-04 hour 1: 156355 events in 0 files, snapshot none (task 6146 ms: download 3701 ms overlapping gunzip 871 ms, parse 3728 ms, sort 0 ms, write 0 ms, index 651 ms: 11 candidates, 87364 repo-hours, 695 releases; waiting 540 ms; commit 0 ms)
2026-11-08T14:08:05Z [load_day 2025-10-04] 2025-10-04 hour 2: 140536 events in 0 files, snapshot none (task 4841 ms: download 3089 ms overlapping gunzip 671 ms, parse 2701 ms, sort 0 ms, write 0 ms, index 476 ms: 7 candidates, 65854 repo-hours, 673 releases; waiting 622 ms; commit 0 ms)
2026-11-08T14:08:05Z [load_day 2025-10-04] 2025-10-04 hour 3: 147179 events in 0 files, snapshot none (task 4609 ms: download 2985 ms overlapping gunzip 663 ms, parse 2677 ms, sort 0 ms, write 0 ms, index 417 ms: 10 candidates, 59934 repo-hours, 2070 releases; waiting 516 ms; commit 0 ms)
2026-11-08T14:08:10Z [load_day 2025-10-04] 2025-10-04 hour 4: 146433 events in 0 files, snapshot none (task 4827 ms: download 3054 ms overlapping gunzip 693 ms, parse 2835 ms, sort 0 ms, write 0 ms, index 464 ms: 5 candidates, 57042 repo-hours, 577 releases; waiting 532 ms; commit 0 ms)
2026-11-08T14:08:10Z [load_day 2025-10-04] 2025-10-04 hour 5: 147525 events in 0 files, snapshot none (task 5126 ms: download 3330 ms overlapping gunzip 757 ms, parse 3001 ms, sort 0 ms, write 0 ms, index 460 ms: 5 candidates, 59512 repo-hours, 590 releases; waiting 612 ms; commit 0 ms)
2026-11-08T14:08:17Z [load_day 2025-10-04] 2025-10-04 hour 6: 149794 events in 0 files, snapshot none (task 6205 ms: download 3839 ms overlapping gunzip 646 ms, parse 2730 ms, sort 0 ms, write 0 ms, index 539 ms: 9 candidates, 69661 repo-hours, 821 releases; waiting 1781 ms; commit 0 ms)
2026-11-08T14:08:17Z [load_day 2025-10-04] 2025-10-04 hour 7: 151624 events in 0 files, snapshot none (task 4621 ms: download 2555 ms overlapping gunzip 689 ms, parse 2818 ms, sort 0 ms, write 0 ms, index 557 ms: 11 candidates, 60242 repo-hours, 821 releases; waiting 235 ms; commit 0 ms)
2026-11-08T14:08:23Z [load_day 2025-10-04] 2025-10-04 hour 8: 154126 events in 0 files, snapshot none (task 5437 ms: download 3525 ms overlapping gunzip 723 ms, parse 2953 ms, sort 0 ms, write 0 ms, index 565 ms: 9 candidates, 67540 repo-hours, 749 releases; waiting 867 ms; commit 0 ms)
2026-11-08T14:08:23Z [load_day 2025-10-04] 2025-10-04 hour 9: 155539 events in 0 files, snapshot none (task 5029 ms: download 3376 ms overlapping gunzip 730 ms, parse 2861 ms, sort 0 ms, write 0 ms, index 496 ms: 9 candidates, 65276 repo-hours, 870 releases; waiting 626 ms; commit 0 ms)
2026-11-08T14:08:30Z [load_day 2025-10-04] 2025-10-04 hour 10: 152052 events in 0 files, snapshot none (task 7061 ms: download 4361 ms overlapping gunzip 1081 ms, parse 4757 ms, sort 0 ms, write 0 ms, index 459 ms: 14 candidates, 65008 repo-hours, 675 releases; waiting 458 ms; commit 0 ms)
2026-11-08T14:08:30Z [load_day 2025-10-04] 2025-10-04 hour 11: 155800 events in 0 files, snapshot none (task 6381 ms: download 3574 ms overlapping gunzip 909 ms, parse 3836 ms, sort 0 ms, write 0 ms, index 704 ms: 5 candidates, 65502 repo-hours, 634 releases; waiting 583 ms; commit 0 ms)
2026-11-08T14:08:38Z [load_day 2025-10-04] 2025-10-04 hour 12: 168792 events in 0 files, snapshot none (task 7247 ms: download 3598 ms overlapping gunzip 1034 ms, parse 4535 ms, sort 0 ms, write 0 ms, index 847 ms: 11 candidates, 94153 repo-hours, 761 releases; waiting 528 ms; commit 0 ms)
2026-11-08T14:08:38Z [load_day 2025-10-04] 2025-10-04 hour 13: 160119 events in 0 files, snapshot none (task 7325 ms: download 4238 ms overlapping gunzip 1113 ms, parse 4919 ms, sort 0 ms, write 0 ms, index 645 ms: 8 candidates, 78580 repo-hours, 711 releases; waiting 373 ms; commit 0 ms)
2026-11-08T14:08:46Z [load_day 2025-10-04] 2025-10-04 hour 14: 161842 events in 0 files, snapshot none (task 7303 ms: download 4069 ms overlapping gunzip 1134 ms, parse 4815 ms, sort 0 ms, write 0 ms, index 654 ms: 16 candidates, 72034 repo-hours, 709 releases; waiting 407 ms; commit 0 ms)
2026-11-08T14:08:47Z [load_day 2025-10-04] 2025-10-04 hour 15: 161020 events in 0 files, snapshot none (task 7828 ms: download 4431 ms overlapping gunzip 1134 ms, parse 5099 ms, sort 0 ms, write 0 ms, index 760 ms: 9 candidates, 74420 repo-hours, 745 releases; waiting 476 ms; commit 0 ms)
2026-11-08T14:08:53Z [load_day 2025-10-04] 2025-10-04 hour 16: 164069 events in 0 files, snapshot none (task 6584 ms: download 4163 ms overlapping gunzip 920 ms, parse 3971 ms, sort 0 ms, write 0 ms, index 616 ms: 16 candidates, 73157 repo-hours, 842 releases; waiting 737 ms; commit 0 ms)
2026-11-08T14:08:53Z [load_day 2025-10-04] 2025-10-04 hour 17: 155123 events in 0 files, snapshot none (task 5902 ms: download 3402 ms overlapping gunzip 847 ms, parse 3544 ms, sort 0 ms, write 0 ms, index 532 ms: 10 candidates, 68302 repo-hours, 732 releases; waiting 683 ms; commit 0 ms)
2026-11-08T14:09:00Z [load_day 2025-10-04] 2025-10-04 hour 18: 163079 events in 0 files, snapshot none (task 6193 ms: download 3668 ms overlapping gunzip 974 ms, parse 4045 ms, sort 0 ms, write 0 ms, index 598 ms: 11 candidates, 76139 repo-hours, 784 releases; waiting 281 ms; commit 0 ms)
2026-11-08T14:09:00Z [load_day 2025-10-04] 2025-10-04 hour 19: 154707 events in 0 files, snapshot none (task 6429 ms: download 3879 ms overlapping gunzip 978 ms, parse 4144 ms, sort 0 ms, write 0 ms, index 459 ms: 14 candidates, 62354 repo-hours, 723 releases; waiting 502 ms; commit 0 ms)
2026-11-08T14:09:06Z [load_day 2025-10-04] 2025-10-04 hour 20: 153229 events in 0 files, snapshot none (task 6100 ms: download 3472 ms overlapping gunzip 872 ms, parse 3721 ms, sort 0 ms, write 0 ms, index 476 ms: 7 candidates, 64113 repo-hours, 721 releases; waiting 481 ms; commit 0 ms)
2026-11-08T14:09:06Z [load_day 2025-10-04] 2025-10-04 hour 21: 152676 events in 0 files, snapshot none (task 5830 ms: download 3353 ms overlapping gunzip 959 ms, parse 3668 ms, sort 0 ms, write 0 ms, index 467 ms: 6 candidates, 60607 repo-hours, 728 releases; waiting 479 ms; commit 0 ms)
2026-11-08T14:09:13Z [load_day 2025-10-04] 2025-10-04 hour 22: 145453 events in 0 files, snapshot none (task 6195 ms: download 3521 ms overlapping gunzip 981 ms, parse 3843 ms, sort 0 ms, write 0 ms, index 491 ms: 6 candidates, 53221 repo-hours, 827 releases; waiting 507 ms; commit 0 ms)
2026-11-08T14:09:13Z [load_day 2025-10-04] 2025-10-04 hour 23: 141316 events in 0 files, snapshot none (task 5353 ms: download 2740 ms overlapping gunzip 823 ms, parse 3243 ms, sort 0 ms, write 0 ms, index 451 ms: 4 candidates, 53469 repo-hours, 825 releases; waiting 519 ms; commit 0 ms)
2026-11-08T14:09:20Z [load_day 2025-10-04] 2025-10-04: repo_hour merged from 24 files to 1 (1629174 rows, 7093 ms)
2026-11-08T14:09:23Z [load_day 2025-10-04] 2025-10-04: index committed in 10034 ms (24 + 1 + 24 files)
2026-11-08T14:09:23Z [load_day 2025-10-04] 2025-10-04: 3686983 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:09:23Z [load_day 2025-10-04] attempt 1 succeeded