orcaLog in

Runs · run 4463

load_day 2025-10-02, attempt 1 succeeded

Host
73ccef5e07c2:388909
Started
2026-11-08T14:05:53Z
Ended
2026-11-08T14:07:50Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
703 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
157.2 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4463/load_day/2025-10-02/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:05:53Z [load_day 2025-10-02] attempt 1 started
2026-11-08T14:05:54Z [load_day 2025-10-02] 2025-10-02: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:06:01Z [load_day 2025-10-02] 2025-10-02 hour 0: 160624 events in 0 files, snapshot none (task 6314 ms: download 3612 ms overlapping gunzip 898 ms, parse 3686 ms, sort 0 ms, write 0 ms, index 847 ms: 12 candidates, 76486 repo-hours, 931 releases; waiting 499 ms; commit 0 ms)
2026-11-08T14:06:01Z [load_day 2025-10-02] 2025-10-02 hour 1: 173800 events in 0 files, snapshot none (task 6537 ms: download 3431 ms overlapping gunzip 1000 ms, parse 4045 ms, sort 0 ms, write 0 ms, index 891 ms: 8 candidates, 91144 repo-hours, 794 releases; waiting 312 ms; commit 0 ms)
2026-11-08T14:06:08Z [load_day 2025-10-02] 2025-10-02 hour 2: 154561 events in 0 files, snapshot none (task 6690 ms: download 3861 ms overlapping gunzip 1034 ms, parse 4046 ms, sort 0 ms, write 0 ms, index 748 ms: 7 candidates, 69654 repo-hours, 670 releases; waiting 542 ms; commit 0 ms)
2026-11-08T14:06:08Z [load_day 2025-10-02] 2025-10-02 hour 3: 155532 events in 0 files, snapshot none (task 6374 ms: download 3742 ms overlapping gunzip 894 ms, parse 3757 ms, sort 0 ms, write 0 ms, index 839 ms: 2 candidates, 62527 repo-hours, 1949 releases; waiting 557 ms; commit 0 ms)
2026-11-08T14:06:15Z [load_day 2025-10-02] 2025-10-02 hour 4: 153315 events in 0 files, snapshot none (task 6517 ms: download 4074 ms overlapping gunzip 1066 ms, parse 4203 ms, sort 0 ms, write 0 ms, index 445 ms: 8 candidates, 61989 repo-hours, 634 releases; waiting 485 ms; commit 0 ms)
2026-11-08T14:06:15Z [load_day 2025-10-02] 2025-10-02 hour 5: 154338 events in 0 files, snapshot none (task 6652 ms: download 4137 ms overlapping gunzip 1049 ms, parse 4185 ms, sort 0 ms, write 0 ms, index 507 ms: 7 candidates, 63789 repo-hours, 669 releases; waiting 527 ms; commit 0 ms)
2026-11-08T14:06:22Z [load_day 2025-10-02] 2025-10-02 hour 6: 156807 events in 0 files, snapshot none (task 5932 ms: download 3824 ms overlapping gunzip 885 ms, parse 3556 ms, sort 0 ms, write 0 ms, index 568 ms: 6 candidates, 73242 repo-hours, 764 releases; waiting 616 ms; commit 0 ms)
2026-11-08T14:06:22Z [load_day 2025-10-02] 2025-10-02 hour 7: 168518 events in 0 files, snapshot none (task 6508 ms: download 3987 ms overlapping gunzip 933 ms, parse 3900 ms, sort 0 ms, write 0 ms, index 586 ms: 15 candidates, 72025 repo-hours, 758 releases; waiting 739 ms; commit 0 ms)
2026-11-08T14:06:33Z [load_day 2025-10-02] 2025-10-02 hour 8: 166673 events in 0 files, snapshot none (task 10292 ms: download 8551 ms overlapping gunzip 1085 ms, parse 4148 ms, sort 0 ms, write 0 ms, index 876 ms: 7 candidates, 73561 repo-hours, 787 releases; waiting 3832 ms; commit 0 ms)
2026-11-08T14:06:33Z [load_day 2025-10-02] 2025-10-02 hour 9: 169355 events in 0 files, snapshot none (task 5929 ms: download 3844 ms overlapping gunzip 924 ms, parse 3681 ms, sort 0 ms, write 0 ms, index 620 ms: 10 candidates, 75233 repo-hours, 797 releases; waiting 413 ms; commit 0 ms)
2026-11-08T14:06:41Z [load_day 2025-10-02] 2025-10-02 hour 10: 169890 events in 0 files, snapshot none (task 7428 ms: download 4652 ms overlapping gunzip 1200 ms, parse 4679 ms, sort 0 ms, write 0 ms, index 643 ms: 10 candidates, 77294 repo-hours, 701 releases; waiting 577 ms; commit 0 ms)
2026-11-08T14:06:42Z [load_day 2025-10-02] 2025-10-02 hour 11: 167372 events in 0 files, snapshot none (task 8301 ms: download 5679 ms overlapping gunzip 1226 ms, parse 5004 ms, sort 0 ms, write 0 ms, index 557 ms: 8 candidates, 71594 repo-hours, 718 releases; waiting 1240 ms; commit 0 ms)
2026-11-08T14:06:51Z [load_day 2025-10-02] 2025-10-02 hour 12: 169709 events in 0 files, snapshot none (task 7775 ms: download 5021 ms overlapping gunzip 1168 ms, parse 4971 ms, sort 0 ms, write 0 ms, index 687 ms: 6 candidates, 93743 repo-hours, 752 releases; waiting 655 ms; commit 0 ms)
2026-11-08T14:06:51Z [load_day 2025-10-02] 2025-10-02 hour 13: 168208 events in 0 files, snapshot none (task 7606 ms: download 4802 ms overlapping gunzip 1209 ms, parse 4926 ms, sort 0 ms, write 0 ms, index 742 ms: 14 candidates, 90932 repo-hours, 873 releases; waiting 391 ms; commit 0 ms)
2026-11-08T14:06:59Z [load_day 2025-10-02] 2025-10-02 hour 14: 167602 events in 0 files, snapshot none (task 7681 ms: download 5026 ms overlapping gunzip 1203 ms, parse 4856 ms, sort 0 ms, write 0 ms, index 644 ms: 8 candidates, 84615 repo-hours, 874 releases; waiting 485 ms; commit 0 ms)
2026-11-08T14:06:59Z [load_day 2025-10-02] 2025-10-02 hour 15: 169682 events in 0 files, snapshot none (task 7845 ms: download 5158 ms overlapping gunzip 1243 ms, parse 5060 ms, sort 0 ms, write 0 ms, index 674 ms: 11 candidates, 85010 repo-hours, 840 releases; waiting 535 ms; commit 0 ms)
2026-11-08T14:07:09Z [load_day 2025-10-02] 2025-10-02 hour 16: 165699 events in 0 files, snapshot none (task 9223 ms: download 6529 ms overlapping gunzip 1436 ms, parse 5826 ms, sort 0 ms, write 0 ms, index 645 ms: 13 candidates, 80795 repo-hours, 786 releases; waiting 1016 ms; commit 0 ms)
2026-11-08T14:07:09Z [load_day 2025-10-02] 2025-10-02 hour 17: 169137 events in 0 files, snapshot none (task 8289 ms: download 4831 ms overlapping gunzip 1302 ms, parse 5346 ms, sort 0 ms, write 0 ms, index 817 ms: 9 candidates, 85533 repo-hours, 769 releases; waiting 478 ms; commit 0 ms)
2026-11-08T14:07:19Z [load_day 2025-10-02] 2025-10-02 hour 18: 170262 events in 0 files, snapshot none (task 9479 ms: download 6581 ms overlapping gunzip 1559 ms, parse 5917 ms, sort 0 ms, write 0 ms, index 1016 ms: 11 candidates, 86267 repo-hours, 788 releases; waiting 673 ms; commit 0 ms)
2026-11-08T14:07:19Z [load_day 2025-10-02] 2025-10-02 hour 19: 159429 events in 0 files, snapshot none (task 9501 ms: download 6220 ms overlapping gunzip 1320 ms, parse 5167 ms, sort 0 ms, write 0 ms, index 883 ms: 9 candidates, 72971 repo-hours, 772 releases; waiting 1813 ms; commit 0 ms)
2026-11-08T14:07:30Z [load_day 2025-10-02] 2025-10-02 hour 20: 162805 events in 0 files, snapshot none (task 10932 ms: download 6973 ms overlapping gunzip 1949 ms, parse 7341 ms, sort 0 ms, write 0 ms, index 684 ms: 7 candidates, 73777 repo-hours, 828 releases; waiting 671 ms; commit 0 ms)
2026-11-08T14:07:30Z [load_day 2025-10-02] 2025-10-02 hour 21: 159238 events in 0 files, snapshot none (task 10759 ms: download 7151 ms overlapping gunzip 1792 ms, parse 7489 ms, sort 0 ms, write 0 ms, index 579 ms: 12 candidates, 70143 repo-hours, 790 releases; waiting 587 ms; commit 0 ms)
2026-11-08T14:07:38Z [load_day 2025-10-02] 2025-10-02 hour 22: 153652 events in 0 files, snapshot none (task 7174 ms: download 4953 ms overlapping gunzip 1209 ms, parse 4633 ms, sort 0 ms, write 0 ms, index 492 ms: 7 candidates, 63526 repo-hours, 827 releases; waiting 537 ms; commit 0 ms)
2026-11-08T14:07:38Z [load_day 2025-10-02] 2025-10-02 hour 23: 147924 events in 0 files, snapshot none (task 7562 ms: download 3790 ms overlapping gunzip 1214 ms, parse 4884 ms, sort 0 ms, write 0 ms, index 520 ms: 6 candidates, 59673 repo-hours, 900 releases; waiting 583 ms; commit 0 ms)
2026-11-08T14:07:47Z [load_day 2025-10-02] 2025-10-02: repo_hour merged from 24 files to 1 (1815523 rows, 8965 ms)
2026-11-08T14:07:50Z [load_day 2025-10-02] 2025-10-02: index committed in 12030 ms (24 + 1 + 24 files)
2026-11-08T14:07:50Z [load_day 2025-10-02] 2025-10-02: 3914132 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:07:50Z [load_day 2025-10-02] attempt 1 succeeded