orcaLog in

Runs · run 4319

load_day 2025-08-27, attempt 1 succeeded

Host
73ccef5e07c2:367943
Started
2026-11-08T13:34:02Z
Ended
2026-11-08T13:35:54Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
694 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
154.7 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4319/load_day/2025-08-27/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:34:02Z [load_day 2025-08-27] attempt 1 started
2026-11-08T13:34:03Z [load_day 2025-08-27] 2025-08-27: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:34:12Z [load_day 2025-08-27] 2025-08-27 hour 0: 147758 events in 0 files, snapshot none (task 8128 ms: download 4496 ms overlapping gunzip 1241 ms, parse 5468 ms, sort 0 ms, write 0 ms, index 577 ms: 2 candidates, 74997 repo-hours, 997 releases; waiting 559 ms; commit 0 ms)
2026-11-08T13:34:12Z [load_day 2025-08-27] 2025-08-27 hour 1: 155146 events in 0 files, snapshot none (task 7021 ms: download 3206 ms overlapping gunzip 1109 ms, parse 4528 ms, sort 0 ms, write 0 ms, index 898 ms: 3 candidates, 91906 repo-hours, 784 releases; waiting 263 ms; commit 0 ms)
2026-11-08T13:34:20Z [load_day 2025-08-27] 2025-08-27 hour 2: 144585 events in 0 files, snapshot none (task 7822 ms: download 4346 ms overlapping gunzip 1217 ms, parse 5014 ms, sort 0 ms, write 0 ms, index 800 ms: 4 candidates, 68524 repo-hours, 796 releases; waiting 524 ms; commit 0 ms)
2026-11-08T13:34:21Z [load_day 2025-08-27] 2025-08-27 hour 3: 148357 events in 0 files, snapshot none (task 8104 ms: download 4496 ms overlapping gunzip 1267 ms, parse 5334 ms, sort 0 ms, write 0 ms, index 749 ms: 4 candidates, 66788 repo-hours, 1955 releases; waiting 528 ms; commit 0 ms)
2026-11-08T13:34:27Z [load_day 2025-08-27] 2025-08-27 hour 4: 142798 events in 0 files, snapshot none (task 5821 ms: download 2889 ms overlapping gunzip 937 ms, parse 3435 ms, sort 0 ms, write 0 ms, index 540 ms: 5 candidates, 60669 repo-hours, 710 releases; waiting 597 ms; commit 0 ms)
2026-11-08T13:34:30Z [load_day 2025-08-27] 2025-08-27 hour 5: 149312 events in 0 files, snapshot none (task 8718 ms: download 5835 ms overlapping gunzip 1219 ms, parse 4769 ms, sort 0 ms, write 0 ms, index 676 ms: 7 candidates, 63651 repo-hours, 724 releases; waiting 1747 ms; commit 0 ms)
2026-11-08T13:34:34Z [load_day 2025-08-27] 2025-08-27 hour 6: 155039 events in 0 files, snapshot none (task 7091 ms: download 3585 ms overlapping gunzip 1174 ms, parse 4159 ms, sort 0 ms, write 0 ms, index 1082 ms: 4 candidates, 77004 repo-hours, 787 releases; waiting 420 ms; commit 0 ms)
2026-11-08T13:34:38Z [load_day 2025-08-27] 2025-08-27 hour 7: 159606 events in 0 files, snapshot none (task 7235 ms: download 4893 ms overlapping gunzip 1173 ms, parse 4430 ms, sort 0 ms, write 0 ms, index 812 ms: 8 candidates, 72852 repo-hours, 878 releases; waiting 567 ms; commit 0 ms)
2026-11-08T13:34:43Z [load_day 2025-08-27] 2025-08-27 hour 8: 157883 events in 0 files, snapshot none (task 7616 ms: download 4443 ms overlapping gunzip 1152 ms, parse 4433 ms, sort 0 ms, write 0 ms, index 1000 ms: 13 candidates, 76956 repo-hours, 794 releases; waiting 759 ms; commit 0 ms)
2026-11-08T13:34:47Z [load_day 2025-08-27] 2025-08-27 hour 9: 164394 events in 0 files, snapshot none (task 8281 ms: download 5281 ms overlapping gunzip 1314 ms, parse 5159 ms, sort 0 ms, write 0 ms, index 848 ms: 10 candidates, 79085 repo-hours, 1008 releases; waiting 679 ms; commit 0 ms)
2026-11-08T13:34:50Z [load_day 2025-08-27] 2025-08-27 hour 10: 162005 events in 0 files, snapshot none (task 6618 ms: download 4128 ms overlapping gunzip 1049 ms, parse 4013 ms, sort 0 ms, write 0 ms, index 803 ms: 11 candidates, 76630 repo-hours, 932 releases; waiting 503 ms; commit 0 ms)
2026-11-08T13:34:55Z [load_day 2025-08-27] 2025-08-27 hour 11: 162742 events in 0 files, snapshot none (task 7498 ms: download 4578 ms overlapping gunzip 1320 ms, parse 4735 ms, sort 0 ms, write 0 ms, index 651 ms: 7 candidates, 74982 repo-hours, 855 releases; waiting 466 ms; commit 0 ms)
2026-11-08T13:34:58Z [load_day 2025-08-27] 2025-08-27 hour 12: 166338 events in 0 files, snapshot none (task 6862 ms: download 4301 ms overlapping gunzip 1112 ms, parse 4034 ms, sort 0 ms, write 0 ms, index 832 ms: 9 candidates, 96911 repo-hours, 859 releases; waiting 629 ms; commit 0 ms)
2026-11-08T13:35:03Z [load_day 2025-08-27] 2025-08-27 hour 13: 164116 events in 0 files, snapshot none (task 7610 ms: download 4202 ms overlapping gunzip 1172 ms, parse 4586 ms, sort 0 ms, write 0 ms, index 1105 ms: 8 candidates, 88940 repo-hours, 739 releases; waiting 509 ms; commit 0 ms)
2026-11-08T13:35:06Z [load_day 2025-08-27] 2025-08-27 hour 14: 167092 events in 0 files, snapshot none (task 7493 ms: download 4827 ms overlapping gunzip 1197 ms, parse 4637 ms, sort 0 ms, write 0 ms, index 869 ms: 10 candidates, 83856 repo-hours, 956 releases; waiting 508 ms; commit 0 ms)
2026-11-08T13:35:12Z [load_day 2025-08-27] 2025-08-27 hour 15: 164140 events in 0 files, snapshot none (task 8630 ms: download 6178 ms overlapping gunzip 1126 ms, parse 4443 ms, sort 0 ms, write 0 ms, index 593 ms: 9 candidates, 82435 repo-hours, 936 releases; waiting 2059 ms; commit 0 ms)
2026-11-08T13:35:12Z [load_day 2025-08-27] 2025-08-27 hour 16: 136930 events in 0 files, snapshot none (task 5757 ms: download 3499 ms overlapping gunzip 905 ms, parse 3472 ms, sort 0 ms, write 0 ms, index 558 ms: 8 candidates, 70679 repo-hours, 739 releases; waiting 539 ms; commit 0 ms)
2026-11-08T13:35:20Z [load_day 2025-08-27] 2025-08-27 hour 17: 162985 events in 0 files, snapshot none (task 7174 ms: download 4203 ms overlapping gunzip 979 ms, parse 3645 ms, sort 0 ms, write 0 ms, index 581 ms: 6 candidates, 77488 repo-hours, 765 releases; waiting 1048 ms; commit 0 ms)
2026-11-08T13:35:20Z [load_day 2025-08-27] 2025-08-27 hour 18: 165679 events in 0 files, snapshot none (task 6259 ms: download 3827 ms overlapping gunzip 1023 ms, parse 3814 ms, sort 0 ms, write 0 ms, index 613 ms: 6 candidates, 83030 repo-hours, 894 releases; waiting 528 ms; commit 0 ms)
2026-11-08T13:35:28Z [load_day 2025-08-27] 2025-08-27 hour 19: 160357 events in 0 files, snapshot none (task 7667 ms: download 4507 ms overlapping gunzip 1212 ms, parse 4503 ms, sort 0 ms, write 0 ms, index 755 ms: 7 candidates, 71484 repo-hours, 792 releases; waiting 910 ms; commit 0 ms)
2026-11-08T13:35:28Z [load_day 2025-08-27] 2025-08-27 hour 20: 154875 events in 0 files, snapshot none (task 7057 ms: download 3489 ms overlapping gunzip 1090 ms, parse 4093 ms, sort 0 ms, write 0 ms, index 1324 ms: 3 candidates, 70335 repo-hours, 847 releases; waiting 267 ms; commit 0 ms)
2026-11-08T13:35:36Z [load_day 2025-08-27] 2025-08-27 hour 21: 153631 events in 0 files, snapshot none (task 6720 ms: download 3833 ms overlapping gunzip 1085 ms, parse 3998 ms, sort 0 ms, write 0 ms, index 957 ms: 3 candidates, 65724 repo-hours, 835 releases; waiting 347 ms; commit 0 ms)
2026-11-08T13:35:36Z [load_day 2025-08-27] 2025-08-27 hour 22: 148029 events in 0 files, snapshot none (task 7132 ms: download 4143 ms overlapping gunzip 1143 ms, parse 4231 ms, sort 0 ms, write 0 ms, index 950 ms: 4 candidates, 60640 repo-hours, 833 releases; waiting 500 ms; commit 0 ms)
2026-11-08T13:35:42Z [load_day 2025-08-27] 2025-08-27 hour 23: 146463 events in 0 files, snapshot none (task 5170 ms: download 3455 ms overlapping gunzip 879 ms, parse 3256 ms, sort 0 ms, write 0 ms, index 470 ms: 13 candidates, 58732 repo-hours, 810 releases; waiting 312 ms; commit 0 ms)
2026-11-08T13:35:51Z [load_day 2025-08-27] 2025-08-27: repo_hour merged from 24 files to 1 (1794298 rows, 9100 ms)
2026-11-08T13:35:54Z [load_day 2025-08-27] 2025-08-27: index committed in 12250 ms (24 + 1 + 24 files)
2026-11-08T13:35:54Z [load_day 2025-08-27] 2025-08-27: 3740260 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:35:54Z [load_day 2025-08-27] attempt 1 succeeded