orcaLog in

Runs · run 4163

load_day 2025-07-18, attempt 1 succeeded

Host
73ccef5e07c2:344827
Started
2026-11-08T12:59:15Z
Ended
2026-11-08T13:01:04Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
678 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
156.8 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4163/load_day/2025-07-18/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:59:15Z [load_day 2025-07-18] attempt 1 started
2026-11-08T12:59:15Z [load_day 2025-07-18] 2025-07-18: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:59:27Z [load_day 2025-07-18] 2025-07-18 hour 0: 165983 events in 0 files, snapshot none (task 11020 ms: download 8216 ms overlapping gunzip 1831 ms, parse 7363 ms, sort 0 ms, write 0 ms, index 953 ms: 9 candidates, 100728 repo-hours, 840 releases; waiting 564 ms; commit 0 ms)
2026-11-08T12:59:27Z [load_day 2025-07-18] 2025-07-18 hour 1: 162172 events in 0 files, snapshot none (task 8755 ms: download 5883 ms overlapping gunzip 1519 ms, parse 5585 ms, sort 0 ms, write 0 ms, index 772 ms: 6 candidates, 96305 repo-hours, 700 releases; waiting 511 ms; commit 0 ms)
2026-11-08T12:59:34Z [load_day 2025-07-18] 2025-07-18 hour 2: 149663 events in 0 files, snapshot none (task 6382 ms: download 3938 ms overlapping gunzip 1018 ms, parse 3977 ms, sort 0 ms, write 0 ms, index 604 ms: 4 candidates, 76766 repo-hours, 829 releases; waiting 532 ms; commit 0 ms)
2026-11-08T12:59:34Z [load_day 2025-07-18] 2025-07-18 hour 3: 145585 events in 0 files, snapshot none (task 6097 ms: download 3671 ms overlapping gunzip 932 ms, parse 3912 ms, sort 0 ms, write 0 ms, index 542 ms: 6 candidates, 66123 repo-hours, 940 releases; waiting 483 ms; commit 0 ms)
2026-11-08T12:59:41Z [load_day 2025-07-18] 2025-07-18 hour 4: 142036 events in 0 files, snapshot none (task 6399 ms: download 3053 ms overlapping gunzip 957 ms, parse 4109 ms, sort 0 ms, write 0 ms, index 760 ms: 7 candidates, 63006 repo-hours, 1846 releases; waiting 227 ms; commit 0 ms)
2026-11-08T12:59:42Z [load_day 2025-07-18] 2025-07-18 hour 5: 152321 events in 0 files, snapshot none (task 7247 ms: download 3991 ms overlapping gunzip 1087 ms, parse 4746 ms, sort 0 ms, write 0 ms, index 601 ms: 1 candidates, 67544 repo-hours, 796 releases; waiting 480 ms; commit 0 ms)
2026-11-08T12:59:48Z [load_day 2025-07-18] 2025-07-18 hour 6: 157578 events in 0 files, snapshot none (task 6027 ms: download 4141 ms overlapping gunzip 768 ms, parse 3140 ms, sort 0 ms, write 0 ms, index 664 ms: 4 candidates, 79470 repo-hours, 905 releases; waiting 1085 ms; commit 0 ms)
2026-11-08T12:59:48Z [load_day 2025-07-18] 2025-07-18 hour 7: 159725 events in 0 files, snapshot none (task 5534 ms: download 3405 ms overlapping gunzip 849 ms, parse 3267 ms, sort 0 ms, write 0 ms, index 627 ms: 4 candidates, 75202 repo-hours, 948 releases; waiting 502 ms; commit 0 ms)
2026-11-08T12:59:54Z [load_day 2025-07-18] 2025-07-18 hour 8: 158675 events in 0 files, snapshot none (task 6350 ms: download 3320 ms overlapping gunzip 933 ms, parse 3734 ms, sort 0 ms, write 0 ms, index 776 ms: 7 candidates, 78308 repo-hours, 1013 releases; waiting 275 ms; commit 0 ms)
2026-11-08T12:59:55Z [load_day 2025-07-18] 2025-07-18 hour 9: 163743 events in 0 files, snapshot none (task 6935 ms: download 4593 ms overlapping gunzip 906 ms, parse 3772 ms, sort 0 ms, write 0 ms, index 660 ms: 6 candidates, 80568 repo-hours, 1283 releases; waiting 1306 ms; commit 0 ms)
2026-11-08T13:00:01Z [load_day 2025-07-18] 2025-07-18 hour 10: 157583 events in 0 files, snapshot none (task 6190 ms: download 3418 ms overlapping gunzip 908 ms, parse 3631 ms, sort 0 ms, write 0 ms, index 870 ms: 8 candidates, 76507 repo-hours, 864 releases; waiting 508 ms; commit 0 ms)
2026-11-08T13:00:02Z [load_day 2025-07-18] 2025-07-18 hour 11: 156826 events in 0 files, snapshot none (task 6278 ms: download 3476 ms overlapping gunzip 958 ms, parse 3875 ms, sort 0 ms, write 0 ms, index 626 ms: 8 candidates, 70783 repo-hours, 853 releases; waiting 528 ms; commit 0 ms)
2026-11-08T13:00:08Z [load_day 2025-07-18] 2025-07-18 hour 12: 167371 events in 0 files, snapshot none (task 6530 ms: download 3633 ms overlapping gunzip 886 ms, parse 3661 ms, sort 0 ms, write 0 ms, index 766 ms: 7 candidates, 93892 repo-hours, 1190 releases; waiting 892 ms; commit 0 ms)
2026-11-08T13:00:11Z [load_day 2025-07-18] 2025-07-18 hour 13: 167351 events in 0 files, snapshot none (task 8476 ms: download 5882 ms overlapping gunzip 938 ms, parse 4087 ms, sort 0 ms, write 0 ms, index 663 ms: 5 candidates, 89733 repo-hours, 1262 releases; waiting 2368 ms; commit 0 ms)
2026-11-08T13:00:17Z [load_day 2025-07-18] 2025-07-18 hour 14: 162552 events in 0 files, snapshot none (task 7808 ms: download 4808 ms overlapping gunzip 1238 ms, parse 4748 ms, sort 0 ms, write 0 ms, index 720 ms: 3 candidates, 78893 repo-hours, 998 releases; waiting 679 ms; commit 0 ms)
2026-11-08T13:00:20Z [load_day 2025-07-18] 2025-07-18 hour 15: 166884 events in 0 files, snapshot none (task 8185 ms: download 4947 ms overlapping gunzip 1272 ms, parse 4863 ms, sort 0 ms, write 0 ms, index 1120 ms: 6 candidates, 85419 repo-hours, 927 releases; waiting 540 ms; commit 0 ms)
2026-11-08T13:00:24Z [load_day 2025-07-18] 2025-07-18 hour 16: 157358 events in 0 files, snapshot none (task 6614 ms: download 4083 ms overlapping gunzip 1034 ms, parse 4158 ms, sort 0 ms, write 0 ms, index 606 ms: 7 candidates, 76721 repo-hours, 803 releases; waiting 461 ms; commit 0 ms)
2026-11-08T13:00:27Z [load_day 2025-07-18] 2025-07-18 hour 17: 159120 events in 0 files, snapshot none (task 5887 ms: download 3491 ms overlapping gunzip 836 ms, parse 3298 ms, sort 0 ms, write 0 ms, index 903 ms: 6 candidates, 75368 repo-hours, 800 releases; waiting 568 ms; commit 0 ms)
2026-11-08T13:00:37Z [load_day 2025-07-18] 2025-07-18 hour 18: 160540 events in 0 files, snapshot none (task 12089 ms: download 9475 ms overlapping gunzip 1167 ms, parse 4970 ms, sort 0 ms, write 0 ms, index 676 ms: 5 candidates, 80760 repo-hours, 884 releases; waiting 4896 ms; commit 0 ms)
2026-11-08T13:00:37Z [load_day 2025-07-18] 2025-07-18 hour 19: 152028 events in 0 files, snapshot none (task 7932 ms: download 3897 ms overlapping gunzip 1333 ms, parse 5110 ms, sort 0 ms, write 0 ms, index 701 ms: 9 candidates, 65672 repo-hours, 830 releases; waiting 503 ms; commit 0 ms)
2026-11-08T13:00:45Z [load_day 2025-07-18] 2025-07-18 hour 20: 148756 events in 0 files, snapshot none (task 7141 ms: download 4128 ms overlapping gunzip 1070 ms, parse 4348 ms, sort 0 ms, write 0 ms, index 706 ms: 8 candidates, 64975 repo-hours, 868 releases; waiting 499 ms; commit 0 ms)
2026-11-08T13:00:45Z [load_day 2025-07-18] 2025-07-18 hour 21: 149677 events in 0 files, snapshot none (task 6515 ms: download 4068 ms overlapping gunzip 930 ms, parse 3769 ms, sort 0 ms, write 0 ms, index 874 ms: 6 candidates, 62130 repo-hours, 1001 releases; waiting 528 ms; commit 0 ms)
2026-11-08T13:00:52Z [load_day 2025-07-18] 2025-07-18 hour 22: 140352 events in 0 files, snapshot none (task 6432 ms: download 3282 ms overlapping gunzip 1044 ms, parse 4001 ms, sort 0 ms, write 0 ms, index 461 ms: 3 candidates, 56873 repo-hours, 860 releases; waiting 591 ms; commit 0 ms)
2026-11-08T13:00:52Z [load_day 2025-07-18] 2025-07-18 hour 23: 138879 events in 0 files, snapshot none (task 6066 ms: download 3164 ms overlapping gunzip 920 ms, parse 3784 ms, sort 0 ms, write 0 ms, index 430 ms: 8 candidates, 54507 repo-hours, 948 releases; waiting 593 ms; commit 0 ms)
2026-11-08T13:01:01Z [load_day 2025-07-18] 2025-07-18: repo_hour merged from 24 files to 1 (1816253 rows, 8457 ms)
2026-11-08T13:01:04Z [load_day 2025-07-18] 2025-07-18: index committed in 11395 ms (24 + 1 + 24 files)
2026-11-08T13:01:04Z [load_day 2025-07-18] 2025-07-18: 3742758 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:01:04Z [load_day 2025-07-18] attempt 1 succeeded