orcaLog in

Runs · run 3394

load_day 2025-01-03, attempt 1 succeeded

Host
73ccef5e07c2:232195
Started
2026-11-08T09:38:46Z
Ended
2026-11-08T09:40:28Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
702 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
159.1 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3394/load_day/2025-01-03/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:38:46Z [load_day 2025-01-03] attempt 1 started
2026-11-08T09:38:47Z [load_day 2025-01-03] 2025-01-03: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:38:55Z [load_day 2025-01-03] 2025-01-03 hour 0: 177454 events in 0 files, snapshot none (task 6927 ms: download 4111 ms overlapping gunzip 1090 ms, parse 4290 ms, sort 0 ms, write 0 ms, index 657 ms: 7 candidates, 84454 repo-hours, 1228 releases; waiting 574 ms; commit 0 ms)
2026-11-08T09:38:55Z [load_day 2025-01-03] 2025-01-03 hour 1: 189366 events in 0 files, snapshot none (task 7213 ms: download 3873 ms overlapping gunzip 1153 ms, parse 4813 ms, sort 0 ms, write 0 ms, index 777 ms: 4 candidates, 104705 repo-hours, 906 releases; waiting 196 ms; commit 0 ms)
2026-11-08T09:39:02Z [load_day 2025-01-03] 2025-01-03 hour 2: 166564 events in 0 files, snapshot none (task 7050 ms: download 3445 ms overlapping gunzip 1040 ms, parse 4199 ms, sort 0 ms, write 0 ms, index 845 ms: 4 candidates, 74115 repo-hours, 825 releases; waiting 650 ms; commit 0 ms)
2026-11-08T09:39:02Z [load_day 2025-01-03] 2025-01-03 hour 3: 182389 events in 0 files, snapshot none (task 6574 ms: download 3158 ms overlapping gunzip 920 ms, parse 4030 ms, sort 0 ms, write 0 ms, index 863 ms: 5 candidates, 73048 repo-hours, 4028 releases; waiting 506 ms; commit 0 ms)
2026-11-08T09:39:08Z [load_day 2025-01-03] 2025-01-03 hour 4: 161898 events in 0 files, snapshot none (task 5060 ms: download 2461 ms overlapping gunzip 721 ms, parse 2981 ms, sort 0 ms, write 0 ms, index 908 ms: 6 candidates, 60311 repo-hours, 709 releases; waiting 188 ms; commit 0 ms)
2026-11-08T09:39:08Z [load_day 2025-01-03] 2025-01-03 hour 5: 167428 events in 0 files, snapshot none (task 5688 ms: download 2658 ms overlapping gunzip 779 ms, parse 3340 ms, sort 0 ms, write 0 ms, index 619 ms: 5 candidates, 63760 repo-hours, 790 releases; waiting 480 ms; commit 0 ms)
2026-11-08T09:39:15Z [load_day 2025-01-03] 2025-01-03 hour 6: 195707 events in 0 files, snapshot none (task 6826 ms: download 4015 ms overlapping gunzip 1002 ms, parse 4136 ms, sort 0 ms, write 0 ms, index 859 ms: 5 candidates, 88130 repo-hours, 886 releases; waiting 537 ms; commit 0 ms)
2026-11-08T09:39:16Z [load_day 2025-01-03] 2025-01-03 hour 7: 189876 events in 0 files, snapshot none (task 6908 ms: download 3738 ms overlapping gunzip 960 ms, parse 4097 ms, sort 0 ms, write 0 ms, index 1044 ms: 7 candidates, 74232 repo-hours, 797 releases; waiting 488 ms; commit 0 ms)
2026-11-08T09:39:22Z [load_day 2025-01-03] 2025-01-03 hour 8: 197703 events in 0 files, snapshot none (task 6806 ms: download 4377 ms overlapping gunzip 1062 ms, parse 4372 ms, sort 0 ms, write 0 ms, index 588 ms: 11 candidates, 79993 repo-hours, 824 releases; waiting 510 ms; commit 0 ms)
2026-11-08T09:39:23Z [load_day 2025-01-03] 2025-01-03 hour 9: 220232 events in 0 files, snapshot none (task 6896 ms: download 4371 ms overlapping gunzip 1042 ms, parse 4426 ms, sort 0 ms, write 0 ms, index 622 ms: 9 candidates, 88022 repo-hours, 1224 releases; waiting 508 ms; commit 0 ms)
2026-11-08T09:39:29Z [load_day 2025-01-03] 2025-01-03 hour 10: 209986 events in 0 files, snapshot none (task 6348 ms: download 3893 ms overlapping gunzip 947 ms, parse 4035 ms, sort 0 ms, write 0 ms, index 660 ms: 6 candidates, 80938 repo-hours, 1015 releases; waiting 495 ms; commit 0 ms)
2026-11-08T09:39:30Z [load_day 2025-01-03] 2025-01-03 hour 11: 201843 events in 0 files, snapshot none (task 6211 ms: download 3764 ms overlapping gunzip 975 ms, parse 3900 ms, sort 0 ms, write 0 ms, index 584 ms: 7 candidates, 75463 repo-hours, 941 releases; waiting 460 ms; commit 0 ms)
2026-11-08T09:39:37Z [load_day 2025-01-03] 2025-01-03 hour 12: 251115 events in 0 files, snapshot none (task 7815 ms: download 3979 ms overlapping gunzip 1116 ms, parse 4861 ms, sort 0 ms, write 0 ms, index 1036 ms: 6 candidates, 121902 repo-hours, 1063 releases; waiting 494 ms; commit 0 ms)
2026-11-08T09:39:38Z [load_day 2025-01-03] 2025-01-03 hour 13: 228646 events in 0 files, snapshot none (task 7370 ms: download 3728 ms overlapping gunzip 1074 ms, parse 4733 ms, sort 0 ms, write 0 ms, index 747 ms: 1 candidates, 102486 repo-hours, 1084 releases; waiting 492 ms; commit 0 ms)
2026-11-08T09:39:46Z [load_day 2025-01-03] 2025-01-03 hour 14: 218761 events in 0 files, snapshot none (task 8338 ms: download 5485 ms overlapping gunzip 1256 ms, parse 5700 ms, sort 0 ms, write 0 ms, index 655 ms: 7 candidates, 86763 repo-hours, 1136 releases; waiting 480 ms; commit 0 ms)
2026-11-08T09:39:46Z [load_day 2025-01-03] 2025-01-03 hour 15: 228704 events in 0 files, snapshot none (task 8328 ms: download 5649 ms overlapping gunzip 1290 ms, parse 5582 ms, sort 0 ms, write 0 ms, index 741 ms: 7 candidates, 96426 repo-hours, 1540 releases; waiting 478 ms; commit 0 ms)
2026-11-08T09:39:55Z [load_day 2025-01-03] 2025-01-03 hour 16: 218959 events in 0 files, snapshot none (task 8353 ms: download 5569 ms overlapping gunzip 1305 ms, parse 5284 ms, sort 0 ms, write 0 ms, index 982 ms: 9 candidates, 88434 repo-hours, 1123 releases; waiting 546 ms; commit 0 ms)
2026-11-08T09:39:55Z [load_day 2025-01-03] 2025-01-03 hour 17: 209280 events in 0 files, snapshot none (task 8036 ms: download 5152 ms overlapping gunzip 1180 ms, parse 5083 ms, sort 0 ms, write 0 ms, index 1012 ms: 9 candidates, 81649 repo-hours, 1062 releases; waiting 470 ms; commit 0 ms)
2026-11-08T09:40:03Z [load_day 2025-01-03] 2025-01-03 hour 18: 216985 events in 0 files, snapshot none (task 7746 ms: download 4522 ms overlapping gunzip 1142 ms, parse 5067 ms, sort 0 ms, write 0 ms, index 793 ms: 8 candidates, 95631 repo-hours, 1183 releases; waiting 482 ms; commit 0 ms)
2026-11-08T09:40:03Z [load_day 2025-01-03] 2025-01-03 hour 19: 198353 events in 0 files, snapshot none (task 7774 ms: download 4893 ms overlapping gunzip 1247 ms, parse 5177 ms, sort 0 ms, write 0 ms, index 506 ms: 0 candidates, 71411 repo-hours, 956 releases; waiting 486 ms; commit 0 ms)
2026-11-08T09:40:11Z [load_day 2025-01-03] 2025-01-03 hour 20: 191430 events in 0 files, snapshot none (task 7262 ms: download 4800 ms overlapping gunzip 1168 ms, parse 4711 ms, sort 0 ms, write 0 ms, index 565 ms: 7 candidates, 71616 repo-hours, 920 releases; waiting 493 ms; commit 0 ms)
2026-11-08T09:40:11Z [load_day 2025-01-03] 2025-01-03 hour 21: 186898 events in 0 files, snapshot none (task 7078 ms: download 4743 ms overlapping gunzip 1060 ms, parse 4692 ms, sort 0 ms, write 0 ms, index 520 ms: 10 candidates, 72536 repo-hours, 1126 releases; waiting 515 ms; commit 0 ms)
2026-11-08T09:40:18Z [load_day 2025-01-03] 2025-01-03 hour 22: 169997 events in 0 files, snapshot none (task 6111 ms: download 3924 ms overlapping gunzip 931 ms, parse 4098 ms, sort 0 ms, write 0 ms, index 466 ms: 4 candidates, 60477 repo-hours, 1137 releases; waiting 394 ms; commit 0 ms)
2026-11-08T09:40:18Z [load_day 2025-01-03] 2025-01-03 hour 23: 160855 events in 0 files, snapshot none (task 6352 ms: download 3995 ms overlapping gunzip 1017 ms, parse 4066 ms, sort 0 ms, write 0 ms, index 455 ms: 7 candidates, 56189 repo-hours, 885 releases; waiting 488 ms; commit 0 ms)
2026-11-08T09:40:26Z [load_day 2025-01-03] 2025-01-03: repo_hour merged from 24 files to 1 (1952691 rows, 8129 ms)
2026-11-08T09:40:28Z [load_day 2025-01-03] 2025-01-03: index committed in 10330 ms (23 + 1 + 24 files)
2026-11-08T09:40:28Z [load_day 2025-01-03] 2025-01-03: 4740429 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:40:28Z [load_day 2025-01-03] attempt 1 succeeded