orcaLog in

Runs · run 3198

load_day 2024-11-13, attempt 1 succeeded

Host
73ccef5e07c2:206762
Started
2026-11-08T08:48:14Z
Ended
2026-11-08T08:50:33Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
969 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
227.8 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3198/load_day/2024-11-13/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:48:14Z [load_day 2024-11-13] attempt 1 started
2026-11-08T08:48:15Z [load_day 2024-11-13] 2024-11-13: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:48:24Z [load_day 2024-11-13] 2024-11-13 hour 0: 200752 events in 0 files, snapshot none (task 8659 ms: download 5766 ms overlapping gunzip 1320 ms, parse 5631 ms, sort 0 ms, write 0 ms, index 950 ms: 5 candidates, 97403 repo-hours, 1226 releases; waiting 464 ms; commit 0 ms)
2026-11-08T08:48:24Z [load_day 2024-11-13] 2024-11-13 hour 1: 212560 events in 0 files, snapshot none (task 8166 ms: download 5394 ms overlapping gunzip 1292 ms, parse 5529 ms, sort 0 ms, write 0 ms, index 856 ms: 3 candidates, 113886 repo-hours, 1225 releases; waiting 169 ms; commit 0 ms)
2026-11-08T08:48:35Z [load_day 2024-11-13] 2024-11-13 hour 2: 199204 events in 0 files, snapshot none (task 9805 ms: download 7094 ms overlapping gunzip 1504 ms, parse 6824 ms, sort 0 ms, write 0 ms, index 739 ms: 11 candidates, 84322 repo-hours, 1046 releases; waiting 500 ms; commit 0 ms)
2026-11-08T08:48:35Z [load_day 2024-11-13] 2024-11-13 hour 3: 208723 events in 0 files, snapshot none (task 9681 ms: download 6991 ms overlapping gunzip 1624 ms, parse 6519 ms, sort 0 ms, write 0 ms, index 790 ms: 3 candidates, 81689 repo-hours, 3844 releases; waiting 530 ms; commit 0 ms)
2026-11-08T08:48:44Z [load_day 2024-11-13] 2024-11-13 hour 4: 190542 events in 0 files, snapshot none (task 8831 ms: download 5834 ms overlapping gunzip 1311 ms, parse 5431 ms, sort 0 ms, write 0 ms, index 780 ms: 4 candidates, 67428 repo-hours, 731 releases; waiting 1016 ms; commit 0 ms)
2026-11-08T08:48:45Z [load_day 2024-11-13] 2024-11-13 hour 5: 204998 events in 0 files, snapshot none (task 9517 ms: download 6549 ms overlapping gunzip 1681 ms, parse 6652 ms, sort 0 ms, write 0 ms, index 732 ms: 4 candidates, 71169 repo-hours, 815 releases; waiting 176 ms; commit 0 ms)
2026-11-08T08:48:54Z [load_day 2024-11-13] 2024-11-13 hour 6: 223421 events in 0 files, snapshot none (task 8763 ms: download 5712 ms overlapping gunzip 1343 ms, parse 5658 ms, sort 0 ms, write 0 ms, index 761 ms: 5 candidates, 92269 repo-hours, 1000 releases; waiting 572 ms; commit 0 ms)
2026-11-08T08:48:54Z [load_day 2024-11-13] 2024-11-13 hour 7: 222752 events in 0 files, snapshot none (task 8568 ms: download 5793 ms overlapping gunzip 1462 ms, parse 5535 ms, sort 0 ms, write 0 ms, index 743 ms: 6 candidates, 82426 repo-hours, 891 releases; waiting 520 ms; commit 0 ms)
2026-11-08T08:49:04Z [load_day 2024-11-13] 2024-11-13 hour 8: 234639 events in 0 files, snapshot none (task 10133 ms: download 7151 ms overlapping gunzip 1563 ms, parse 6616 ms, sort 0 ms, write 0 ms, index 1121 ms: 8 candidates, 92793 repo-hours, 1155 releases; waiting 519 ms; commit 0 ms)
2026-11-08T08:49:05Z [load_day 2024-11-13] 2024-11-13 hour 9: 248853 events in 0 files, snapshot none (task 10575 ms: download 7494 ms overlapping gunzip 1707 ms, parse 7187 ms, sort 0 ms, write 0 ms, index 886 ms: 2 candidates, 100892 repo-hours, 1329 releases; waiting 528 ms; commit 0 ms)
2026-11-08T08:49:16Z [load_day 2024-11-13] 2024-11-13 hour 10: 245196 events in 0 files, snapshot none (task 10639 ms: download 7887 ms overlapping gunzip 1731 ms, parse 7138 ms, sort 0 ms, write 0 ms, index 884 ms: 5 candidates, 95268 repo-hours, 1219 releases; waiting 561 ms; commit 0 ms)
2026-11-08T08:49:16Z [load_day 2024-11-13] 2024-11-13 hour 11: 243727 events in 0 files, snapshot none (task 10336 ms: download 7499 ms overlapping gunzip 1634 ms, parse 7051 ms, sort 0 ms, write 0 ms, index 854 ms: 4 candidates, 91204 repo-hours, 1112 releases; waiting 503 ms; commit 0 ms)
2026-11-08T08:49:25Z [load_day 2024-11-13] 2024-11-13 hour 12: 273819 events in 0 files, snapshot none (task 8540 ms: download 5437 ms overlapping gunzip 1247 ms, parse 5357 ms, sort 0 ms, write 0 ms, index 1036 ms: 8 candidates, 137757 repo-hours, 1259 releases; waiting 500 ms; commit 0 ms)
2026-11-08T08:49:28Z [load_day 2024-11-13] 2024-11-13 hour 13: 275479 events in 0 files, snapshot none (task 11542 ms: download 8931 ms overlapping gunzip 1585 ms, parse 6235 ms, sort 0 ms, write 0 ms, index 866 ms: 10 candidates, 118670 repo-hours, 1074 releases; waiting 2565 ms; commit 0 ms)
2026-11-08T08:49:34Z [load_day 2024-11-13] 2024-11-13 hour 14: 270306 events in 0 files, snapshot none (task 8744 ms: download 6291 ms overlapping gunzip 1521 ms, parse 6021 ms, sort 0 ms, write 0 ms, index 738 ms: 9 candidates, 106806 repo-hours, 1234 releases; waiting 174 ms; commit 0 ms)
2026-11-08T08:49:38Z [load_day 2024-11-13] 2024-11-13 hour 15: 270416 events in 0 files, snapshot none (task 9767 ms: download 6624 ms overlapping gunzip 1554 ms, parse 6004 ms, sort 0 ms, write 0 ms, index 1283 ms: 19 candidates, 111718 repo-hours, 1460 releases; waiting 425 ms; commit 0 ms)
2026-11-08T08:49:46Z [load_day 2024-11-13] 2024-11-13 hour 16: 265866 events in 0 files, snapshot none (task 11626 ms: download 8961 ms overlapping gunzip 2024 ms, parse 7883 ms, sort 0 ms, write 0 ms, index 753 ms: 8 candidates, 105699 repo-hours, 1286 releases; waiting 664 ms; commit 0 ms)
2026-11-08T08:49:49Z [load_day 2024-11-13] 2024-11-13 hour 17: 253024 events in 0 files, snapshot none (task 10771 ms: download 7478 ms overlapping gunzip 1906 ms, parse 7093 ms, sort 0 ms, write 0 ms, index 885 ms: 7 candidates, 97475 repo-hours, 1088 releases; waiting 518 ms; commit 0 ms)
2026-11-08T08:49:59Z [load_day 2024-11-13] 2024-11-13 hour 18: 264090 events in 0 files, snapshot none (task 12450 ms: download 8843 ms overlapping gunzip 1859 ms, parse 8222 ms, sort 0 ms, write 0 ms, index 1627 ms: 11 candidates, 116182 repo-hours, 1102 releases; waiting 485 ms; commit 0 ms)
2026-11-08T08:50:00Z [load_day 2024-11-13] 2024-11-13 hour 19: 262559 events in 0 files, snapshot none (task 10396 ms: download 7501 ms overlapping gunzip 1727 ms, parse 6964 ms, sort 0 ms, write 0 ms, index 868 ms: 9 candidates, 117216 repo-hours, 1070 releases; waiting 501 ms; commit 0 ms)
2026-11-08T08:50:10Z [load_day 2024-11-13] 2024-11-13 hour 20: 248287 events in 0 files, snapshot none (task 10868 ms: download 6356 ms overlapping gunzip 1676 ms, parse 6828 ms, sort 0 ms, write 0 ms, index 1575 ms: 13 candidates, 106061 repo-hours, 1037 releases; waiting 494 ms; commit 0 ms)
2026-11-08T08:50:11Z [load_day 2024-11-13] 2024-11-13 hour 21: 226193 events in 0 files, snapshot none (task 9715 ms: download 6991 ms overlapping gunzip 1676 ms, parse 6437 ms, sort 0 ms, write 0 ms, index 795 ms: 7 candidates, 82113 repo-hours, 1217 releases; waiting 505 ms; commit 0 ms)
2026-11-08T08:50:20Z [load_day 2024-11-13] 2024-11-13 hour 22: 209292 events in 0 files, snapshot none (task 9249 ms: download 6382 ms overlapping gunzip 1587 ms, parse 6297 ms, sort 0 ms, write 0 ms, index 592 ms: 11 candidates, 71807 repo-hours, 1183 releases; waiting 450 ms; commit 0 ms)
2026-11-08T08:50:20Z [load_day 2024-11-13] 2024-11-13 hour 23: 200816 events in 0 files, snapshot none (task 8464 ms: download 5345 ms overlapping gunzip 1450 ms, parse 5872 ms, sort 0 ms, write 0 ms, index 654 ms: 9 candidates, 68034 repo-hours, 853 releases; waiting 177 ms; commit 0 ms)
2026-11-08T08:50:30Z [load_day 2024-11-13] 2024-11-13: repo_hour merged from 24 files to 1 (2310287 rows, 10392 ms)
2026-11-08T08:50:33Z [load_day 2024-11-13] 2024-11-13: index committed in 13139 ms (24 + 1 + 24 files)
2026-11-08T08:50:33Z [load_day 2024-11-13] 2024-11-13: 5655514 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:50:33Z [load_day 2024-11-13] attempt 1 succeeded