orcaLog in

Runs · run 3800

load_day 2025-04-18, attempt 1 succeeded

Host
73ccef5e07c2:289828
Started
2026-11-08T11:28:44Z
Ended
2026-11-08T11:30:44Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
811 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
178.2 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3800/load_day/2025-04-18/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:28:44Z [load_day 2025-04-18] attempt 1 started
2026-11-08T11:28:45Z [load_day 2025-04-18] 2025-04-18: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:28:55Z [load_day 2025-04-18] 2025-04-18 hour 0: 189624 events in 0 files, snapshot none (task 8798 ms: download 5083 ms overlapping gunzip 1397 ms, parse 6122 ms, sort 0 ms, write 0 ms, index 863 ms: 11 candidates, 90203 repo-hours, 1248 releases; waiting 174 ms; commit 0 ms)
2026-11-08T11:28:56Z [load_day 2025-04-18] 2025-04-18 hour 1: 221927 events in 0 files, snapshot none (task 9441 ms: download 5197 ms overlapping gunzip 1377 ms, parse 6081 ms, sort 0 ms, write 0 ms, index 1288 ms: 2 candidates, 121689 repo-hours, 1000 releases; waiting 425 ms; commit 0 ms)
2026-11-08T11:29:03Z [load_day 2025-04-18] 2025-04-18 hour 2: 191080 events in 0 files, snapshot none (task 7747 ms: download 4570 ms overlapping gunzip 1268 ms, parse 5278 ms, sort 0 ms, write 0 ms, index 679 ms: 4 candidates, 82110 repo-hours, 953 releases; waiting 186 ms; commit 0 ms)
2026-11-08T11:29:04Z [load_day 2025-04-18] 2025-04-18 hour 3: 206365 events in 0 files, snapshot none (task 7436 ms: download 4660 ms overlapping gunzip 1141 ms, parse 4908 ms, sort 0 ms, write 0 ms, index 599 ms: 6 candidates, 82682 repo-hours, 2987 releases; waiting 454 ms; commit 0 ms)
2026-11-08T11:29:11Z [load_day 2025-04-18] 2025-04-18 hour 4: 184656 events in 0 files, snapshot none (task 7174 ms: download 3661 ms overlapping gunzip 1072 ms, parse 4490 ms, sort 0 ms, write 0 ms, index 771 ms: 6 candidates, 71154 repo-hours, 800 releases; waiting 544 ms; commit 0 ms)
2026-11-08T11:29:13Z [load_day 2025-04-18] 2025-04-18 hour 5: 196354 events in 0 files, snapshot none (task 8236 ms: download 5148 ms overlapping gunzip 1272 ms, parse 5257 ms, sort 0 ms, write 0 ms, index 890 ms: 4 candidates, 77223 repo-hours, 902 releases; waiting 523 ms; commit 0 ms)
2026-11-08T11:29:19Z [load_day 2025-04-18] 2025-04-18 hour 6: 219847 events in 0 files, snapshot none (task 7734 ms: download 4254 ms overlapping gunzip 1075 ms, parse 4844 ms, sort 0 ms, write 0 ms, index 954 ms: 3 candidates, 97694 repo-hours, 1121 releases; waiting 565 ms; commit 0 ms)
2026-11-08T11:29:22Z [load_day 2025-04-18] 2025-04-18 hour 7: 217452 events in 0 files, snapshot none (task 8345 ms: download 5084 ms overlapping gunzip 1305 ms, parse 5613 ms, sort 0 ms, write 0 ms, index 882 ms: 15 candidates, 87433 repo-hours, 1031 releases; waiting 335 ms; commit 0 ms)
2026-11-08T11:29:28Z [load_day 2025-04-18] 2025-04-18 hour 8: 225084 events in 0 files, snapshot none (task 8288 ms: download 5108 ms overlapping gunzip 1213 ms, parse 5194 ms, sort 0 ms, write 0 ms, index 1004 ms: 8 candidates, 92903 repo-hours, 1003 releases; waiting 502 ms; commit 0 ms)
2026-11-08T11:29:30Z [load_day 2025-04-18] 2025-04-18 hour 9: 230547 events in 0 files, snapshot none (task 8075 ms: download 4807 ms overlapping gunzip 1165 ms, parse 5188 ms, sort 0 ms, write 0 ms, index 876 ms: 7 candidates, 96819 repo-hours, 1233 releases; waiting 505 ms; commit 0 ms)
2026-11-08T11:29:37Z [load_day 2025-04-18] 2025-04-18 hour 10: 218974 events in 0 files, snapshot none (task 8190 ms: download 4652 ms overlapping gunzip 1114 ms, parse 4829 ms, sort 0 ms, write 0 ms, index 1398 ms: 10 candidates, 87582 repo-hours, 1033 releases; waiting 578 ms; commit 0 ms)
2026-11-08T11:29:39Z [load_day 2025-04-18] 2025-04-18 hour 11: 219870 events in 0 files, snapshot none (task 8005 ms: download 5000 ms overlapping gunzip 1168 ms, parse 4946 ms, sort 0 ms, write 0 ms, index 686 ms: 5 candidates, 84656 repo-hours, 964 releases; waiting 903 ms; commit 0 ms)
2026-11-08T11:29:46Z [load_day 2025-04-18] 2025-04-18 hour 12: 267149 events in 0 files, snapshot none (task 7948 ms: download 4931 ms overlapping gunzip 1141 ms, parse 4971 ms, sort 0 ms, write 0 ms, index 1007 ms: 7 candidates, 133598 repo-hours, 1154 releases; waiting 518 ms; commit 0 ms)
2026-11-08T11:29:46Z [load_day 2025-04-18] 2025-04-18 hour 13: 249576 events in 0 files, snapshot none (task 7000 ms: download 4336 ms overlapping gunzip 1036 ms, parse 4398 ms, sort 0 ms, write 0 ms, index 764 ms: 11 candidates, 114138 repo-hours, 1171 releases; waiting 460 ms; commit 0 ms)
2026-11-08T11:29:54Z [load_day 2025-04-18] 2025-04-18 hour 14: 244577 events in 0 files, snapshot none (task 7662 ms: download 5105 ms overlapping gunzip 1173 ms, parse 5123 ms, sort 0 ms, write 0 ms, index 739 ms: 4 candidates, 100093 repo-hours, 1321 releases; waiting 358 ms; commit 0 ms)
2026-11-08T11:29:54Z [load_day 2025-04-18] 2025-04-18 hour 15: 247609 events in 0 files, snapshot none (task 7596 ms: download 4933 ms overlapping gunzip 1153 ms, parse 4850 ms, sort 0 ms, write 0 ms, index 759 ms: 7 candidates, 106181 repo-hours, 1317 releases; waiting 500 ms; commit 0 ms)
2026-11-08T11:30:04Z [load_day 2025-04-18] 2025-04-18 hour 16: 238142 events in 0 files, snapshot none (task 9566 ms: download 6318 ms overlapping gunzip 1469 ms, parse 6316 ms, sort 0 ms, write 0 ms, index 879 ms: 8 candidates, 98334 repo-hours, 1143 releases; waiting 557 ms; commit 0 ms)
2026-11-08T11:30:04Z [load_day 2025-04-18] 2025-04-18 hour 17: 230777 events in 0 files, snapshot none (task 9448 ms: download 6495 ms overlapping gunzip 1546 ms, parse 6141 ms, sort 0 ms, write 0 ms, index 831 ms: 4 candidates, 93103 repo-hours, 1038 releases; waiting 709 ms; commit 0 ms)
2026-11-08T11:30:14Z [load_day 2025-04-18] 2025-04-18 hour 18: 238710 events in 0 files, snapshot none (task 9261 ms: download 6289 ms overlapping gunzip 1441 ms, parse 5910 ms, sort 0 ms, write 0 ms, index 972 ms: 5 candidates, 104494 repo-hours, 1136 releases; waiting 632 ms; commit 0 ms)
2026-11-08T11:30:14Z [load_day 2025-04-18] 2025-04-18 hour 19: 219043 events in 0 files, snapshot none (task 9179 ms: download 6641 ms overlapping gunzip 1456 ms, parse 6008 ms, sort 0 ms, write 0 ms, index 732 ms: 2 candidates, 84385 repo-hours, 1153 releases; waiting 731 ms; commit 0 ms)
2026-11-08T11:30:24Z [load_day 2025-04-18] 2025-04-18 hour 20: 212615 events in 0 files, snapshot none (task 8731 ms: download 5286 ms overlapping gunzip 1389 ms, parse 5741 ms, sort 0 ms, write 0 ms, index 631 ms: 10 candidates, 81891 repo-hours, 1209 releases; waiting 639 ms; commit 0 ms)
2026-11-08T11:30:24Z [load_day 2025-04-18] 2025-04-18 hour 21: 204630 events in 0 files, snapshot none (task 8110 ms: download 4847 ms overlapping gunzip 1296 ms, parse 5442 ms, sort 0 ms, write 0 ms, index 597 ms: 6 candidates, 79441 repo-hours, 1243 releases; waiting 520 ms; commit 0 ms)
2026-11-08T11:30:32Z [load_day 2025-04-18] 2025-04-18 hour 22: 189807 events in 0 files, snapshot none (task 7791 ms: download 5309 ms overlapping gunzip 1239 ms, parse 5094 ms, sort 0 ms, write 0 ms, index 600 ms: 6 candidates, 68108 repo-hours, 1206 releases; waiting 553 ms; commit 0 ms)
2026-11-08T11:30:32Z [load_day 2025-04-18] 2025-04-18 hour 23: 176031 events in 0 files, snapshot none (task 6912 ms: download 4293 ms overlapping gunzip 1065 ms, parse 4424 ms, sort 0 ms, write 0 ms, index 457 ms: 6 candidates, 63608 repo-hours, 1226 releases; waiting 674 ms; commit 0 ms)
2026-11-08T11:30:41Z [load_day 2025-04-18] 2025-04-18: repo_hour merged from 24 files to 1 (2199522 rows, 9535 ms)
2026-11-08T11:30:44Z [load_day 2025-04-18] 2025-04-18: index committed in 12254 ms (24 + 1 + 24 files)
2026-11-08T11:30:44Z [load_day 2025-04-18] 2025-04-18: 5240446 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:30:44Z [load_day 2025-04-18] attempt 1 succeeded