orcaLog in

Runs · run 3491

load_day 2025-01-29, attempt 1 succeeded

Host
73ccef5e07c2:245512
Started
2026-11-08T10:03:25Z
Ended
2026-11-08T10:05:29Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
743 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
190.3 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3491/load_day/2025-01-29/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:03:25Z [load_day 2025-01-29] attempt 1 started
2026-11-08T10:03:26Z [load_day 2025-01-29] 2025-01-29: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:03:36Z [load_day 2025-01-29] 2025-01-29 hour 0: 196126 events in 0 files, snapshot none (task 9947 ms: download 6862 ms overlapping gunzip 1361 ms, parse 5932 ms, sort 0 ms, write 0 ms, index 770 ms: 9 candidates, 92466 repo-hours, 1264 releases; waiting 1625 ms; commit 0 ms)
2026-11-08T10:03:36Z [load_day 2025-01-29] 2025-01-29 hour 1: 203056 events in 0 files, snapshot none (task 8808 ms: download 4877 ms overlapping gunzip 1336 ms, parse 5926 ms, sort 0 ms, write 0 ms, index 1067 ms: 9 candidates, 104424 repo-hours, 1051 releases; waiting 209 ms; commit 0 ms)
2026-11-08T10:03:43Z [load_day 2025-01-29] 2025-01-29 hour 2: 167734 events in 0 files, snapshot none (task 6728 ms: download 3597 ms overlapping gunzip 990 ms, parse 4285 ms, sort 0 ms, write 0 ms, index 624 ms: 8 candidates, 70722 repo-hours, 788 releases; waiting 481 ms; commit 0 ms)
2026-11-08T10:03:44Z [load_day 2025-01-29] 2025-01-29 hour 3: 180796 events in 0 files, snapshot none (task 6803 ms: download 3649 ms overlapping gunzip 993 ms, parse 4357 ms, sort 0 ms, write 0 ms, index 718 ms: 6 candidates, 70210 repo-hours, 3954 releases; waiting 495 ms; commit 0 ms)
2026-11-08T10:03:50Z [load_day 2025-01-29] 2025-01-29 hour 4: 176639 events in 0 files, snapshot none (task 6516 ms: download 3622 ms overlapping gunzip 975 ms, parse 4151 ms, sort 0 ms, write 0 ms, index 518 ms: 4 candidates, 64492 repo-hours, 829 releases; waiting 259 ms; commit 0 ms)
2026-11-08T10:03:50Z [load_day 2025-01-29] 2025-01-29 hour 5: 183254 events in 0 files, snapshot none (task 6338 ms: download 3841 ms overlapping gunzip 953 ms, parse 4090 ms, sort 0 ms, write 0 ms, index 563 ms: 2 candidates, 67576 repo-hours, 698 releases; waiting 467 ms; commit 0 ms)
2026-11-08T10:03:59Z [load_day 2025-01-29] 2025-01-29 hour 6: 199135 events in 0 files, snapshot none (task 7756 ms: download 4888 ms overlapping gunzip 1138 ms, parse 5053 ms, sort 0 ms, write 0 ms, index 769 ms: 6 candidates, 82876 repo-hours, 841 releases; waiting 504 ms; commit 0 ms)
2026-11-08T10:03:59Z [load_day 2025-01-29] 2025-01-29 hour 7: 198153 events in 0 files, snapshot none (task 7788 ms: download 4846 ms overlapping gunzip 1235 ms, parse 5035 ms, sort 0 ms, write 0 ms, index 708 ms: 12 candidates, 73126 repo-hours, 827 releases; waiting 525 ms; commit 0 ms)
2026-11-08T10:04:08Z [load_day 2025-01-29] 2025-01-29 hour 8: 212907 events in 0 files, snapshot none (task 8885 ms: download 6133 ms overlapping gunzip 1444 ms, parse 6027 ms, sort 0 ms, write 0 ms, index 650 ms: 8 candidates, 84717 repo-hours, 979 releases; waiting 517 ms; commit 0 ms)
2026-11-08T10:04:08Z [load_day 2025-01-29] 2025-01-29 hour 9: 235372 events in 0 files, snapshot none (task 9210 ms: download 6580 ms overlapping gunzip 1477 ms, parse 6239 ms, sort 0 ms, write 0 ms, index 751 ms: 7 candidates, 95375 repo-hours, 1274 releases; waiting 509 ms; commit 0 ms)
2026-11-08T10:04:17Z [load_day 2025-01-29] 2025-01-29 hour 10: 233453 events in 0 files, snapshot none (task 8480 ms: download 5592 ms overlapping gunzip 1362 ms, parse 5642 ms, sort 0 ms, write 0 ms, index 720 ms: 8 candidates, 93900 repo-hours, 1142 releases; waiting 527 ms; commit 0 ms)
2026-11-08T10:04:20Z [load_day 2025-01-29] 2025-01-29 hour 11: 233107 events in 0 files, snapshot none (task 11191 ms: download 8606 ms overlapping gunzip 1221 ms, parse 5334 ms, sort 0 ms, write 0 ms, index 737 ms: 9 candidates, 90080 repo-hours, 1115 releases; waiting 3662 ms; commit 0 ms)
2026-11-08T10:04:25Z [load_day 2025-01-29] 2025-01-29 hour 12: 274378 events in 0 files, snapshot none (task 8049 ms: download 4828 ms overlapping gunzip 1155 ms, parse 5027 ms, sort 0 ms, write 0 ms, index 1110 ms: 11 candidates, 134754 repo-hours, 1291 releases; waiting 492 ms; commit 0 ms)
2026-11-08T10:04:29Z [load_day 2025-01-29] 2025-01-29 hour 13: 263222 events in 0 files, snapshot none (task 8267 ms: download 5402 ms overlapping gunzip 1259 ms, parse 5395 ms, sort 0 ms, write 0 ms, index 968 ms: 5 candidates, 118107 repo-hours, 1264 releases; waiting 321 ms; commit 0 ms)
2026-11-08T10:04:34Z [load_day 2025-01-29] 2025-01-29 hour 14: 257186 events in 0 files, snapshot none (task 8385 ms: download 5500 ms overlapping gunzip 1255 ms, parse 5269 ms, sort 0 ms, write 0 ms, index 1016 ms: 11 candidates, 106221 repo-hours, 1467 releases; waiting 509 ms; commit 0 ms)
2026-11-08T10:04:39Z [load_day 2025-01-29] 2025-01-29 hour 15: 259823 events in 0 files, snapshot none (task 9193 ms: download 5590 ms overlapping gunzip 1364 ms, parse 5958 ms, sort 0 ms, write 0 ms, index 1295 ms: 6 candidates, 111539 repo-hours, 1397 releases; waiting 328 ms; commit 0 ms)
2026-11-08T10:04:45Z [load_day 2025-01-29] 2025-01-29 hour 16: 254644 events in 0 files, snapshot none (task 10381 ms: download 6400 ms overlapping gunzip 1589 ms, parse 6630 ms, sort 0 ms, write 0 ms, index 1317 ms: 8 candidates, 107647 repo-hours, 1285 releases; waiting 502 ms; commit 0 ms)
2026-11-08T10:04:48Z [load_day 2025-01-29] 2025-01-29 hour 17: 247456 events in 0 files, snapshot none (task 9024 ms: download 6213 ms overlapping gunzip 1469 ms, parse 6266 ms, sort 0 ms, write 0 ms, index 780 ms: 14 candidates, 100635 repo-hours, 1141 releases; waiting 256 ms; commit 0 ms)
2026-11-08T10:04:55Z [load_day 2025-01-29] 2025-01-29 hour 18: 254068 events in 0 files, snapshot none (task 9266 ms: download 6371 ms overlapping gunzip 1440 ms, parse 6103 ms, sort 0 ms, write 0 ms, index 917 ms: 27 candidates, 111574 repo-hours, 1310 releases; waiting 563 ms; commit 0 ms)
2026-11-08T10:04:59Z [load_day 2025-01-29] 2025-01-29 hour 19: 236867 events in 0 files, snapshot none (task 10414 ms: download 6422 ms overlapping gunzip 1600 ms, parse 6717 ms, sort 0 ms, write 0 ms, index 1267 ms: 16 candidates, 89855 repo-hours, 1077 releases; waiting 467 ms; commit 0 ms)
2026-11-08T10:05:05Z [load_day 2025-01-29] 2025-01-29 hour 20: 229630 events in 0 files, snapshot none (task 9431 ms: download 6327 ms overlapping gunzip 1462 ms, parse 6029 ms, sort 0 ms, write 0 ms, index 1196 ms: 25 candidates, 89264 repo-hours, 1014 releases; waiting 489 ms; commit 0 ms)
2026-11-08T10:05:10Z [load_day 2025-01-29] 2025-01-29 hour 21: 225284 events in 0 files, snapshot none (task 9839 ms: download 6886 ms overlapping gunzip 1391 ms, parse 5778 ms, sort 0 ms, write 0 ms, index 908 ms: 8 candidates, 88836 repo-hours, 1191 releases; waiting 1463 ms; commit 0 ms)
2026-11-08T10:05:13Z [load_day 2025-01-29] 2025-01-29 hour 22: 204002 events in 0 files, snapshot none (task 7519 ms: download 4858 ms overlapping gunzip 1268 ms, parse 4767 ms, sort 0 ms, write 0 ms, index 726 ms: 11 candidates, 77339 repo-hours, 1224 releases; waiting 517 ms; commit 0 ms)
2026-11-08T10:05:16Z [load_day 2025-01-29] 2025-01-29 hour 23: 186200 events in 0 files, snapshot none (task 5930 ms: download 3277 ms overlapping gunzip 902 ms, parse 3957 ms, sort 0 ms, write 0 ms, index 554 ms: 21 candidates, 68922 repo-hours, 927 releases; waiting 241 ms; commit 0 ms)
2026-11-08T10:05:26Z [load_day 2025-01-29] 2025-01-29: repo_hour merged from 24 files to 1 (2194657 rows, 9835 ms)
2026-11-08T10:05:29Z [load_day 2025-01-29] 2025-01-29: index committed in 12773 ms (24 + 1 + 24 files)
2026-11-08T10:05:29Z [load_day 2025-01-29] 2025-01-29: 5312492 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:05:29Z [load_day 2025-01-29] attempt 1 succeeded