orcaLog in

Runs · run 3712

load_day 2025-03-25, attempt 1 succeeded

Host
73ccef5e07c2:276813
Started
2026-11-08T11:02:25Z
Ended
2026-11-08T11:04:52Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
899 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
225.0 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3712/load_day/2025-03-25/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:02:25Z [load_day 2025-03-25] attempt 1 started
2026-11-08T11:02:25Z [load_day 2025-03-25] 2025-03-25: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:02:36Z [load_day 2025-03-25] 2025-03-25 hour 0: 219357 events in 0 files, snapshot none (task 9972 ms: download 7270 ms overlapping gunzip 1646 ms, parse 6719 ms, sort 0 ms, write 0 ms, index 794 ms: 9 candidates, 100106 repo-hours, 1524 releases; waiting 530 ms; commit 0 ms)
2026-11-08T11:02:36Z [load_day 2025-03-25] 2025-03-25 hour 1: 247794 events in 0 files, snapshot none (task 9980 ms: download 6869 ms overlapping gunzip 1718 ms, parse 6547 ms, sort 0 ms, write 0 ms, index 932 ms: 7 candidates, 129428 repo-hours, 1024 releases; waiting 454 ms; commit 0 ms)
2026-11-08T11:02:48Z [load_day 2025-03-25] 2025-03-25 hour 2: 213070 events in 0 files, snapshot none (task 10978 ms: download 7597 ms overlapping gunzip 1854 ms, parse 7238 ms, sort 0 ms, write 0 ms, index 1116 ms: 9 candidates, 92213 repo-hours, 874 releases; waiting 515 ms; commit 0 ms)
2026-11-08T11:02:48Z [load_day 2025-03-25] 2025-03-25 hour 3: 224299 events in 0 files, snapshot none (task 11082 ms: download 7874 ms overlapping gunzip 1819 ms, parse 7768 ms, sort 0 ms, write 0 ms, index 755 ms: 2 candidates, 92957 repo-hours, 3290 releases; waiting 504 ms; commit 0 ms)
2026-11-08T11:02:55Z [load_day 2025-03-25] 2025-03-25 hour 4: 193648 events in 0 files, snapshot none (task 6617 ms: download 4164 ms overlapping gunzip 1024 ms, parse 4481 ms, sort 0 ms, write 0 ms, index 605 ms: 4 candidates, 75270 repo-hours, 801 releases; waiting 283 ms; commit 0 ms)
2026-11-08T11:02:56Z [load_day 2025-03-25] 2025-03-25 hour 5: 207710 events in 0 files, snapshot none (task 7312 ms: download 4742 ms overlapping gunzip 1204 ms, parse 4899 ms, sort 0 ms, write 0 ms, index 619 ms: 3 candidates, 80911 repo-hours, 833 releases; waiting 230 ms; commit 0 ms)
2026-11-08T11:03:03Z [load_day 2025-03-25] 2025-03-25 hour 6: 228321 events in 0 files, snapshot none (task 7275 ms: download 4473 ms overlapping gunzip 1042 ms, parse 4668 ms, sort 0 ms, write 0 ms, index 751 ms: 6 candidates, 102836 repo-hours, 1083 releases; waiting 515 ms; commit 0 ms)
2026-11-08T11:03:04Z [load_day 2025-03-25] 2025-03-25 hour 7: 237714 events in 0 files, snapshot none (task 7637 ms: download 5155 ms overlapping gunzip 1205 ms, parse 4961 ms, sort 0 ms, write 0 ms, index 698 ms: 3 candidates, 95590 repo-hours, 929 releases; waiting 507 ms; commit 0 ms)
2026-11-08T11:03:12Z [load_day 2025-03-25] 2025-03-25 hour 8: 264855 events in 0 files, snapshot none (task 8647 ms: download 5877 ms overlapping gunzip 1408 ms, parse 5764 ms, sort 0 ms, write 0 ms, index 843 ms: 5 candidates, 107674 repo-hours, 1194 releases; waiting 318 ms; commit 0 ms)
2026-11-08T11:03:13Z [load_day 2025-03-25] 2025-03-25 hour 9: 273105 events in 0 files, snapshot none (task 9052 ms: download 6387 ms overlapping gunzip 1405 ms, parse 5759 ms, sort 0 ms, write 0 ms, index 849 ms: 2 candidates, 115848 repo-hours, 1562 releases; waiting 773 ms; commit 0 ms)
2026-11-08T11:03:24Z [load_day 2025-03-25] 2025-03-25 hour 10: 261514 events in 0 files, snapshot none (task 11849 ms: download 8652 ms overlapping gunzip 1819 ms, parse 7902 ms, sort 0 ms, write 0 ms, index 1331 ms: 9 candidates, 109454 repo-hours, 1381 releases; waiting 517 ms; commit 0 ms)
2026-11-08T11:03:25Z [load_day 2025-03-25] 2025-03-25 hour 11: 257004 events in 0 files, snapshot none (task 11106 ms: download 7880 ms overlapping gunzip 1662 ms, parse 7553 ms, sort 0 ms, write 0 ms, index 1163 ms: 7 candidates, 104815 repo-hours, 1407 releases; waiting 353 ms; commit 0 ms)
2026-11-08T11:03:36Z [load_day 2025-03-25] 2025-03-25 hour 12: 290544 events in 0 files, snapshot none (task 11455 ms: download 7273 ms overlapping gunzip 1691 ms, parse 7431 ms, sort 0 ms, write 0 ms, index 1656 ms: 5 candidates, 148969 repo-hours, 1457 releases; waiting 340 ms; commit 0 ms)
2026-11-08T11:03:38Z [load_day 2025-03-25] 2025-03-25 hour 13: 281519 events in 0 files, snapshot none (task 12507 ms: download 8221 ms overlapping gunzip 1919 ms, parse 8277 ms, sort 0 ms, write 0 ms, index 1523 ms: 13 candidates, 133569 repo-hours, 1405 releases; waiting 482 ms; commit 0 ms)
2026-11-08T11:03:51Z [load_day 2025-03-25] 2025-03-25 hour 14: 273666 events in 0 files, snapshot none (task 13878 ms: download 10800 ms overlapping gunzip 2346 ms, parse 9829 ms, sort 0 ms, write 0 ms, index 955 ms: 7 candidates, 123072 repo-hours, 1425 releases; waiting 512 ms; commit 0 ms)
2026-11-08T11:03:52Z [load_day 2025-03-25] 2025-03-25 hour 15: 280389 events in 0 files, snapshot none (task 13710 ms: download 10711 ms overlapping gunzip 2349 ms, parse 9468 ms, sort 0 ms, write 0 ms, index 897 ms: 9 candidates, 127573 repo-hours, 1477 releases; waiting 661 ms; commit 0 ms)
2026-11-08T11:04:04Z [load_day 2025-03-25] 2025-03-25 hour 16: 272542 events in 0 files, snapshot none (task 12990 ms: download 9851 ms overlapping gunzip 2191 ms, parse 9144 ms, sort 0 ms, write 0 ms, index 864 ms: 9 candidates, 119219 repo-hours, 1396 releases; waiting 455 ms; commit 0 ms)
2026-11-08T11:04:05Z [load_day 2025-03-25] 2025-03-25 hour 17: 264437 events in 0 files, snapshot none (task 11868 ms: download 8885 ms overlapping gunzip 1963 ms, parse 8324 ms, sort 0 ms, write 0 ms, index 834 ms: 5 candidates, 109950 repo-hours, 1460 releases; waiting 253 ms; commit 0 ms)
2026-11-08T11:04:15Z [load_day 2025-03-25] 2025-03-25 hour 18: 264566 events in 0 files, snapshot none (task 10235 ms: download 7177 ms overlapping gunzip 1645 ms, parse 7116 ms, sort 0 ms, write 0 ms, index 993 ms: 2 candidates, 118351 repo-hours, 1325 releases; waiting 183 ms; commit 0 ms)
2026-11-08T11:04:16Z [load_day 2025-03-25] 2025-03-25 hour 19: 253022 events in 0 files, snapshot none (task 11074 ms: download 8073 ms overlapping gunzip 1845 ms, parse 7866 ms, sort 0 ms, write 0 ms, index 701 ms: 14 candidates, 99378 repo-hours, 1212 releases; waiting 200 ms; commit 0 ms)
2026-11-08T11:04:27Z [load_day 2025-03-25] 2025-03-25 hour 20: 239295 events in 0 files, snapshot none (task 11552 ms: download 8717 ms overlapping gunzip 1887 ms, parse 7821 ms, sort 0 ms, write 0 ms, index 743 ms: 3 candidates, 96675 repo-hours, 1297 releases; waiting 818 ms; commit 0 ms)
2026-11-08T11:04:28Z [load_day 2025-03-25] 2025-03-25 hour 21: 234689 events in 0 files, snapshot none (task 11146 ms: download 8462 ms overlapping gunzip 1851 ms, parse 7759 ms, sort 0 ms, write 0 ms, index 784 ms: 16 candidates, 93348 repo-hours, 1405 releases; waiting 475 ms; commit 0 ms)
2026-11-08T11:04:38Z [load_day 2025-03-25] 2025-03-25 hour 22: 214051 events in 0 files, snapshot none (task 10379 ms: download 6489 ms overlapping gunzip 1717 ms, parse 6917 ms, sort 0 ms, write 0 ms, index 1041 ms: 8 candidates, 82472 repo-hours, 1429 releases; waiting 398 ms; commit 0 ms)
2026-11-08T11:04:38Z [load_day 2025-03-25] 2025-03-25 hour 23: 200734 events in 0 files, snapshot none (task 9978 ms: download 6186 ms overlapping gunzip 1562 ms, parse 6683 ms, sort 0 ms, write 0 ms, index 901 ms: 7 candidates, 76693 repo-hours, 1292 releases; waiting 473 ms; commit 0 ms)
2026-11-08T11:04:50Z [load_day 2025-03-25] 2025-03-25: repo_hour merged from 24 files to 1 (2536371 rows, 11148 ms)
2026-11-08T11:04:52Z [load_day 2025-03-25] 2025-03-25: index committed in 13736 ms (24 + 1 + 24 files)
2026-11-08T11:04:52Z [load_day 2025-03-25] 2025-03-25: 5897845 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:04:52Z [load_day 2025-03-25] attempt 1 succeeded