orcaLog in

Runs · run 3722

load_day 2025-03-27, attempt 1 succeeded

Host
73ccef5e07c2:278340
Started
2026-11-08T11:04:53Z
Ended
2026-11-08T11:07:10Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
944 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
212.6 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3722/load_day/2025-03-27/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:04:53Z [load_day 2025-03-27] attempt 1 started
2026-11-08T11:04:54Z [load_day 2025-03-27] 2025-03-27: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:05:02Z [load_day 2025-03-27] 2025-03-27 hour 0: 212919 events in 0 files, snapshot none (task 7492 ms: download 4608 ms overlapping gunzip 1061 ms, parse 4693 ms, sort 0 ms, write 0 ms, index 966 ms: 4 candidates, 99666 repo-hours, 1298 releases; waiting 500 ms; commit 0 ms)
2026-11-08T11:05:03Z [load_day 2025-03-27] 2025-03-27 hour 1: 236667 events in 0 files, snapshot none (task 8233 ms: download 5028 ms overlapping gunzip 1184 ms, parse 5012 ms, sort 0 ms, write 0 ms, index 1227 ms: 3 candidates, 127585 repo-hours, 1165 releases; waiting 492 ms; commit 0 ms)
2026-11-08T11:05:11Z [load_day 2025-03-27] 2025-03-27 hour 2: 205263 events in 0 files, snapshot none (task 7989 ms: download 5039 ms overlapping gunzip 1221 ms, parse 5194 ms, sort 0 ms, write 0 ms, index 762 ms: 2 candidates, 90290 repo-hours, 1002 releases; waiting 513 ms; commit 0 ms)
2026-11-08T11:05:11Z [load_day 2025-03-27] 2025-03-27 hour 3: 221374 events in 0 files, snapshot none (task 7566 ms: download 4808 ms overlapping gunzip 1147 ms, parse 4969 ms, sort 0 ms, write 0 ms, index 711 ms: 6 candidates, 90906 repo-hours, 3525 releases; waiting 460 ms; commit 0 ms)
2026-11-08T11:05:19Z [load_day 2025-03-27] 2025-03-27 hour 4: 198458 events in 0 files, snapshot none (task 7727 ms: download 4814 ms overlapping gunzip 1210 ms, parse 4994 ms, sort 0 ms, write 0 ms, index 735 ms: 5 candidates, 75994 repo-hours, 867 releases; waiting 555 ms; commit 0 ms)
2026-11-08T11:05:20Z [load_day 2025-03-27] 2025-03-27 hour 5: 208451 events in 0 files, snapshot none (task 8055 ms: download 5298 ms overlapping gunzip 1273 ms, parse 5406 ms, sort 0 ms, write 0 ms, index 667 ms: 2 candidates, 81474 repo-hours, 894 releases; waiting 410 ms; commit 0 ms)
2026-11-08T11:05:26Z [load_day 2025-03-27] 2025-03-27 hour 6: 236953 events in 0 files, snapshot none (task 6613 ms: download 3911 ms overlapping gunzip 1032 ms, parse 4319 ms, sort 0 ms, write 0 ms, index 759 ms: 1 candidates, 104338 repo-hours, 1094 releases; waiting 290 ms; commit 0 ms)
2026-11-08T11:05:27Z [load_day 2025-03-27] 2025-03-27 hour 7: 236496 events in 0 files, snapshot none (task 7326 ms: download 4758 ms overlapping gunzip 1128 ms, parse 4606 ms, sort 0 ms, write 0 ms, index 731 ms: 2 candidates, 95512 repo-hours, 972 releases; waiting 581 ms; commit 0 ms)
2026-11-08T11:05:34Z [load_day 2025-03-27] 2025-03-27 hour 8: 254307 events in 0 files, snapshot none (task 7833 ms: download 5034 ms overlapping gunzip 1193 ms, parse 4954 ms, sort 0 ms, write 0 ms, index 865 ms: 7 candidates, 105968 repo-hours, 1157 releases; waiting 493 ms; commit 0 ms)
2026-11-08T11:05:36Z [load_day 2025-03-27] 2025-03-27 hour 9: 263233 events in 0 files, snapshot none (task 8230 ms: download 5571 ms overlapping gunzip 1265 ms, parse 5357 ms, sort 0 ms, write 0 ms, index 772 ms: 10 candidates, 112521 repo-hours, 1493 releases; waiting 511 ms; commit 0 ms)
2026-11-08T11:05:46Z [load_day 2025-03-27] 2025-03-27 hour 10: 259235 events in 0 files, snapshot none (task 11112 ms: download 8279 ms overlapping gunzip 1787 ms, parse 7488 ms, sort 0 ms, write 0 ms, index 801 ms: 4 candidates, 107884 repo-hours, 1256 releases; waiting 812 ms; commit 0 ms)
2026-11-08T11:05:47Z [load_day 2025-03-27] 2025-03-27 hour 11: 255592 events in 0 files, snapshot none (task 10175 ms: download 7408 ms overlapping gunzip 1650 ms, parse 6920 ms, sort 0 ms, write 0 ms, index 864 ms: 8 candidates, 102783 repo-hours, 1179 releases; waiting 492 ms; commit 0 ms)
2026-11-08T11:05:58Z [load_day 2025-03-27] 2025-03-27 hour 12: 287668 events in 0 files, snapshot none (task 11895 ms: download 7419 ms overlapping gunzip 1586 ms, parse 7120 ms, sort 0 ms, write 0 ms, index 2434 ms: 13 candidates, 146858 repo-hours, 1309 releases; waiting 495 ms; commit 0 ms)
2026-11-08T11:06:00Z [load_day 2025-03-27] 2025-03-27 hour 13: 277115 events in 0 files, snapshot none (task 12414 ms: download 7865 ms overlapping gunzip 1880 ms, parse 8219 ms, sort 0 ms, write 0 ms, index 1652 ms: 11 candidates, 131061 repo-hours, 1340 releases; waiting 371 ms; commit 0 ms)
2026-11-08T11:06:11Z [load_day 2025-03-27] 2025-03-27 hour 14: 274061 events in 0 files, snapshot none (task 11847 ms: download 8617 ms overlapping gunzip 1973 ms, parse 8448 ms, sort 0 ms, write 0 ms, index 982 ms: 7 candidates, 118069 repo-hours, 1457 releases; waiting 198 ms; commit 0 ms)
2026-11-08T11:06:13Z [load_day 2025-03-27] 2025-03-27 hour 15: 280860 events in 0 files, snapshot none (task 12499 ms: download 9513 ms overlapping gunzip 1961 ms, parse 8747 ms, sort 0 ms, write 0 ms, index 962 ms: 6 candidates, 122951 repo-hours, 1578 releases; waiting 525 ms; commit 0 ms)
2026-11-08T11:06:23Z [load_day 2025-03-27] 2025-03-27 hour 16: 267328 events in 0 files, snapshot none (task 11749 ms: download 8373 ms overlapping gunzip 1875 ms, parse 8031 ms, sort 0 ms, write 0 ms, index 1040 ms: 10 candidates, 114951 repo-hours, 1398 releases; waiting 594 ms; commit 0 ms)
2026-11-08T11:06:24Z [load_day 2025-03-27] 2025-03-27 hour 17: 259639 events in 0 files, snapshot none (task 10743 ms: download 7917 ms overlapping gunzip 1750 ms, parse 7552 ms, sort 0 ms, write 0 ms, index 746 ms: 10 candidates, 105448 repo-hours, 1216 releases; waiting 330 ms; commit 0 ms)
2026-11-08T11:06:35Z [load_day 2025-03-27] 2025-03-27 hour 18: 263985 events in 0 files, snapshot none (task 10795 ms: download 7728 ms overlapping gunzip 1678 ms, parse 7333 ms, sort 0 ms, write 0 ms, index 948 ms: 9 candidates, 115038 repo-hours, 1289 releases; waiting 508 ms; commit 0 ms)
2026-11-08T11:06:35Z [load_day 2025-03-27] 2025-03-27 hour 19: 245483 events in 0 files, snapshot none (task 10201 ms: download 7388 ms overlapping gunzip 1651 ms, parse 7099 ms, sort 0 ms, write 0 ms, index 724 ms: 5 candidates, 94504 repo-hours, 1357 releases; waiting 457 ms; commit 0 ms)
2026-11-08T11:06:46Z [load_day 2025-03-27] 2025-03-27 hour 20: 243421 events in 0 files, snapshot none (task 10516 ms: download 8082 ms overlapping gunzip 1866 ms, parse 7409 ms, sort 0 ms, write 0 ms, index 663 ms: 8 candidates, 94394 repo-hours, 1276 releases; waiting 278 ms; commit 0 ms)
2026-11-08T11:06:46Z [load_day 2025-03-27] 2025-03-27 hour 21: 229649 events in 0 files, snapshot none (task 9787 ms: download 7063 ms overlapping gunzip 1666 ms, parse 6646 ms, sort 0 ms, write 0 ms, index 738 ms: 9 candidates, 90272 repo-hours, 1271 releases; waiting 492 ms; commit 0 ms)
2026-11-08T11:06:55Z [load_day 2025-03-27] 2025-03-27 hour 22: 214264 events in 0 files, snapshot none (task 8930 ms: download 6101 ms overlapping gunzip 1452 ms, parse 5827 ms, sort 0 ms, write 0 ms, index 785 ms: 6 candidates, 79838 repo-hours, 1245 releases; waiting 544 ms; commit 0 ms)
2026-11-08T11:06:55Z [load_day 2025-03-27] 2025-03-27 hour 23: 198213 events in 0 files, snapshot none (task 9118 ms: download 6427 ms overlapping gunzip 1121 ms, parse 5431 ms, sort 0 ms, write 0 ms, index 689 ms: 7 candidates, 74231 repo-hours, 1293 releases; waiting 1625 ms; commit 0 ms)
2026-11-08T11:07:06Z [load_day 2025-03-27] 2025-03-27: repo_hour merged from 24 files to 1 (2482536 rows, 11050 ms)
2026-11-08T11:07:10Z [load_day 2025-03-27] 2025-03-27: index committed in 14400 ms (24 + 1 + 24 files)
2026-11-08T11:07:10Z [load_day 2025-03-27] 2025-03-27: 5830634 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:07:10Z [load_day 2025-03-27] attempt 1 succeeded