orcaLog in

Runs · run 5056

load_day 2026-03-20, attempt 1 succeeded

Host
73ccef5e07c2:457882
Started
2026-11-08T15:37:40Z
Ended
2026-11-08T15:38:46Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
725 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
70.4 s, up to 2.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/5056/load_day/2026-03-20/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:37:40Z [load_day 2026-03-20] attempt 1 started
2026-11-08T15:37:41Z [load_day 2026-03-20] 2026-03-20: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:37:46Z [load_day 2026-03-20] 2026-03-20 hour 0: 149811 events in 0 files, snapshot none (task 4804 ms: download 3518 ms overlapping gunzip 489 ms, parse 1544 ms, sort 0 ms, write 0 ms, index 557 ms: 9 candidates, 72427 repo-hours, 909 releases; waiting 1498 ms; commit 0 ms)
2026-11-08T15:37:46Z [load_day 2026-03-20] 2026-03-20 hour 1: 154057 events in 0 files, snapshot none (task 3999 ms: download 2430 ms overlapping gunzip 325 ms, parse 1067 ms, sort 0 ms, write 0 ms, index 1011 ms: 9 candidates, 91601 repo-hours, 524 releases; waiting 1253 ms; commit 0 ms)
2026-11-08T15:37:50Z [load_day 2026-03-20] 2026-03-20 hour 2: 147522 events in 0 files, snapshot none (task 3369 ms: download 1748 ms overlapping gunzip 390 ms, parse 1143 ms, sort 0 ms, write 0 ms, index 740 ms: 11 candidates, 87263 repo-hours, 615 releases; waiting 776 ms; commit 0 ms)
2026-11-08T15:37:51Z [load_day 2026-03-20] 2026-03-20 hour 3: 143523 events in 0 files, snapshot none (task 3790 ms: download 2510 ms overlapping gunzip 437 ms, parse 1332 ms, sort 0 ms, write 0 ms, index 583 ms: 7 candidates, 71147 repo-hours, 1034 releases; waiting 1147 ms; commit 0 ms)
2026-11-08T15:37:55Z [load_day 2026-03-20] 2026-03-20 hour 4: 146766 events in 0 files, snapshot none (task 3855 ms: download 2376 ms overlapping gunzip 442 ms, parse 1307 ms, sort 0 ms, write 0 ms, index 850 ms: 8 candidates, 73378 repo-hours, 998 releases; waiting 927 ms; commit 0 ms)
2026-11-08T15:37:55Z [load_day 2026-03-20] 2026-03-20 hour 5: 135849 events in 0 files, snapshot none (task 3496 ms: download 2330 ms overlapping gunzip 474 ms, parse 1389 ms, sort 0 ms, write 0 ms, index 553 ms: 2 candidates, 67402 repo-hours, 735 releases; waiting 758 ms; commit 0 ms)
2026-11-08T15:37:59Z [load_day 2026-03-20] 2026-03-20 hour 6: 151264 events in 0 files, snapshot none (task 4094 ms: download 2451 ms overlapping gunzip 464 ms, parse 1460 ms, sort 0 ms, write 0 ms, index 1000 ms: 6 candidates, 78289 repo-hours, 772 releases; waiting 889 ms; commit 0 ms)
2026-11-08T15:38:00Z [load_day 2026-03-20] 2026-03-20 hour 7: 146519 events in 0 files, snapshot none (task 4318 ms: download 2857 ms overlapping gunzip 520 ms, parse 1587 ms, sort 0 ms, write 0 ms, index 665 ms: 7 candidates, 79005 repo-hours, 472 releases; waiting 1221 ms; commit 0 ms)
2026-11-08T15:38:03Z [load_day 2026-03-20] 2026-03-20 hour 8: 152457 events in 0 files, snapshot none (task 3321 ms: download 2080 ms overlapping gunzip 445 ms, parse 1271 ms, sort 0 ms, write 0 ms, index 602 ms: 7 candidates, 82731 repo-hours, 570 releases; waiting 701 ms; commit 0 ms)
2026-11-08T15:38:03Z [load_day 2026-03-20] 2026-03-20 hour 9: 155758 events in 0 files, snapshot none (task 2992 ms: download 1669 ms overlapping gunzip 430 ms, parse 1265 ms, sort 0 ms, write 0 ms, index 630 ms: 6 candidates, 85751 repo-hours, 515 releases; waiting 381 ms; commit 0 ms)
2026-11-08T15:38:07Z [load_day 2026-03-20] 2026-03-20 hour 10: 152882 events in 0 files, snapshot none (task 3047 ms: download 1950 ms overlapping gunzip 344 ms, parse 1018 ms, sort 0 ms, write 0 ms, index 667 ms: 3 candidates, 83365 repo-hours, 488 releases; waiting 710 ms; commit 0 ms)
2026-11-08T15:38:07Z [load_day 2026-03-20] 2026-03-20 hour 11: 154080 events in 0 files, snapshot none (task 3622 ms: download 2457 ms overlapping gunzip 366 ms, parse 1105 ms, sort 0 ms, write 0 ms, index 611 ms: 8 candidates, 82650 repo-hours, 526 releases; waiting 1279 ms; commit 0 ms)
2026-11-08T15:38:11Z [load_day 2026-03-20] 2026-03-20 hour 12: 162906 events in 0 files, snapshot none (task 3930 ms: download 2410 ms overlapping gunzip 254 ms, parse 848 ms, sort 0 ms, write 0 ms, index 789 ms: 18 candidates, 94487 repo-hours, 213 releases; waiting 1716 ms; commit 0 ms)
2026-11-08T15:38:11Z [load_day 2026-03-20] 2026-03-20 hour 13: 160930 events in 0 files, snapshot none (task 2597 ms: download 1277 ms overlapping gunzip 233 ms, parse 784 ms, sort 0 ms, write 0 ms, index 826 ms: 8 candidates, 95032 repo-hours, 87 releases; waiting 446 ms; commit 0 ms)
2026-11-08T15:38:15Z [load_day 2026-03-20] 2026-03-20 hour 14: 152549 events in 0 files, snapshot none (task 2967 ms: download 1671 ms overlapping gunzip 285 ms, parse 973 ms, sort 0 ms, write 0 ms, index 805 ms: 8 candidates, 85896 repo-hours, 161 releases; waiting 563 ms; commit 0 ms)
2026-11-08T15:38:15Z [load_day 2026-03-20] 2026-03-20 hour 15: 155595 events in 0 files, snapshot none (task 3183 ms: download 2010 ms overlapping gunzip 249 ms, parse 915 ms, sort 0 ms, write 0 ms, index 724 ms: 14 candidates, 86009 repo-hours, 150 releases; waiting 926 ms; commit 0 ms)
2026-11-08T15:38:18Z [load_day 2026-03-20] 2026-03-20 hour 16: 164465 events in 0 files, snapshot none (task 2864 ms: download 1650 ms overlapping gunzip 285 ms, parse 943 ms, sort 0 ms, write 0 ms, index 736 ms: 9 candidates, 87566 repo-hours, 143 releases; waiting 550 ms; commit 0 ms)
2026-11-08T15:38:19Z [load_day 2026-03-20] 2026-03-20 hour 17: 159226 events in 0 files, snapshot none (task 3036 ms: download 1782 ms overlapping gunzip 325 ms, parse 1048 ms, sort 0 ms, write 0 ms, index 800 ms: 12 candidates, 85760 repo-hours, 230 releases; waiting 589 ms; commit 0 ms)
2026-11-08T15:38:24Z [load_day 2026-03-20] 2026-03-20 hour 18: 155605 events in 0 files, snapshot none (task 4679 ms: download 2414 ms overlapping gunzip 704 ms, parse 2023 ms, sort 0 ms, write 0 ms, index 1161 ms: 7 candidates, 85699 repo-hours, 196 releases; waiting 516 ms; commit 0 ms)
2026-11-08T15:38:24Z [load_day 2026-03-20] 2026-03-20 hour 19: 154344 events in 0 files, snapshot none (task 4541 ms: download 2498 ms overlapping gunzip 673 ms, parse 2094 ms, sort 0 ms, write 0 ms, index 881 ms: 14 candidates, 81457 repo-hours, 576 releases; waiting 581 ms; commit 0 ms)
2026-11-08T15:38:28Z [load_day 2026-03-20] 2026-03-20 hour 20: 154711 events in 0 files, snapshot none (task 4068 ms: download 2368 ms overlapping gunzip 598 ms, parse 1794 ms, sort 0 ms, write 0 ms, index 889 ms: 7 candidates, 81018 repo-hours, 623 releases; waiting 469 ms; commit 0 ms)
2026-11-08T15:38:28Z [load_day 2026-03-20] 2026-03-20 hour 21: 153252 events in 0 files, snapshot none (task 4143 ms: download 2295 ms overlapping gunzip 649 ms, parse 1884 ms, sort 0 ms, write 0 ms, index 741 ms: 7 candidates, 74093 repo-hours, 795 releases; waiting 551 ms; commit 0 ms)
2026-11-08T15:38:34Z [load_day 2026-03-20] 2026-03-20 hour 22: 157150 events in 0 files, snapshot none (task 4580 ms: download 2160 ms overlapping gunzip 759 ms, parse 2210 ms, sort 0 ms, write 0 ms, index 856 ms: 9 candidates, 74241 repo-hours, 904 releases; waiting 381 ms; commit 0 ms)
2026-11-08T15:38:34Z [load_day 2026-03-20] 2026-03-20 hour 23: 153841 events in 0 files, snapshot none (task 4515 ms: download 2624 ms overlapping gunzip 702 ms, parse 2160 ms, sort 0 ms, write 0 ms, index 731 ms: 4 candidates, 72586 repo-hours, 1150 releases; waiting 588 ms; commit 0 ms)
2026-11-08T15:38:42Z [load_day 2026-03-20] 2026-03-20: repo_hour merged from 24 files to 1 (1958853 rows, 8860 ms)
2026-11-08T15:38:46Z [load_day 2026-03-20] 2026-03-20: index committed in 12124 ms (24 + 1 + 24 files)
2026-11-08T15:38:46Z [load_day 2026-03-20] 2026-03-20: 3675062 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:38:46Z [load_day 2026-03-20] attempt 1 succeeded