orcaLog in

Runs · run 687

load_day 2026-04-03, attempt 1 succeeded

Host
4e84322b8c45:169362
Started
2026-11-07T13:12:09Z
Ended
2026-11-07T13:13:57Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/687/load_day/2026-04-03/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T13:12:09Z [load_day 2026-04-03] attempt 1 started
2026-11-07T13:12:19Z [load_day 2026-04-03] 2026-04-03 hour 0: 148938 events in 3 files, snapshot 6426504313598273888 (task 6646 ms: download 1831 ms overlapping gunzip 429 ms, parse 1463 ms, sort 318 ms, write 3142 ms, index 481 ms: 6 candidates, 69847 repo-hours, 778 releases; waiting 503 ms; commit 1213 ms)
2026-11-07T13:12:21Z [load_day 2026-04-03] 2026-04-03 hour 1: 154338 events in 4 files, snapshot 7133214827708823286 (task 6427 ms: download 2163 ms overlapping gunzip 402 ms, parse 1420 ms, sort 253 ms, write 2700 ms, index 553 ms: 4 candidates, 85708 repo-hours, 685 releases; waiting 528 ms; commit 1329 ms)
2026-11-07T13:12:26Z [load_day 2026-04-03] 2026-04-03 hour 2: 163236 events in 4 files, snapshot 5196995152043404739 (task 6387 ms: download 1959 ms overlapping gunzip 408 ms, parse 1333 ms, sort 134 ms, write 3093 ms, index 613 ms: 10 candidates, 90886 repo-hours, 628 releases; waiting 533 ms; commit 1205 ms)
2026-11-07T13:12:28Z [load_day 2026-04-03] 2026-04-03 hour 3: 154231 events in 4 files, snapshot 8378511369458495882 (task 6220 ms: download 2224 ms overlapping gunzip 416 ms, parse 1331 ms, sort 135 ms, write 2980 ms, index 499 ms: 8 candidates, 76066 repo-hours, 724 releases; waiting 545 ms; commit 1337 ms)
2026-11-07T13:12:34Z [load_day 2026-04-03] 2026-04-03 hour 4: 152896 events in 4 files, snapshot 1531014303217814568 (task 7352 ms: download 2598 ms overlapping gunzip 569 ms, parse 1773 ms, sort 146 ms, write 3076 ms, index 756 ms: 6 candidates, 70475 repo-hours, 721 releases; waiting 696 ms; commit 1368 ms)
2026-11-07T13:12:38Z [load_day 2026-04-03] 2026-04-03 hour 5: 158253 events in 4 files, snapshot 7718431879310557445 (task 9617 ms: download 3217 ms overlapping gunzip 660 ms, parse 2083 ms, sort 255 ms, write 4723 ms, index 664 ms: 5 candidates, 74988 repo-hours, 652 releases; waiting 833 ms; commit 1481 ms)
2026-11-07T13:12:44Z [load_day 2026-04-03] 2026-04-03 hour 6: 161351 events in 4 files, snapshot 7740323900271179952 (task 8572 ms: download 2740 ms overlapping gunzip 546 ms, parse 1630 ms, sort 164 ms, write 4248 ms, index 573 ms: 2 candidates, 79763 repo-hours, 570 releases; waiting 960 ms; commit 1461 ms)
2026-11-07T13:12:47Z [load_day 2026-04-03] 2026-04-03 hour 7: 163542 events in 4 files, snapshot 2596259266109589710 (task 8193 ms: download 3693 ms overlapping gunzip 498 ms, parse 1514 ms, sort 166 ms, write 3761 ms, index 890 ms: 6 candidates, 81592 repo-hours, 480 releases; waiting 1022 ms; commit 1375 ms)
2026-11-07T13:12:52Z [load_day 2026-04-03] 2026-04-03 hour 8: 159393 events in 4 files, snapshot 4020131404208025705 (task 8029 ms: download 2566 ms overlapping gunzip 520 ms, parse 1589 ms, sort 149 ms, write 4178 ms, index 572 ms: 13 candidates, 82337 repo-hours, 533 releases; waiting 662 ms; commit 1363 ms)
2026-11-07T13:12:56Z [load_day 2026-04-03] 2026-04-03 hour 9: 159018 events in 4 files, snapshot 4961301367141874566 (task 8636 ms: download 2947 ms overlapping gunzip 579 ms, parse 1723 ms, sort 190 ms, write 4452 ms, index 668 ms: 8 candidates, 81088 repo-hours, 519 releases; waiting 689 ms; commit 1346 ms)
2026-11-07T13:13:02Z [load_day 2026-04-03] 2026-04-03 hour 10: 160481 events in 4 files, snapshot 5626287527337913594 (task 9495 ms: download 2890 ms overlapping gunzip 781 ms, parse 2278 ms, sort 154 ms, write 4808 ms, index 584 ms: 5 candidates, 81211 repo-hours, 594 releases; waiting 575 ms; commit 1423 ms)
2026-11-07T13:13:04Z [load_day 2026-04-03] 2026-04-03 hour 11: 161617 events in 4 files, snapshot 3848957577465456965 (task 6826 ms: download 1994 ms overlapping gunzip 535 ms, parse 1655 ms, sort 205 ms, write 3318 ms, index 554 ms: 8 candidates, 82396 repo-hours, 587 releases; waiting 220 ms; commit 1274 ms)
2026-11-07T13:13:09Z [load_day 2026-04-03] 2026-04-03 hour 12: 160151 events in 4 files, snapshot 768237415884862384 (task 5853 ms: download 1867 ms overlapping gunzip 417 ms, parse 1243 ms, sort 173 ms, write 2637 ms, index 587 ms: 8 candidates, 87519 repo-hours, 592 releases; waiting 540 ms; commit 1304 ms)
2026-11-07T13:13:11Z [load_day 2026-04-03] 2026-04-03 hour 13: 159283 events in 4 files, snapshot 4118604401687151397 (task 5919 ms: download 2469 ms overlapping gunzip 428 ms, parse 1416 ms, sort 164 ms, write 2606 ms, index 629 ms: 9 candidates, 92794 repo-hours, 549 releases; waiting 418 ms; commit 1229 ms)
2026-11-07T13:13:17Z [load_day 2026-04-03] 2026-04-03 hour 14: 161003 events in 4 files, snapshot 3495699442576115105 (task 7049 ms: download 2012 ms overlapping gunzip 434 ms, parse 1408 ms, sort 150 ms, write 3488 ms, index 731 ms: 9 candidates, 87193 repo-hours, 642 releases; waiting 540 ms; commit 1354 ms)
2026-11-07T13:13:18Z [load_day 2026-04-03] 2026-04-03 hour 15: 158997 events in 4 files, snapshot 5630410421071875120 (task 6074 ms: download 1596 ms overlapping gunzip 401 ms, parse 1298 ms, sort 181 ms, write 3036 ms, index 571 ms: 33 candidates, 85693 repo-hours, 708 releases; waiting 261 ms; commit 1258 ms)
2026-11-07T13:13:25Z [load_day 2026-04-03] 2026-04-03 hour 16: 159067 events in 4 files, snapshot 3247105736805610142 (task 6815 ms: download 2160 ms overlapping gunzip 424 ms, parse 1445 ms, sort 274 ms, write 2892 ms, index 830 ms: 10 candidates, 83076 repo-hours, 634 releases; waiting 641 ms; commit 2203 ms)
2026-11-07T13:13:26Z [load_day 2026-04-03] 2026-04-03 hour 17: 152617 events in 4 files, snapshot 5350619682301969252 (task 6182 ms: download 2049 ms overlapping gunzip 400 ms, parse 1313 ms, sort 131 ms, write 2968 ms, index 528 ms: 10 candidates, 78332 repo-hours, 588 releases; waiting 545 ms; commit 1243 ms)
2026-11-07T13:13:32Z [load_day 2026-04-03] 2026-04-03 hour 18: 163729 events in 4 files, snapshot 838605418939033057 (task 6416 ms: download 2039 ms overlapping gunzip 443 ms, parse 1340 ms, sort 164 ms, write 2908 ms, index 557 ms: 9 candidates, 77145 repo-hours, 619 releases; waiting 715 ms; commit 1435 ms)
2026-11-07T13:13:34Z [load_day 2026-04-03] 2026-04-03 hour 19: 158594 events in 4 files, snapshot 7656861682625673402 (task 6155 ms: download 1957 ms overlapping gunzip 445 ms, parse 1408 ms, sort 177 ms, write 2658 ms, index 552 ms: 6 candidates, 77908 repo-hours, 635 releases; waiting 598 ms; commit 1639 ms)
2026-11-07T13:13:38Z [load_day 2026-04-03] 2026-04-03 hour 20: 154814 events in 4 files, snapshot 2372885485254273552 (task 6137 ms: download 1932 ms overlapping gunzip 394 ms, parse 1267 ms, sort 149 ms, write 2796 ms, index 547 ms: 7 candidates, 77762 repo-hours, 700 releases; waiting 686 ms; commit 1153 ms)
2026-11-07T13:13:41Z [load_day 2026-04-03] 2026-04-03 hour 21: 156833 events in 4 files, snapshot 1640283950291852889 (task 6105 ms: download 1831 ms overlapping gunzip 462 ms, parse 1456 ms, sort 167 ms, write 2661 ms, index 508 ms: 2 candidates, 76336 repo-hours, 740 releases; waiting 548 ms; commit 1498 ms)
2026-11-07T13:13:46Z [load_day 2026-04-03] 2026-04-03 hour 22: 151950 events in 4 files, snapshot 6986690323370828512 (task 6499 ms: download 2573 ms overlapping gunzip 415 ms, parse 1402 ms, sort 197 ms, write 2961 ms, index 592 ms: 5 candidates, 71926 repo-hours, 732 releases; waiting 588 ms; commit 1329 ms)
2026-11-07T13:13:47Z [load_day 2026-04-03] 2026-04-03 hour 23: 149674 events in 3 files, snapshot 7975425131268271718 (task 6176 ms: download 1994 ms overlapping gunzip 420 ms, parse 1477 ms, sort 170 ms, write 2678 ms, index 471 ms: 7 candidates, 69529 repo-hours, 960 releases; waiting 583 ms; commit 1321 ms)
2026-11-07T13:13:55Z [load_day 2026-04-03] 2026-04-03: repo_hour merged from 24 files to 1 (1921570 rows, 7956 ms)
2026-11-07T13:13:57Z [load_day 2026-04-03] 2026-04-03: index committed in 9867 ms (24 + 1 + 24 files)
2026-11-07T13:13:57Z [load_day 2026-04-03] 2026-04-03: 3784006 events in 24 hours
2026-11-07T13:13:57Z [load_day 2026-04-03] attempt 1 succeeded