orcaLog in

Runs · run 134

load_day 2026-10-04, attempt 1 succeeded

Host
4e84322b8c45:23233
Started
2026-11-07T03:42:11Z
Ended
2026-11-07T03:43:05Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/134/load_day/2026-10-04/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:42:11Z [load_day 2026-10-04] attempt 1 started
2026-11-07T03:42:18Z [load_day 2026-10-04] 2026-10-04 hour 0: 67855 events in 2 files, snapshot 6763671937409711210 (task 3707 ms: download 1782 ms overlapping gunzip 233 ms, parse 705 ms, sort 77 ms, write 1681 ms, index 238 ms: 4 candidates, 36072 repo-hours, 568 releases; waiting 544 ms; commit 712 ms)
2026-11-07T03:42:18Z [load_day 2026-10-04] 2026-10-04 hour 1: 69518 events in 2 files, snapshot 3897893479237615653 (task 3649 ms: download 1413 ms overlapping gunzip 186 ms, parse 586 ms, sort 72 ms, write 1693 ms, index 250 ms: 5 candidates, 36206 repo-hours, 430 releases; waiting 575 ms; commit 648 ms)
2026-11-07T03:42:22Z [load_day 2026-10-04] 2026-10-04 hour 2: 70526 events in 2 files, snapshot 6228675663664294516 (task 3410 ms: download 1245 ms overlapping gunzip 194 ms, parse 584 ms, sort 71 ms, write 1442 ms, index 271 ms: 8 candidates, 40357 repo-hours, 559 releases; waiting 551 ms; commit 659 ms)
2026-11-07T03:42:22Z [load_day 2026-10-04] 2026-10-04 hour 3: 76508 events in 2 files, snapshot 6283397659969921615 (task 3508 ms: download 1570 ms overlapping gunzip 237 ms, parse 651 ms, sort 69 ms, write 1347 ms, index 320 ms: 4 candidates, 46390 repo-hours, 439 releases; waiting 599 ms; commit 684 ms)
2026-11-07T03:42:26Z [load_day 2026-10-04] 2026-10-04 hour 4: 78096 events in 2 files, snapshot 7159433255097263789 (task 3257 ms: download 1102 ms overlapping gunzip 215 ms, parse 600 ms, sort 63 ms, write 1300 ms, index 298 ms: 3 candidates, 47739 repo-hours, 273 releases; waiting 535 ms; commit 724 ms)
2026-11-07T03:42:26Z [load_day 2026-10-04] 2026-10-04 hour 5: 77656 events in 2 files, snapshot 2470951748508201126 (task 3277 ms: download 1163 ms overlapping gunzip 228 ms, parse 646 ms, sort 55 ms, write 1274 ms, index 294 ms: 10 candidates, 47739 repo-hours, 518 releases; waiting 551 ms; commit 558 ms)
2026-11-07T03:42:30Z [load_day 2026-10-04] 2026-10-04 hour 6: 78859 events in 2 files, snapshot 6202577069445059713 (task 3444 ms: download 1359 ms overlapping gunzip 195 ms, parse 585 ms, sort 58 ms, write 1463 ms, index 288 ms: 8 candidates, 46953 repo-hours, 484 releases; waiting 544 ms; commit 819 ms)
2026-11-07T03:42:30Z [load_day 2026-10-04] 2026-10-04 hour 7: 77336 events in 2 files, snapshot 7322766178893391103 (task 3381 ms: download 1472 ms overlapping gunzip 166 ms, parse 502 ms, sort 51 ms, write 1309 ms, index 278 ms: 7 candidates, 45556 repo-hours, 290 releases; waiting 752 ms; commit 659 ms)
2026-11-07T03:42:33Z [load_day 2026-10-04] 2026-10-04 hour 8: 80208 events in 2 files, snapshot 5243838271053428052 (task 3258 ms: download 1431 ms overlapping gunzip 171 ms, parse 527 ms, sort 51 ms, write 1249 ms, index 324 ms: 8 candidates, 47209 repo-hours, 309 releases; waiting 611 ms; commit 734 ms)
2026-11-07T03:42:34Z [load_day 2026-10-04] 2026-10-04 hour 9: 74528 events in 2 files, snapshot 668398815776587756 (task 2980 ms: download 1157 ms overlapping gunzip 206 ms, parse 586 ms, sort 46 ms, write 1066 ms, index 332 ms: 10 candidates, 45209 repo-hours, 284 releases; waiting 529 ms; commit 656 ms)
2026-11-07T03:42:37Z [load_day 2026-10-04] 2026-10-04 hour 10: 75973 events in 2 files, snapshot 2338461696483497847 (task 2859 ms: download 1171 ms overlapping gunzip 154 ms, parse 480 ms, sort 48 ms, write 1062 ms, index 309 ms: 10 candidates, 44723 repo-hours, 222 releases; waiting 552 ms; commit 1270 ms)
2026-11-07T03:42:38Z [load_day 2026-10-04] 2026-10-04 hour 11: 78507 events in 2 files, snapshot 3306424166784078064 (task 2860 ms: download 1267 ms overlapping gunzip 158 ms, parse 510 ms, sort 50 ms, write 1012 ms, index 312 ms: 5 candidates, 48262 repo-hours, 179 releases; waiting 540 ms; commit 668 ms)
2026-11-07T03:42:40Z [load_day 2026-10-04] 2026-10-04 hour 12: 77699 events in 2 files, snapshot 115605366948080895 (task 2928 ms: download 1253 ms overlapping gunzip 158 ms, parse 493 ms, sort 48 ms, write 1102 ms, index 309 ms: 9 candidates, 48214 repo-hours, 274 releases; waiting 554 ms; commit 757 ms)
2026-11-07T03:42:41Z [load_day 2026-10-04] 2026-10-04 hour 13: 78041 events in 2 files, snapshot 609055019762707005 (task 2759 ms: download 1085 ms overlapping gunzip 154 ms, parse 477 ms, sort 85 ms, write 996 ms, index 304 ms: 4 candidates, 47515 repo-hours, 157 releases; waiting 509 ms; commit 649 ms)
2026-11-07T03:42:44Z [load_day 2026-10-04] 2026-10-04 hour 14: 79902 events in 2 files, snapshot 1248697713625926915 (task 2851 ms: download 1310 ms overlapping gunzip 146 ms, parse 462 ms, sort 49 ms, write 1053 ms, index 310 ms: 9 candidates, 48970 repo-hours, 148 releases; waiting 568 ms; commit 650 ms)
2026-11-07T03:42:44Z [load_day 2026-10-04] 2026-10-04 hour 15: 77589 events in 2 files, snapshot 9189629061428662089 (task 2823 ms: download 1364 ms overlapping gunzip 135 ms, parse 434 ms, sort 47 ms, write 1020 ms, index 321 ms: 13 candidates, 48092 repo-hours, 151 releases; waiting 582 ms; commit 623 ms)
2026-11-07T03:42:48Z [load_day 2026-10-04] 2026-10-04 hour 16: 81633 events in 2 files, snapshot 4492679451598518762 (task 3270 ms: download 1060 ms overlapping gunzip 147 ms, parse 513 ms, sort 70 ms, write 1068 ms, index 318 ms: 9 candidates, 52948 repo-hours, 123 releases; waiting 539 ms; commit 707 ms)
2026-11-07T03:42:48Z [load_day 2026-10-04] 2026-10-04 hour 17: 77110 events in 2 files, snapshot 6047189411204253276 (task 2826 ms: download 1188 ms overlapping gunzip 137 ms, parse 443 ms, sort 49 ms, write 1002 ms, index 293 ms: 10 candidates, 48063 repo-hours, 137 releases; waiting 601 ms; commit 631 ms)
2026-11-07T03:42:51Z [load_day 2026-10-04] 2026-10-04 hour 18: 77367 events in 2 files, snapshot 3056886868567808171 (task 2867 ms: download 1158 ms overlapping gunzip 143 ms, parse 463 ms, sort 48 ms, write 1127 ms, index 287 ms: 9 candidates, 47340 repo-hours, 141 releases; waiting 543 ms; commit 869 ms)
2026-11-07T03:42:52Z [load_day 2026-10-04] 2026-10-04 hour 19: 72699 events in 2 files, snapshot 3212962404192871522 (task 2799 ms: download 1151 ms overlapping gunzip 134 ms, parse 432 ms, sort 44 ms, write 1026 ms, index 294 ms: 5 candidates, 44106 repo-hours, 141 releases; waiting 556 ms; commit 567 ms)
2026-11-07T03:42:54Z [load_day 2026-10-04] 2026-10-04 hour 20: 72990 events in 2 files, snapshot 8754736065121926634 (task 2750 ms: download 952 ms overlapping gunzip 143 ms, parse 461 ms, sort 54 ms, write 1003 ms, index 335 ms: 5 candidates, 43955 repo-hours, 129 releases; waiting 529 ms; commit 671 ms)
2026-11-07T03:42:55Z [load_day 2026-10-04] 2026-10-04 hour 21: 69613 events in 2 files, snapshot 1405573579566863182 (task 2820 ms: download 1016 ms overlapping gunzip 152 ms, parse 468 ms, sort 43 ms, write 969 ms, index 276 ms: 10 candidates, 40046 repo-hours, 134 releases; waiting 531 ms; commit 622 ms)
2026-11-07T03:42:58Z [load_day 2026-10-04] 2026-10-04 hour 22: 70526 events in 2 files, snapshot 8269659193712205922 (task 2753 ms: download 1015 ms overlapping gunzip 146 ms, parse 449 ms, sort 47 ms, write 993 ms, index 297 ms: 8 candidates, 39831 repo-hours, 147 releases; waiting 545 ms; commit 852 ms)
2026-11-07T03:42:59Z [load_day 2026-10-04] 2026-10-04 hour 23: 67103 events in 2 files, snapshot 7814385547347964127 (task 2954 ms: download 1192 ms overlapping gunzip 146 ms, parse 458 ms, sort 46 ms, write 986 ms, index 260 ms: 3 candidates, 37309 repo-hours, 216 releases; waiting 646 ms; commit 749 ms)
2026-11-07T03:43:04Z [load_day 2026-10-04] 2026-10-04: repo_hour merged from 24 files to 1 (1078804 rows, 4743 ms)
2026-11-07T03:43:05Z [load_day 2026-10-04] 2026-10-04: index committed in 6379 ms (24 + 1 + 24 files)
2026-11-07T03:43:05Z [load_day 2026-10-04] 2026-10-04: 1807842 events in 24 hours
2026-11-07T03:43:05Z [load_day 2026-10-04] attempt 1 succeeded