orcaLog in

Runs · run 408

load_day 2026-07-05, attempt 1 succeeded

Host
4e84322b8c45:81825
Started
2026-11-07T05:18:07Z
Ended
2026-11-07T05:19:17Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/408/load_day/2026-07-05/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:18:07Z [load_day 2026-07-05] attempt 1 started
2026-11-07T05:18:16Z [load_day 2026-07-05] 2026-07-05 hour 0: 156883 events in 4 files, snapshot 6807522720702678915 (task 5401 ms: download 1874 ms overlapping gunzip 332 ms, parse 1106 ms, sort 146 ms, write 2616 ms, index 383 ms: 4 candidates, 60300 repo-hours, 577 releases; waiting 492 ms; commit 859 ms)
2026-11-07T05:18:17Z [load_day 2026-07-05] 2026-07-05 hour 1: 156683 events in 4 files, snapshot 4370574732695393943 (task 5431 ms: download 2202 ms overlapping gunzip 314 ms, parse 1085 ms, sort 163 ms, write 2555 ms, index 416 ms: 7 candidates, 66630 repo-hours, 513 releases; waiting 543 ms; commit 952 ms)
2026-11-07T05:18:21Z [load_day 2026-07-05] 2026-07-05 hour 2: 164243 events in 4 files, snapshot 3097562411252906894 (task 4393 ms: download 1717 ms overlapping gunzip 241 ms, parse 879 ms, sort 107 ms, write 1865 ms, index 483 ms: 5 candidates, 78861 repo-hours, 161 releases; waiting 523 ms; commit 1145 ms)
2026-11-07T05:18:22Z [load_day 2026-07-05] 2026-07-05 hour 3: 164391 events in 4 files, snapshot 1271449032079833779 (task 4342 ms: download 1655 ms overlapping gunzip 250 ms, parse 887 ms, sort 113 ms, write 1758 ms, index 461 ms: 4 candidates, 73812 repo-hours, 254 releases; waiting 565 ms; commit 1095 ms)
2026-11-07T05:18:27Z [load_day 2026-07-05] 2026-07-05 hour 4: 164147 events in 4 files, snapshot 3548950053220743645 (task 4020 ms: download 1378 ms overlapping gunzip 225 ms, parse 844 ms, sort 107 ms, write 1592 ms, index 409 ms: 4 candidates, 61776 repo-hours, 130 releases; waiting 537 ms; commit 2386 ms)
2026-11-07T05:18:28Z [load_day 2026-07-05] 2026-07-05 hour 5: 172871 events in 4 files, snapshot 2052424270217890521 (task 3826 ms: download 1642 ms overlapping gunzip 243 ms, parse 865 ms, sort 112 ms, write 1502 ms, index 383 ms: 7 candidates, 57594 repo-hours, 80 releases; waiting 325 ms; commit 1139 ms)
2026-11-07T05:18:30Z [load_day 2026-07-05] 2026-07-05 hour 6: 164658 events in 4 files, snapshot 7557444086307401334 (task 3751 ms: download 1349 ms overlapping gunzip 208 ms, parse 771 ms, sort 104 ms, write 1415 ms, index 419 ms: 2 candidates, 58879 repo-hours, 92 releases; waiting 531 ms; commit 1209 ms)
2026-11-07T05:18:32Z [load_day 2026-07-05] 2026-07-05 hour 7: 166490 events in 4 files, snapshot 8433363021054357665 (task 3710 ms: download 1635 ms overlapping gunzip 202 ms, parse 748 ms, sort 107 ms, write 1373 ms, index 421 ms: 4 candidates, 60585 repo-hours, 33 releases; waiting 524 ms; commit 1101 ms)
2026-11-07T05:18:34Z [load_day 2026-07-05] 2026-07-05 hour 8: 167347 events in 4 files, snapshot 1150198298995012380 (task 3845 ms: download 1707 ms overlapping gunzip 196 ms, parse 752 ms, sort 102 ms, write 1477 ms, index 440 ms: 1 candidates, 65561 repo-hours, 25 releases; waiting 474 ms; commit 1076 ms)
2026-11-07T05:18:36Z [load_day 2026-07-05] 2026-07-05 hour 9: 164877 events in 4 files, snapshot 5119189735390784893 (task 3735 ms: download 1252 ms overlapping gunzip 199 ms, parse 745 ms, sort 99 ms, write 1422 ms, index 437 ms: 7 candidates, 63977 repo-hours, 21 releases; waiting 516 ms; commit 1052 ms)
2026-11-07T05:18:39Z [load_day 2026-07-05] 2026-07-05 hour 10: 170163 events in 4 files, snapshot 3930135109985590925 (task 4017 ms: download 1268 ms overlapping gunzip 209 ms, parse 792 ms, sort 119 ms, write 1498 ms, index 468 ms: 9 candidates, 68575 repo-hours, 37 releases; waiting 655 ms; commit 971 ms)
2026-11-07T05:18:41Z [load_day 2026-07-05] 2026-07-05 hour 11: 165219 events in 4 files, snapshot 8053394730011327770 (task 3915 ms: download 1605 ms overlapping gunzip 206 ms, parse 791 ms, sort 105 ms, write 1457 ms, index 516 ms: 5 candidates, 69096 repo-hours, 41 releases; waiting 538 ms; commit 981 ms)
2026-11-07T05:18:44Z [load_day 2026-07-05] 2026-07-05 hour 12: 166628 events in 4 files, snapshot 736622172754522667 (task 3884 ms: download 1296 ms overlapping gunzip 205 ms, parse 778 ms, sort 100 ms, write 1485 ms, index 495 ms: 4 candidates, 74038 repo-hours, 48 releases; waiting 516 ms; commit 1085 ms)
2026-11-07T05:18:46Z [load_day 2026-07-05] 2026-07-05 hour 13: 169865 events in 4 files, snapshot 8741217530900519544 (task 4156 ms: download 1716 ms overlapping gunzip 210 ms, parse 795 ms, sort 120 ms, write 1575 ms, index 640 ms: 5 candidates, 89420 repo-hours, 25 releases; waiting 522 ms; commit 1001 ms)
2026-11-07T05:18:48Z [load_day 2026-07-05] 2026-07-05 hour 14: 169075 events in 4 files, snapshot 7744580293179244956 (task 3992 ms: download 1575 ms overlapping gunzip 205 ms, parse 777 ms, sort 105 ms, write 1577 ms, index 485 ms: 8 candidates, 73361 repo-hours, 30 releases; waiting 523 ms; commit 995 ms)
2026-11-07T05:18:50Z [load_day 2026-07-05] 2026-07-05 hour 15: 166062 events in 4 files, snapshot 1389225893319179044 (task 3804 ms: download 1878 ms overlapping gunzip 206 ms, parse 745 ms, sort 102 ms, write 1451 ms, index 497 ms: 6 candidates, 71902 repo-hours, 20 releases; waiting 526 ms; commit 1017 ms)
2026-11-07T05:18:53Z [load_day 2026-07-05] 2026-07-05 hour 16: 167969 events in 4 files, snapshot 6985589093753560404 (task 3916 ms: download 1480 ms overlapping gunzip 206 ms, parse 760 ms, sort 105 ms, write 1483 ms, index 515 ms: 9 candidates, 67021 repo-hours, 28 releases; waiting 534 ms; commit 1107 ms)
2026-11-07T05:18:55Z [load_day 2026-07-05] 2026-07-05 hour 17: 167665 events in 4 files, snapshot 6344787473868803559 (task 4167 ms: download 1548 ms overlapping gunzip 220 ms, parse 827 ms, sort 113 ms, write 1492 ms, index 483 ms: 8 candidates, 69072 repo-hours, 33 releases; waiting 519 ms; commit 1151 ms)
2026-11-07T05:18:57Z [load_day 2026-07-05] 2026-07-05 hour 18: 167246 events in 4 files, snapshot 5673530633079684041 (task 3849 ms: download 1392 ms overlapping gunzip 210 ms, parse 785 ms, sort 109 ms, write 1481 ms, index 454 ms: 5 candidates, 67292 repo-hours, 22 releases; waiting 517 ms; commit 881 ms)
2026-11-07T05:18:59Z [load_day 2026-07-05] 2026-07-05 hour 19: 171372 events in 4 files, snapshot 8826954977631660540 (task 4037 ms: download 1627 ms overlapping gunzip 214 ms, parse 804 ms, sort 110 ms, write 1545 ms, index 496 ms: 6 candidates, 70080 repo-hours, 24 releases; waiting 530 ms; commit 889 ms)
2026-11-07T05:19:02Z [load_day 2026-07-05] 2026-07-05 hour 20: 170350 events in 4 files, snapshot 4014686983709149879 (task 3992 ms: download 1412 ms overlapping gunzip 208 ms, parse 785 ms, sort 104 ms, write 1581 ms, index 480 ms: 6 candidates, 62997 repo-hours, 30 releases; waiting 522 ms; commit 1058 ms)
2026-11-07T05:19:04Z [load_day 2026-07-05] 2026-07-05 hour 21: 168943 events in 4 files, snapshot 7464066132599813833 (task 4065 ms: download 1640 ms overlapping gunzip 213 ms, parse 780 ms, sort 108 ms, write 1500 ms, index 405 ms: 10 candidates, 62815 repo-hours, 29 releases; waiting 795 ms; commit 1163 ms)
2026-11-07T05:19:07Z [load_day 2026-07-05] 2026-07-05 hour 22: 168140 events in 4 files, snapshot 5972285615038675030 (task 3941 ms: download 1285 ms overlapping gunzip 216 ms, parse 800 ms, sort 114 ms, write 1546 ms, index 441 ms: 11 candidates, 60283 repo-hours, 40 releases; waiting 522 ms; commit 1070 ms)
2026-11-07T05:19:09Z [load_day 2026-07-05] 2026-07-05 hour 23: 167604 events in 4 files, snapshot 73960801921915890 (task 3754 ms: download 1374 ms overlapping gunzip 216 ms, parse 784 ms, sort 112 ms, write 1441 ms, index 377 ms: 10 candidates, 59937 repo-hours, 84 releases; waiting 530 ms; commit 910 ms)
2026-11-07T05:19:15Z [load_day 2026-07-05] 2026-07-05: repo_hour merged from 24 files to 1 (1613864 rows, 6780 ms)
2026-11-07T05:19:17Z [load_day 2026-07-05] 2026-07-05: index committed in 8497 ms (24 + 1 + 24 files)
2026-11-07T05:19:17Z [load_day 2026-07-05] 2026-07-05: 3998891 events in 24 hours
2026-11-07T05:19:17Z [load_day 2026-07-05] attempt 1 succeeded