orcaLog in

Runs · run 356

load_day 2026-07-22, attempt 1 succeeded

Host
4e84322b8c45:67275
Started
2026-11-07T04:59:18Z
Ended
2026-11-07T05:00:30Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/356/load_day/2026-07-22/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:59:18Z [load_day 2026-07-22] attempt 1 started
2026-11-07T04:59:25Z [load_day 2026-07-22] 2026-07-22 hour 0: 149589 events in 3 files, snapshot 3645438328888664654 (task 3568 ms: download 1589 ms overlapping gunzip 175 ms, parse 706 ms, sort 101 ms, write 1430 ms, index 330 ms: 2 candidates, 49922 repo-hours, 13 releases; waiting 497 ms; commit 2126 ms)
2026-11-07T04:59:28Z [load_day 2026-07-22] 2026-07-22 hour 1: 160180 events in 4 files, snapshot 4975773732617807030 (task 4701 ms: download 1531 ms overlapping gunzip 186 ms, parse 749 ms, sort 107 ms, write 1441 ms, index 1369 ms: 4 candidates, 62293 repo-hours, 10 releases; waiting 507 ms; commit 2147 ms)
2026-11-07T04:59:30Z [load_day 2026-07-22] 2026-07-22 hour 2: 167392 events in 4 files, snapshot 7837177419456520698 (task 3946 ms: download 1205 ms overlapping gunzip 195 ms, parse 759 ms, sort 112 ms, write 1765 ms, index 328 ms: 4 candidates, 51327 repo-hours, 8 releases; waiting 520 ms; commit 960 ms)
2026-11-07T04:59:31Z [load_day 2026-07-22] 2026-07-22 hour 3: 167688 events in 4 files, snapshot 2344256882004801919 (task 3385 ms: download 1228 ms overlapping gunzip 185 ms, parse 736 ms, sort 102 ms, write 1402 ms, index 202 ms: 3 candidates, 30731 repo-hours, 8 releases; waiting 525 ms; commit 767 ms)
2026-11-07T04:59:34Z [load_day 2026-07-22] 2026-07-22 hour 4: 166458 events in 4 files, snapshot 3448889805886678281 (task 3607 ms: download 1512 ms overlapping gunzip 190 ms, parse 747 ms, sort 106 ms, write 1539 ms, index 205 ms: 8 candidates, 28288 repo-hours, 26 releases; waiting 546 ms; commit 948 ms)
2026-11-07T04:59:36Z [load_day 2026-07-22] 2026-07-22 hour 5: 165892 events in 4 files, snapshot 3822696094500065606 (task 3525 ms: download 1259 ms overlapping gunzip 195 ms, parse 770 ms, sort 109 ms, write 1471 ms, index 185 ms: 2 candidates, 27866 repo-hours, 20 releases; waiting 513 ms; commit 891 ms)
2026-11-07T04:59:38Z [load_day 2026-07-22] 2026-07-22 hour 6: 165671 events in 4 files, snapshot 813466624057003528 (task 3660 ms: download 1439 ms overlapping gunzip 220 ms, parse 803 ms, sort 113 ms, write 1446 ms, index 202 ms: 3 candidates, 29433 repo-hours, 18 releases; waiting 521 ms; commit 749 ms)
2026-11-07T04:59:40Z [load_day 2026-07-22] 2026-07-22 hour 7: 166083 events in 4 files, snapshot 4102455347384960008 (task 3500 ms: download 1269 ms overlapping gunzip 193 ms, parse 745 ms, sort 96 ms, write 1433 ms, index 198 ms: 2 candidates, 28722 repo-hours, 5 releases; waiting 527 ms; commit 740 ms)
2026-11-07T04:59:43Z [load_day 2026-07-22] 2026-07-22 hour 8: 166982 events in 4 files, snapshot 4167637508820615082 (task 3634 ms: download 1343 ms overlapping gunzip 212 ms, parse 757 ms, sort 101 ms, write 1500 ms, index 197 ms: 0 candidates, 30783 repo-hours, 16 releases; waiting 533 ms; commit 933 ms)
2026-11-07T04:59:44Z [load_day 2026-07-22] 2026-07-22 hour 9: 167366 events in 4 files, snapshot 5575277331970386366 (task 3462 ms: download 1118 ms overlapping gunzip 189 ms, parse 738 ms, sort 99 ms, write 1549 ms, index 216 ms: 1 candidates, 32455 repo-hours, 30 releases; waiting 303 ms; commit 854 ms)
2026-11-07T04:59:47Z [load_day 2026-07-22] 2026-07-22 hour 10: 165083 events in 4 files, snapshot 7079752443267166100 (task 3765 ms: download 1419 ms overlapping gunzip 202 ms, parse 779 ms, sort 107 ms, write 1531 ms, index 272 ms: 5 candidates, 38224 repo-hours, 24 releases; waiting 529 ms; commit 907 ms)
2026-11-07T04:59:48Z [load_day 2026-07-22] 2026-07-22 hour 11: 164187 events in 4 files, snapshot 3648134815782601837 (task 3571 ms: download 1335 ms overlapping gunzip 184 ms, parse 729 ms, sort 104 ms, write 1480 ms, index 261 ms: 3 candidates, 39787 repo-hours, 8 releases; waiting 522 ms; commit 802 ms)
2026-11-07T04:59:51Z [load_day 2026-07-22] 2026-07-22 hour 12: 173986 events in 4 files, snapshot 3262594470185690417 (task 3733 ms: download 1295 ms overlapping gunzip 200 ms, parse 768 ms, sort 105 ms, write 1671 ms, index 247 ms: 3 candidates, 35458 repo-hours, 12 releases; waiting 523 ms; commit 815 ms)
2026-11-07T04:59:53Z [load_day 2026-07-22] 2026-07-22 hour 13: 165788 events in 4 files, snapshot 2088495859368752554 (task 3570 ms: download 1395 ms overlapping gunzip 198 ms, parse 756 ms, sort 103 ms, write 1461 ms, index 251 ms: 2 candidates, 36742 repo-hours, 6 releases; waiting 515 ms; commit 936 ms)
2026-11-07T05:00:04Z [load_day 2026-07-22] 2026-07-22 hour 14: 165773 events in 4 files, snapshot 7214131204333021309 (task 3635 ms: download 1458 ms overlapping gunzip 199 ms, parse 765 ms, sort 99 ms, write 1490 ms, index 272 ms: 6 candidates, 39663 repo-hours, 18 releases; waiting 533 ms; commit 9799 ms)
2026-11-07T05:00:05Z [load_day 2026-07-22] 2026-07-22 hour 15: 162867 events in 4 files, snapshot 324072575519185547 (task 4452 ms: download 1381 ms overlapping gunzip 207 ms, parse 758 ms, sort 110 ms, write 1617 ms, index 929 ms: 3 candidates, 42454 repo-hours, 32 releases; waiting 509 ms; commit 1050 ms)
2026-11-07T05:00:08Z [load_day 2026-07-22] 2026-07-22 hour 16: 155680 events in 4 files, snapshot 2708403678716018285 (task 4807 ms: download 1481 ms overlapping gunzip 197 ms, parse 755 ms, sort 124 ms, write 2527 ms, index 371 ms: 3 candidates, 51921 repo-hours, 50 releases; waiting 522 ms; commit 2352 ms)
2026-11-07T05:00:10Z [load_day 2026-07-22] 2026-07-22 hour 17: 160219 events in 4 files, snapshot 1819672323678970220 (task 4183 ms: download 1553 ms overlapping gunzip 224 ms, parse 821 ms, sort 116 ms, write 1749 ms, index 398 ms: 5 candidates, 56232 repo-hours, 58 releases; waiting 527 ms; commit 843 ms)
2026-11-07T05:00:11Z [load_day 2026-07-22] 2026-07-22 hour 18: 160369 events in 4 files, snapshot 5441510317115489310 (task 3931 ms: download 1542 ms overlapping gunzip 193 ms, parse 743 ms, sort 111 ms, write 1596 ms, index 392 ms: 9 candidates, 58224 repo-hours, 24 releases; waiting 530 ms; commit 813 ms)
2026-11-07T05:00:15Z [load_day 2026-07-22] 2026-07-22 hour 19: 164671 events in 4 files, snapshot 5867194859507396910 (task 3991 ms: download 1353 ms overlapping gunzip 203 ms, parse 741 ms, sort 99 ms, write 1580 ms, index 515 ms: 2 candidates, 64703 repo-hours, 23 releases; waiting 538 ms; commit 788 ms)
2026-11-07T05:00:15Z [load_day 2026-07-22] 2026-07-22 hour 20: 157356 events in 4 files, snapshot 1930211355046153520 (task 3780 ms: download 1311 ms overlapping gunzip 197 ms, parse 734 ms, sort 113 ms, write 1443 ms, index 402 ms: 2 candidates, 59309 repo-hours, 25 releases; waiting 527 ms; commit 874 ms)
2026-11-07T05:00:19Z [load_day 2026-07-22] 2026-07-22 hour 21: 163760 events in 4 files, snapshot 8788467623686603551 (task 4297 ms: download 1483 ms overlapping gunzip 209 ms, parse 786 ms, sort 119 ms, write 1557 ms, index 379 ms: 7 candidates, 56875 repo-hours, 20 releases; waiting 532 ms; commit 665 ms)
2026-11-07T05:00:20Z [load_day 2026-07-22] 2026-07-22 hour 22: 157856 events in 4 files, snapshot 8812127445320806540 (task 3565 ms: download 1179 ms overlapping gunzip 208 ms, parse 745 ms, sort 104 ms, write 1316 ms, index 345 ms: 4 candidates, 54909 repo-hours, 27 releases; waiting 533 ms; commit 729 ms)
2026-11-07T05:00:24Z [load_day 2026-07-22] 2026-07-22 hour 23: 166658 events in 4 files, snapshot 3647052012510422678 (task 3633 ms: download 1406 ms overlapping gunzip 206 ms, parse 790 ms, sort 105 ms, write 1354 ms, index 338 ms: 2 candidates, 54141 repo-hours, 28 releases; waiting 517 ms; commit 968 ms)
2026-11-07T05:00:29Z [load_day 2026-07-22] 2026-07-22: repo_hour merged from 24 files to 1 (1060462 rows, 4792 ms)
2026-11-07T05:00:30Z [load_day 2026-07-22] 2026-07-22: index committed in 6409 ms (23 + 1 + 24 files)
2026-11-07T05:00:30Z [load_day 2026-07-22] 2026-07-22: 3927554 events in 24 hours
2026-11-07T05:00:30Z [load_day 2026-07-22] attempt 1 succeeded