orcaLog in

Runs · run 628

load_day 2026-04-22, attempt 1 succeeded

Host
4e84322b8c45:152847
Started
2026-11-07T12:41:41Z
Ended
2026-11-07T12:43:23Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/628/load_day/2026-04-22/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T12:41:41Z [load_day 2026-04-22] attempt 1 started
2026-11-07T12:41:51Z [load_day 2026-04-22] 2026-04-22 hour 0: 147944 events in 3 files, snapshot 5621643843395181847 (task 7101 ms: download 1545 ms overlapping gunzip 431 ms, parse 1479 ms, sort 164 ms, write 3725 ms, index 661 ms: 6 candidates, 69305 repo-hours, 909 releases; waiting 14 ms; commit 1232 ms)
2026-11-07T12:41:52Z [load_day 2026-04-22] 2026-04-22 hour 1: 149819 events in 3 files, snapshot 3190348039151120679 (task 7236 ms: download 1868 ms overlapping gunzip 515 ms, parse 1721 ms, sort 273 ms, write 3206 ms, index 638 ms: 9 candidates, 82418 repo-hours, 585 releases; waiting 515 ms; commit 1395 ms)
2026-11-07T12:41:59Z [load_day 2026-04-22] 2026-04-22 hour 2: 155641 events in 4 files, snapshot 656485025828995794 (task 7044 ms: download 1963 ms overlapping gunzip 399 ms, parse 1420 ms, sort 406 ms, write 3222 ms, index 735 ms: 9 candidates, 88624 repo-hours, 620 releases; waiting 530 ms; commit 1538 ms)
2026-11-07T12:42:02Z [load_day 2026-04-22] 2026-04-22 hour 3: 151831 events in 4 files, snapshot 1200744741552401763 (task 6688 ms: download 1886 ms overlapping gunzip 384 ms, parse 1253 ms, sort 186 ms, write 3128 ms, index 887 ms: 14 candidates, 76932 repo-hours, 649 releases; waiting 546 ms; commit 2865 ms)
2026-11-07T12:42:07Z [load_day 2026-04-22] 2026-04-22 hour 4: 150417 events in 4 files, snapshot 55378115856072466 (task 7415 ms: download 2352 ms overlapping gunzip 551 ms, parse 1809 ms, sort 134 ms, write 3164 ms, index 911 ms: 5 candidates, 68849 repo-hours, 741 releases; waiting 573 ms; commit 1305 ms)
2026-11-07T12:42:09Z [load_day 2026-04-22] 2026-04-22 hour 5: 152871 events in 4 files, snapshot 7420940074746587077 (task 6992 ms: download 1726 ms overlapping gunzip 620 ms, parse 1934 ms, sort 178 ms, write 3152 ms, index 585 ms: 9 candidates, 76570 repo-hours, 726 releases; waiting 202 ms; commit 2369 ms)
2026-11-07T12:42:15Z [load_day 2026-04-22] 2026-04-22 hour 6: 149442 events in 3 files, snapshot 8457295555121370698 (task 6949 ms: download 1519 ms overlapping gunzip 446 ms, parse 1657 ms, sort 389 ms, write 3097 ms, index 793 ms: 16 candidates, 82173 repo-hours, 460 releases; waiting 251 ms; commit 2110 ms)
2026-11-07T12:42:17Z [load_day 2026-04-22] 2026-04-22 hour 7: 153605 events in 4 files, snapshot 3501499210948515248 (task 6914 ms: download 1934 ms overlapping gunzip 468 ms, parse 1494 ms, sort 231 ms, write 2665 ms, index 1067 ms: 15 candidates, 86701 repo-hours, 297 releases; waiting 646 ms; commit 1324 ms)
2026-11-07T12:42:21Z [load_day 2026-04-22] 2026-04-22 hour 8: 155384 events in 4 files, snapshot 922380508600150080 (task 5783 ms: download 965 ms overlapping gunzip 416 ms, parse 1369 ms, sort 172 ms, write 2482 ms, index 736 ms: 11 candidates, 84623 repo-hours, 211 releases; waiting 241 ms; commit 1537 ms)
2026-11-07T12:42:24Z [load_day 2026-04-22] 2026-04-22 hour 9: 157337 events in 4 files, snapshot 2451635426270149239 (task 5477 ms: download 1726 ms overlapping gunzip 324 ms, parse 1036 ms, sort 153 ms, write 2292 ms, index 895 ms: 10 candidates, 87795 repo-hours, 258 releases; waiting 544 ms; commit 2508 ms)
2026-11-07T12:42:28Z [load_day 2026-04-22] 2026-04-22 hour 10: 154036 events in 4 files, snapshot 8966825061810009057 (task 5748 ms: download 1359 ms overlapping gunzip 390 ms, parse 1585 ms, sort 280 ms, write 2390 ms, index 696 ms: 13 candidates, 83741 repo-hours, 440 releases; waiting 193 ms; commit 1549 ms)
2026-11-07T12:42:31Z [load_day 2026-04-22] 2026-04-22 hour 11: 157791 events in 4 files, snapshot 586117323448455880 (task 6842 ms: download 1878 ms overlapping gunzip 409 ms, parse 1500 ms, sort 162 ms, write 2411 ms, index 1502 ms: 11 candidates, 85458 repo-hours, 356 releases; waiting 556 ms; commit 1406 ms)
2026-11-07T12:42:34Z [load_day 2026-04-22] 2026-04-22 hour 12: 158641 events in 4 files, snapshot 6719982802110812856 (task 6112 ms: download 1962 ms overlapping gunzip 315 ms, parse 1044 ms, sort 146 ms, write 2532 ms, index 1237 ms: 9 candidates, 88486 repo-hours, 129 releases; waiting 526 ms; commit 1265 ms)
2026-11-07T12:42:37Z [load_day 2026-04-22] 2026-04-22 hour 13: 157124 events in 4 files, snapshot 5693127257474780297 (task 5303 ms: download 1578 ms overlapping gunzip 235 ms, parse 897 ms, sort 253 ms, write 2356 ms, index 678 ms: 10 candidates, 95057 repo-hours, 50 releases; waiting 533 ms; commit 1641 ms)
2026-11-07T12:42:41Z [load_day 2026-04-22] 2026-04-22 hour 14: 156181 events in 4 files, snapshot 3876251258917397634 (task 5450 ms: download 1678 ms overlapping gunzip 227 ms, parse 891 ms, sort 139 ms, write 2391 ms, index 899 ms: 16 candidates, 88474 repo-hours, 98 releases; waiting 548 ms; commit 1504 ms)
2026-11-07T12:42:44Z [load_day 2026-04-22] 2026-04-22 hour 15: 159637 events in 4 files, snapshot 5387730613208943310 (task 5328 ms: download 1364 ms overlapping gunzip 324 ms, parse 1220 ms, sort 245 ms, write 2138 ms, index 667 ms: 14 candidates, 89278 repo-hours, 160 releases; waiting 381 ms; commit 2197 ms)
2026-11-07T12:42:52Z [load_day 2026-04-22] 2026-04-22 hour 16: 163038 events in 4 files, snapshot 5076598356221086830 (task 5610 ms: download 1471 ms overlapping gunzip 287 ms, parse 942 ms, sort 118 ms, write 2192 ms, index 1209 ms: 10 candidates, 89556 repo-hours, 117 releases; waiting 548 ms; commit 6029 ms)
2026-11-07T12:42:53Z [load_day 2026-04-22] 2026-04-22 hour 17: 154495 events in 4 files, snapshot 4031610849138096622 (task 5742 ms: download 1492 ms overlapping gunzip 259 ms, parse 976 ms, sort 206 ms, write 2573 ms, index 935 ms: 8 candidates, 84889 repo-hours, 178 releases; waiting 492 ms; commit 1300 ms)
2026-11-07T12:42:57Z [load_day 2026-04-22] 2026-04-22 hour 18: 157528 events in 4 files, snapshot 6228513744228800598 (task 5419 ms: download 1834 ms overlapping gunzip 294 ms, parse 1076 ms, sort 118 ms, write 2334 ms, index 728 ms: 7 candidates, 82737 repo-hours, 227 releases; waiting 495 ms; commit 3199 ms)
2026-11-07T12:43:01Z [load_day 2026-04-22] 2026-04-22 hour 19: 160467 events in 4 files, snapshot 3849446943853868984 (task 6397 ms: download 1691 ms overlapping gunzip 354 ms, parse 1337 ms, sort 248 ms, write 2709 ms, index 991 ms: 11 candidates, 85553 repo-hours, 193 releases; waiting 490 ms; commit 1590 ms)
2026-11-07T12:43:03Z [load_day 2026-04-22] 2026-04-22 hour 20: 157323 events in 4 files, snapshot 5181943589990232299 (task 5713 ms: download 1662 ms overlapping gunzip 343 ms, parse 1221 ms, sort 216 ms, write 2340 ms, index 710 ms: 14 candidates, 81533 repo-hours, 252 releases; waiting 527 ms; commit 2195 ms)
2026-11-07T12:43:07Z [load_day 2026-04-22] 2026-04-22 hour 21: 158530 events in 4 files, snapshot 8847567078869120392 (task 5571 ms: download 1580 ms overlapping gunzip 395 ms, parse 1412 ms, sort 145 ms, write 2127 ms, index 632 ms: 8 candidates, 79901 repo-hours, 467 releases; waiting 537 ms; commit 1774 ms)
2026-11-07T12:43:09Z [load_day 2026-04-22] 2026-04-22 hour 22: 151299 events in 4 files, snapshot 4007692714640489096 (task 5323 ms: download 1838 ms overlapping gunzip 305 ms, parse 1065 ms, sort 179 ms, write 2318 ms, index 499 ms: 13 candidates, 73494 repo-hours, 615 releases; waiting 611 ms; commit 1194 ms)
2026-11-07T12:43:13Z [load_day 2026-04-22] 2026-04-22 hour 23: 150936 events in 4 files, snapshot 3846199284041806248 (task 5144 ms: download 1828 ms overlapping gunzip 300 ms, parse 1059 ms, sort 148 ms, write 2273 ms, index 526 ms: 9 candidates, 72814 repo-hours, 777 releases; waiting 523 ms; commit 1155 ms)
2026-11-07T12:43:21Z [load_day 2026-04-22] 2026-04-22: repo_hour merged from 24 files to 1 (1984961 rows, 8202 ms)
2026-11-07T12:43:23Z [load_day 2026-04-22] 2026-04-22: index committed in 9980 ms (24 + 1 + 24 files)
2026-11-07T12:43:23Z [load_day 2026-04-22] 2026-04-22: 3721317 events in 24 hours
2026-11-07T12:43:23Z [load_day 2026-04-22] attempt 1 succeeded