orcaLog in

Runs · run 614

load_day 2026-04-27, attempt 1 succeeded

Host
4e84322b8c45:138732
Started
2026-11-07T06:56:29Z
Ended
2026-11-07T06:57:54Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/614/load_day/2026-04-27/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:56:29Z [load_day 2026-04-27] attempt 1 started
2026-11-07T06:56:39Z [load_day 2026-04-27] 2026-04-27 hour 0: 149589 events in 3 files, snapshot 2347066911180755463 (task 6481 ms: download 2136 ms overlapping gunzip 375 ms, parse 1317 ms, sort 183 ms, write 3229 ms, index 511 ms: 8 candidates, 68815 repo-hours, 797 releases; waiting 523 ms; commit 1122 ms)
2026-11-07T06:56:40Z [load_day 2026-04-27] 2026-04-27 hour 1: 151669 events in 4 files, snapshot 4934045823900215853 (task 6422 ms: download 2068 ms overlapping gunzip 382 ms, parse 1254 ms, sort 171 ms, write 3220 ms, index 511 ms: 10 candidates, 78510 repo-hours, 589 releases; waiting 507 ms; commit 1313 ms)
2026-11-07T06:56:45Z [load_day 2026-04-27] 2026-04-27 hour 2: 151052 events in 4 files, snapshot 7175746590393010629 (task 5912 ms: download 1855 ms overlapping gunzip 344 ms, parse 1116 ms, sort 166 ms, write 2884 ms, index 566 ms: 7 candidates, 86240 repo-hours, 559 releases; waiting 558 ms; commit 1077 ms)
2026-11-07T06:56:47Z [load_day 2026-04-27] 2026-04-27 hour 3: 145928 events in 3 files, snapshot 7489540126581328637 (task 5741 ms: download 1929 ms overlapping gunzip 334 ms, parse 1084 ms, sort 138 ms, write 2815 ms, index 521 ms: 7 candidates, 79857 repo-hours, 526 releases; waiting 592 ms; commit 1162 ms)
2026-11-07T06:56:52Z [load_day 2026-04-27] 2026-04-27 hour 4: 146131 events in 3 files, snapshot 4703233013520658686 (task 5985 ms: download 2034 ms overlapping gunzip 417 ms, parse 1342 ms, sort 143 ms, write 2758 ms, index 442 ms: 8 candidates, 67297 repo-hours, 707 releases; waiting 530 ms; commit 1301 ms)
2026-11-07T06:56:54Z [load_day 2026-04-27] 2026-04-27 hour 5: 149712 events in 3 files, snapshot 701291625295462124 (task 5200 ms: download 1368 ms overlapping gunzip 408 ms, parse 1316 ms, sort 160 ms, write 2312 ms, index 491 ms: 7 candidates, 75236 repo-hours, 701 releases; waiting 183 ms; commit 1234 ms)
2026-11-07T06:56:59Z [load_day 2026-04-27] 2026-04-27 hour 6: 147211 events in 3 files, snapshot 7999973789387018797 (task 5799 ms: download 1920 ms overlapping gunzip 357 ms, parse 1165 ms, sort 133 ms, write 2810 ms, index 493 ms: 4 candidates, 78004 repo-hours, 574 releases; waiting 536 ms; commit 1249 ms)
2026-11-07T06:57:00Z [load_day 2026-04-27] 2026-04-27 hour 7: 146474 events in 3 files, snapshot 28095391534375295 (task 5805 ms: download 1949 ms overlapping gunzip 351 ms, parse 1123 ms, sort 133 ms, write 2785 ms, index 529 ms: 10 candidates, 78758 repo-hours, 523 releases; waiting 550 ms; commit 1135 ms)
2026-11-07T06:57:05Z [load_day 2026-04-27] 2026-04-27 hour 8: 151118 events in 4 files, snapshot 4981772850812736441 (task 5658 ms: download 1646 ms overlapping gunzip 368 ms, parse 1226 ms, sort 147 ms, write 2472 ms, index 558 ms: 9 candidates, 83501 repo-hours, 418 releases; waiting 537 ms; commit 1164 ms)
2026-11-07T06:57:06Z [load_day 2026-04-27] 2026-04-27 hour 9: 152106 events in 4 files, snapshot 7013044595978526040 (task 4576 ms: download 1206 ms overlapping gunzip 325 ms, parse 1026 ms, sort 146 ms, write 2027 ms, index 565 ms: 15 candidates, 81996 repo-hours, 250 releases; waiting 189 ms; commit 1257 ms)
2026-11-07T06:57:11Z [load_day 2026-04-27] 2026-04-27 hour 10: 152612 events in 4 files, snapshot 5285406790568580487 (task 4646 ms: download 1460 ms overlapping gunzip 254 ms, parse 864 ms, sort 119 ms, write 1956 ms, index 582 ms: 10 candidates, 81308 repo-hours, 148 releases; waiting 530 ms; commit 1335 ms)
2026-11-07T06:57:12Z [load_day 2026-04-27] 2026-04-27 hour 11: 151773 events in 4 files, snapshot 8833388595690723587 (task 4388 ms: download 1482 ms overlapping gunzip 235 ms, parse 810 ms, sort 112 ms, write 1898 ms, index 551 ms: 13 candidates, 82219 repo-hours, 104 releases; waiting 533 ms; commit 1378 ms)
2026-11-07T06:57:15Z [load_day 2026-04-27] 2026-04-27 hour 12: 153942 events in 4 files, snapshot 4424835345553149892 (task 4149 ms: download 1284 ms overlapping gunzip 265 ms, parse 798 ms, sort 109 ms, write 1604 ms, index 569 ms: 11 candidates, 85855 repo-hours, 69 releases; waiting 525 ms; commit 1225 ms)
2026-11-07T06:57:17Z [load_day 2026-04-27] 2026-04-27 hour 13: 156765 events in 4 files, snapshot 3175232713138273080 (task 4123 ms: download 1459 ms overlapping gunzip 236 ms, parse 848 ms, sort 118 ms, write 1509 ms, index 613 ms: 13 candidates, 95256 repo-hours, 54 releases; waiting 537 ms; commit 1274 ms)
2026-11-07T06:57:20Z [load_day 2026-04-27] 2026-04-27 hour 14: 153974 events in 4 files, snapshot 7600214194508994561 (task 4237 ms: download 1440 ms overlapping gunzip 216 ms, parse 785 ms, sort 103 ms, write 1605 ms, index 688 ms: 4 candidates, 89825 repo-hours, 111 releases; waiting 524 ms; commit 1326 ms)
2026-11-07T06:57:22Z [load_day 2026-04-27] 2026-04-27 hour 15: 150385 events in 4 files, snapshot 5176511865510453797 (task 4194 ms: download 1467 ms overlapping gunzip 231 ms, parse 808 ms, sort 106 ms, write 1651 ms, index 591 ms: 9 candidates, 83542 repo-hours, 99 releases; waiting 489 ms; commit 1292 ms)
2026-11-07T06:57:26Z [load_day 2026-04-27] 2026-04-27 hour 16: 154651 events in 4 files, snapshot 3507372497184021372 (task 4568 ms: download 1368 ms overlapping gunzip 255 ms, parse 912 ms, sort 112 ms, write 1814 ms, index 729 ms: 11 candidates, 84902 repo-hours, 104 releases; waiting 535 ms; commit 1371 ms)
2026-11-07T06:57:27Z [load_day 2026-04-27] 2026-04-27 hour 17: 154759 events in 4 files, snapshot 3808926165353870516 (task 4544 ms: download 1460 ms overlapping gunzip 232 ms, parse 899 ms, sort 133 ms, write 1781 ms, index 590 ms: 8 candidates, 85162 repo-hours, 102 releases; waiting 569 ms; commit 1363 ms)
2026-11-07T06:57:31Z [load_day 2026-04-27] 2026-04-27 hour 18: 156174 events in 4 files, snapshot 1484120815063494740 (task 4737 ms: download 1490 ms overlapping gunzip 255 ms, parse 875 ms, sort 109 ms, write 2098 ms, index 584 ms: 9 candidates, 83551 repo-hours, 140 releases; waiting 518 ms; commit 1403 ms)
2026-11-07T06:57:32Z [load_day 2026-04-27] 2026-04-27 hour 19: 155160 events in 4 files, snapshot 4797201668425984460 (task 4845 ms: download 1533 ms overlapping gunzip 306 ms, parse 1059 ms, sort 124 ms, write 1944 ms, index 577 ms: 8 candidates, 84927 repo-hours, 139 releases; waiting 531 ms; commit 1305 ms)
2026-11-07T06:57:37Z [load_day 2026-04-27] 2026-04-27 hour 20: 155277 events in 4 files, snapshot 409595648471417624 (task 5032 ms: download 1605 ms overlapping gunzip 269 ms, parse 942 ms, sort 168 ms, write 2172 ms, index 560 ms: 6 candidates, 79782 repo-hours, 186 releases; waiting 577 ms; commit 1456 ms)
2026-11-07T06:57:38Z [load_day 2026-04-27] 2026-04-27 hour 21: 154401 events in 4 files, snapshot 2468953383011189964 (task 5133 ms: download 1548 ms overlapping gunzip 316 ms, parse 1103 ms, sort 220 ms, write 2163 ms, index 525 ms: 10 candidates, 77967 repo-hours, 277 releases; waiting 523 ms; commit 1373 ms)
2026-11-07T06:57:43Z [load_day 2026-04-27] 2026-04-27 hour 22: 145305 events in 3 files, snapshot 8022285821506908134 (task 5455 ms: download 1589 ms overlapping gunzip 306 ms, parse 1016 ms, sort 115 ms, write 2710 ms, index 513 ms: 6 candidates, 71794 repo-hours, 398 releases; waiting 519 ms; commit 1329 ms)
2026-11-07T06:57:44Z [load_day 2026-04-27] 2026-04-27 hour 23: 147834 events in 3 files, snapshot 96624054112309115 (task 5768 ms: download 1688 ms overlapping gunzip 379 ms, parse 1240 ms, sort 239 ms, write 2587 ms, index 484 ms: 4 candidates, 71908 repo-hours, 577 releases; waiting 520 ms; commit 1063 ms)
2026-11-07T06:57:52Z [load_day 2026-04-27] 2026-04-27: repo_hour merged from 24 files to 1 (1936212 rows, 7855 ms)
2026-11-07T06:57:54Z [load_day 2026-04-27] 2026-04-27: index committed in 9780 ms (24 + 1 + 24 files)
2026-11-07T06:57:54Z [load_day 2026-04-27] 2026-04-27: 3634002 events in 24 hours
2026-11-07T06:57:54Z [load_day 2026-04-27] attempt 1 succeeded