orcaLog in

Runs · run 675

load_day 2026-04-07, attempt 1 succeeded

Host
4e84322b8c45:166018
Started
2026-11-07T13:05:07Z
Ended
2026-11-07T13:06:41Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/675/load_day/2026-04-07/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T13:05:07Z [load_day 2026-04-07] attempt 1 started
2026-11-07T13:05:18Z [load_day 2026-04-07] 2026-04-07 hour 0: 144085 events in 3 files, snapshot 2960273996527224930 (task 5392 ms: download 2130 ms overlapping gunzip 357 ms, parse 1270 ms, sort 255 ms, write 2176 ms, index 477 ms: 13 candidates, 69492 repo-hours, 717 releases; waiting 519 ms; commit 2903 ms)
2026-11-07T13:05:19Z [load_day 2026-04-07] 2026-04-07 hour 1: 146126 events in 3 files, snapshot 6345799368925782014 (task 5053 ms: download 1585 ms overlapping gunzip 307 ms, parse 1073 ms, sort 143 ms, write 2430 ms, index 533 ms: 7 candidates, 83999 repo-hours, 593 releases; waiting 218 ms; commit 1365 ms)
2026-11-07T13:05:25Z [load_day 2026-04-07] 2026-04-07 hour 2: 151293 events in 4 files, snapshot 1467770243919090378 (task 5569 ms: download 1600 ms overlapping gunzip 325 ms, parse 1092 ms, sort 134 ms, write 2684 ms, index 517 ms: 7 candidates, 81985 repo-hours, 659 releases; waiting 589 ms; commit 1420 ms)
2026-11-07T13:05:26Z [load_day 2026-04-07] 2026-04-07 hour 3: 148999 events in 3 files, snapshot 8199005620496776684 (task 5615 ms: download 2009 ms overlapping gunzip 373 ms, parse 1265 ms, sort 152 ms, write 2565 ms, index 486 ms: 6 candidates, 74309 repo-hours, 665 releases; waiting 535 ms; commit 1375 ms)
2026-11-07T13:05:31Z [load_day 2026-04-07] 2026-04-07 hour 4: 146003 events in 3 files, snapshot 6955824414000765153 (task 6158 ms: download 2102 ms overlapping gunzip 388 ms, parse 1375 ms, sort 156 ms, write 2790 ms, index 492 ms: 8 candidates, 71782 repo-hours, 623 releases; waiting 623 ms; commit 1501 ms)
2026-11-07T13:05:33Z [load_day 2026-04-07] 2026-04-07 hour 5: 147885 events in 3 files, snapshot 5236632640207348414 (task 6389 ms: download 2308 ms overlapping gunzip 405 ms, parse 1353 ms, sort 150 ms, write 3107 ms, index 491 ms: 6 candidates, 74535 repo-hours, 680 releases; waiting 578 ms; commit 1254 ms)
2026-11-07T13:05:38Z [load_day 2026-04-07] 2026-04-07 hour 6: 151406 events in 4 files, snapshot 1482033684694722037 (task 6137 ms: download 2485 ms overlapping gunzip 394 ms, parse 1227 ms, sort 160 ms, write 2683 ms, index 542 ms: 4 candidates, 80630 repo-hours, 661 releases; waiting 802 ms; commit 1302 ms)
2026-11-07T13:05:40Z [load_day 2026-04-07] 2026-04-07 hour 7: 152676 events in 4 files, snapshot 9037950927293044346 (task 5912 ms: download 1788 ms overlapping gunzip 372 ms, parse 1227 ms, sort 154 ms, write 2559 ms, index 588 ms: 7 candidates, 86790 repo-hours, 566 releases; waiting 566 ms; commit 1233 ms)
2026-11-07T13:05:44Z [load_day 2026-04-07] 2026-04-07 hour 8: 146724 events in 3 files, snapshot 5632353287265223101 (task 5615 ms: download 2041 ms overlapping gunzip 353 ms, parse 1118 ms, sort 165 ms, write 2423 ms, index 569 ms: 14 candidates, 82230 repo-hours, 525 releases; waiting 582 ms; commit 1257 ms)
2026-11-07T13:05:46Z [load_day 2026-04-07] 2026-04-07 hour 9: 151916 events in 4 files, snapshot 5112034097470585102 (task 5449 ms: download 1925 ms overlapping gunzip 325 ms, parse 1063 ms, sort 135 ms, write 2417 ms, index 600 ms: 7 candidates, 85857 repo-hours, 468 releases; waiting 573 ms; commit 1442 ms)
2026-11-07T13:05:51Z [load_day 2026-04-07] 2026-04-07 hour 10: 149590 events in 3 files, snapshot 7791605670899201413 (task 5948 ms: download 1770 ms overlapping gunzip 344 ms, parse 1143 ms, sort 134 ms, write 2910 ms, index 550 ms: 9 candidates, 83188 repo-hours, 597 releases; waiting 527 ms; commit 1372 ms)
2026-11-07T13:05:53Z [load_day 2026-04-07] 2026-04-07 hour 11: 147220 events in 3 files, snapshot 2319409937002333957 (task 5963 ms: download 2009 ms overlapping gunzip 375 ms, parse 1195 ms, sort 125 ms, write 2861 ms, index 547 ms: 7 candidates, 80851 repo-hours, 516 releases; waiting 541 ms; commit 1362 ms)
2026-11-07T13:05:57Z [load_day 2026-04-07] 2026-04-07 hour 12: 151881 events in 4 files, snapshot 9048633868698787049 (task 5235 ms: download 1814 ms overlapping gunzip 308 ms, parse 1046 ms, sort 122 ms, write 2316 ms, index 566 ms: 13 candidates, 87970 repo-hours, 448 releases; waiting 596 ms; commit 1460 ms)
2026-11-07T13:05:59Z [load_day 2026-04-07] 2026-04-07 hour 13: 149174 events in 3 files, snapshot 4901535367188560066 (task 4507 ms: download 1412 ms overlapping gunzip 244 ms, parse 837 ms, sort 105 ms, write 2029 ms, index 616 ms: 15 candidates, 94385 repo-hours, 210 releases; waiting 406 ms; commit 1303 ms)
2026-11-07T13:06:03Z [load_day 2026-04-07] 2026-04-07 hour 14: 144401 events in 3 files, snapshot 6614755037954833679 (task 5025 ms: download 1684 ms overlapping gunzip 301 ms, parse 995 ms, sort 132 ms, write 2165 ms, index 597 ms: 15 candidates, 84871 repo-hours, 325 releases; waiting 547 ms; commit 1295 ms)
2026-11-07T13:06:04Z [load_day 2026-04-07] 2026-04-07 hour 15: 145263 events in 3 files, snapshot 9044866172092797738 (task 4976 ms: download 1672 ms overlapping gunzip 310 ms, parse 1040 ms, sort 128 ms, write 2042 ms, index 582 ms: 7 candidates, 83645 repo-hours, 357 releases; waiting 597 ms; commit 1318 ms)
2026-11-07T13:06:09Z [load_day 2026-04-07] 2026-04-07 hour 16: 150925 events in 4 files, snapshot 9161601893130177200 (task 5284 ms: download 1789 ms overlapping gunzip 334 ms, parse 1094 ms, sort 160 ms, write 2288 ms, index 580 ms: 12 candidates, 86133 repo-hours, 412 releases; waiting 541 ms; commit 1303 ms)
2026-11-07T13:06:10Z [load_day 2026-04-07] 2026-04-07 hour 17: 154233 events in 4 files, snapshot 1216852104997865479 (task 5197 ms: download 1877 ms overlapping gunzip 328 ms, parse 1085 ms, sort 188 ms, write 2180 ms, index 570 ms: 7 candidates, 84470 repo-hours, 388 releases; waiting 533 ms; commit 1272 ms)
2026-11-07T13:06:16Z [load_day 2026-04-07] 2026-04-07 hour 18: 149718 events in 3 files, snapshot 8672881951544812137 (task 5977 ms: download 2652 ms overlapping gunzip 440 ms, parse 1283 ms, sort 118 ms, write 2214 ms, index 566 ms: 7 candidates, 81114 repo-hours, 439 releases; waiting 972 ms; commit 1209 ms)
2026-11-07T13:06:17Z [load_day 2026-04-07] 2026-04-07 hour 19: 150947 events in 4 files, snapshot 4770391431584353530 (task 5568 ms: download 2047 ms overlapping gunzip 392 ms, parse 1226 ms, sort 171 ms, write 2259 ms, index 558 ms: 7 candidates, 81630 repo-hours, 495 releases; waiting 636 ms; commit 1344 ms)
2026-11-07T13:06:22Z [load_day 2026-04-07] 2026-04-07 hour 20: 152795 events in 4 files, snapshot 1214570822833756926 (task 5881 ms: download 1879 ms overlapping gunzip 366 ms, parse 1172 ms, sort 167 ms, write 2780 ms, index 546 ms: 13 candidates, 81850 repo-hours, 568 releases; waiting 551 ms; commit 1347 ms)
2026-11-07T13:06:24Z [load_day 2026-04-07] 2026-04-07 hour 21: 153043 events in 4 files, snapshot 1119462091346043241 (task 6051 ms: download 2098 ms overlapping gunzip 374 ms, parse 1220 ms, sort 144 ms, write 2940 ms, index 535 ms: 11 candidates, 78943 repo-hours, 607 releases; waiting 550 ms; commit 1268 ms)
2026-11-07T13:06:29Z [load_day 2026-04-07] 2026-04-07 hour 22: 148801 events in 3 files, snapshot 5228204414120110360 (task 5417 ms: download 1501 ms overlapping gunzip 374 ms, parse 1224 ms, sort 178 ms, write 2638 ms, index 518 ms: 7 candidates, 74336 repo-hours, 708 releases; waiting 201 ms; commit 1346 ms)
2026-11-07T13:06:30Z [load_day 2026-04-07] 2026-04-07 hour 23: 152940 events in 4 files, snapshot 7416453773890789121 (task 5982 ms: download 1986 ms overlapping gunzip 440 ms, parse 1469 ms, sort 212 ms, write 2523 ms, index 483 ms: 7 candidates, 72425 repo-hours, 862 releases; waiting 547 ms; commit 1244 ms)
2026-11-07T13:06:39Z [load_day 2026-04-07] 2026-04-07: repo_hour merged from 24 files to 1 (1947420 rows, 8294 ms)
2026-11-07T13:06:41Z [load_day 2026-04-07] 2026-04-07: index committed in 10456 ms (24 + 1 + 24 files)
2026-11-07T13:06:41Z [load_day 2026-04-07] 2026-04-07: 3588044 events in 24 hours
2026-11-07T13:06:41Z [load_day 2026-04-07] attempt 1 succeeded