orcaLog in

Runs · run 642

load_day 2026-04-18, attempt 1 succeeded

Host
4e84322b8c45:156740
Started
2026-11-07T12:47:48Z
Ended
2026-11-07T12:49:20Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/642/load_day/2026-04-18/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T12:47:49Z [load_day 2026-04-18] attempt 1 started
2026-11-07T12:47:58Z [load_day 2026-04-18] 2026-04-18 hour 0: 148297 events in 3 files, snapshot 4189401956686780211 (task 5855 ms: download 1482 ms overlapping gunzip 399 ms, parse 1309 ms, sort 235 ms, write 2935 ms, index 497 ms: 7 candidates, 66040 repo-hours, 853 releases; waiting 160 ms; commit 1110 ms)
2026-11-07T12:47:59Z [load_day 2026-04-18] 2026-04-18 hour 1: 152839 events in 4 files, snapshot 7198745879026662406 (task 6110 ms: download 2915 ms overlapping gunzip 402 ms, parse 1459 ms, sort 181 ms, write 2361 ms, index 548 ms: 10 candidates, 83431 repo-hours, 592 releases; waiting 836 ms; commit 1191 ms)
2026-11-07T12:48:04Z [load_day 2026-04-18] 2026-04-18 hour 2: 146808 events in 3 files, snapshot 2914417853027267024 (task 5225 ms: download 1597 ms overlapping gunzip 316 ms, parse 1065 ms, sort 117 ms, write 2487 ms, index 540 ms: 5 candidates, 81359 repo-hours, 619 releases; waiting 406 ms; commit 1167 ms)
2026-11-07T12:48:05Z [load_day 2026-04-18] 2026-04-18 hour 3: 146645 events in 3 files, snapshot 1684320745335177599 (task 5682 ms: download 2287 ms overlapping gunzip 344 ms, parse 1145 ms, sort 209 ms, write 2541 ms, index 472 ms: 11 candidates, 69935 repo-hours, 777 releases; waiting 594 ms; commit 1210 ms)
2026-11-07T12:48:09Z [load_day 2026-04-18] 2026-04-18 hour 4: 143302 events in 3 files, snapshot 7999553086823245022 (task 4818 ms: download 1906 ms overlapping gunzip 334 ms, parse 1068 ms, sort 129 ms, write 2226 ms, index 445 ms: 5 candidates, 64606 repo-hours, 668 releases; waiting 289 ms; commit 1250 ms)
2026-11-07T12:48:11Z [load_day 2026-04-18] 2026-04-18 hour 5: 148352 events in 3 files, snapshot 2914683610858777129 (task 5711 ms: download 2817 ms overlapping gunzip 417 ms, parse 1341 ms, sort 177 ms, write 2254 ms, index 474 ms: 5 candidates, 68169 repo-hours, 817 releases; waiting 652 ms; commit 1228 ms)
2026-11-07T12:48:16Z [load_day 2026-04-18] 2026-04-18 hour 6: 148503 events in 3 files, snapshot 3881109209842586506 (task 5852 ms: download 2221 ms overlapping gunzip 357 ms, parse 1189 ms, sort 167 ms, write 2586 ms, index 486 ms: 8 candidates, 73104 repo-hours, 885 releases; waiting 715 ms; commit 1503 ms)
2026-11-07T12:48:17Z [load_day 2026-04-18] 2026-04-18 hour 7: 146153 events in 3 files, snapshot 699609659373683825 (task 5424 ms: download 1856 ms overlapping gunzip 348 ms, parse 1199 ms, sort 167 ms, write 2205 ms, index 530 ms: 10 candidates, 76470 repo-hours, 791 releases; waiting 635 ms; commit 1067 ms)
2026-11-07T12:48:22Z [load_day 2026-04-18] 2026-04-18 hour 8: 149552 events in 3 files, snapshot 2214634523199057345 (task 5652 ms: download 1964 ms overlapping gunzip 358 ms, parse 1231 ms, sort 125 ms, write 2303 ms, index 566 ms: 8 candidates, 76604 repo-hours, 740 releases; waiting 574 ms; commit 972 ms)
2026-11-07T12:48:23Z [load_day 2026-04-18] 2026-04-18 hour 9: 145879 events in 3 files, snapshot 8644629338718461318 (task 5589 ms: download 1463 ms overlapping gunzip 391 ms, parse 1217 ms, sort 156 ms, write 2693 ms, index 531 ms: 3 candidates, 75366 repo-hours, 863 releases; waiting 211 ms; commit 1362 ms)
2026-11-07T12:48:28Z [load_day 2026-04-18] 2026-04-18 hour 10: 152412 events in 4 files, snapshot 895879238882274455 (task 5133 ms: download 684 ms overlapping gunzip 360 ms, parse 1158 ms, sort 152 ms, write 2743 ms, index 509 ms: 8 candidates, 77199 repo-hours, 738 releases; waiting 17 ms; commit 1359 ms)
2026-11-07T12:48:29Z [load_day 2026-04-18] 2026-04-18 hour 11: 150023 events in 4 files, snapshot 425491504377476498 (task 5537 ms: download 1654 ms overlapping gunzip 365 ms, parse 1221 ms, sort 139 ms, write 2358 ms, index 509 ms: 8 candidates, 71505 repo-hours, 713 releases; waiting 293 ms; commit 1249 ms)
2026-11-07T12:48:34Z [load_day 2026-04-18] 2026-04-18 hour 12: 152779 events in 4 files, snapshot 5558963414835471272 (task 5726 ms: download 1621 ms overlapping gunzip 347 ms, parse 1128 ms, sort 153 ms, write 2738 ms, index 573 ms: 8 candidates, 85150 repo-hours, 680 releases; waiting 368 ms; commit 1088 ms)
2026-11-07T12:48:38Z [load_day 2026-04-18] 2026-04-18 hour 13: 157286 events in 4 files, snapshot 4360197608017383468 (task 5732 ms: download 1837 ms overlapping gunzip 313 ms, parse 1059 ms, sort 150 ms, write 2729 ms, index 585 ms: 3 candidates, 90763 repo-hours, 630 releases; waiting 543 ms; commit 3684 ms)
2026-11-07T12:48:41Z [load_day 2026-04-18] 2026-04-18 hour 14: 152828 events in 4 files, snapshot 1068728923203154950 (task 6114 ms: download 1741 ms overlapping gunzip 344 ms, parse 1111 ms, sort 153 ms, write 3071 ms, index 597 ms: 8 candidates, 80689 repo-hours, 678 releases; waiting 542 ms; commit 1066 ms)
2026-11-07T12:48:43Z [load_day 2026-04-18] 2026-04-18 hour 15: 158425 events in 4 files, snapshot 6731279550367873320 (task 6126 ms: download 2060 ms overlapping gunzip 355 ms, parse 1150 ms, sort 152 ms, write 2997 ms, index 581 ms: 8 candidates, 81688 repo-hours, 636 releases; waiting 569 ms; commit 1167 ms)
2026-11-07T12:48:48Z [load_day 2026-04-18] 2026-04-18 hour 16: 153212 events in 4 files, snapshot 4355546179148677763 (task 5789 ms: download 1694 ms overlapping gunzip 354 ms, parse 1189 ms, sort 171 ms, write 2664 ms, index 559 ms: 9 candidates, 79201 repo-hours, 688 releases; waiting 529 ms; commit 1333 ms)
2026-11-07T12:48:49Z [load_day 2026-04-18] 2026-04-18 hour 17: 153789 events in 4 files, snapshot 8536800642885715222 (task 5735 ms: download 1896 ms overlapping gunzip 338 ms, parse 1107 ms, sort 147 ms, write 2771 ms, index 522 ms: 9 candidates, 78013 repo-hours, 704 releases; waiting 535 ms; commit 1249 ms)
2026-11-07T12:48:55Z [load_day 2026-04-18] 2026-04-18 hour 18: 155148 events in 4 files, snapshot 3282276302170651372 (task 5630 ms: download 1771 ms overlapping gunzip 326 ms, parse 1088 ms, sort 139 ms, write 2737 ms, index 519 ms: 17 candidates, 79964 repo-hours, 604 releases; waiting 544 ms; commit 1409 ms)
2026-11-07T12:48:56Z [load_day 2026-04-18] 2026-04-18 hour 19: 152441 events in 4 files, snapshot 4064939591080373398 (task 5864 ms: download 1962 ms overlapping gunzip 354 ms, parse 1136 ms, sort 198 ms, write 2656 ms, index 507 ms: 14 candidates, 74795 repo-hours, 694 releases; waiting 699 ms; commit 1381 ms)
2026-11-07T12:49:03Z [load_day 2026-04-18] 2026-04-18 hour 20: 148297 events in 3 files, snapshot 6345600108769633973 (task 5833 ms: download 1927 ms overlapping gunzip 345 ms, parse 1154 ms, sort 143 ms, write 2770 ms, index 504 ms: 10 candidates, 71056 repo-hours, 663 releases; waiting 529 ms; commit 3053 ms)
2026-11-07T12:49:04Z [load_day 2026-04-18] 2026-04-18 hour 21: 149605 events in 3 files, snapshot 6465047049746781469 (task 6141 ms: download 2165 ms overlapping gunzip 375 ms, parse 1224 ms, sort 167 ms, write 2962 ms, index 505 ms: 9 candidates, 71201 repo-hours, 769 releases; waiting 627 ms; commit 1385 ms)
2026-11-07T12:49:10Z [load_day 2026-04-18] 2026-04-18 hour 22: 148377 events in 3 files, snapshot 5222639194848951320 (task 6406 ms: download 2292 ms overlapping gunzip 384 ms, parse 1319 ms, sort 135 ms, write 3043 ms, index 614 ms: 4 candidates, 66026 repo-hours, 878 releases; waiting 556 ms; commit 1171 ms)
2026-11-07T12:49:11Z [load_day 2026-04-18] 2026-04-18 hour 23: 144730 events in 3 files, snapshot 7856710505621753464 (task 5977 ms: download 2556 ms overlapping gunzip 358 ms, parse 1252 ms, sort 144 ms, write 2735 ms, index 459 ms: 6 candidates, 67359 repo-hours, 915 releases; waiting 584 ms; commit 1295 ms)
2026-11-07T12:49:18Z [load_day 2026-04-18] 2026-04-18: repo_hour merged from 24 files to 1 (1809693 rows, 7280 ms)
2026-11-07T12:49:20Z [load_day 2026-04-18] 2026-04-18: index committed in 8906 ms (24 + 1 + 24 files)
2026-11-07T12:49:20Z [load_day 2026-04-18] 2026-04-18: 3605682 events in 24 hours
2026-11-07T12:49:20Z [load_day 2026-04-18] attempt 1 succeeded