orcaLog in

Runs · run 509

load_day 2026-06-01, attempt 1 succeeded

Host
4e84322b8c45:110825
Started
2026-11-07T06:06:29Z
Ended
2026-11-07T06:07:38Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/509/load_day/2026-06-01/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:06:29Z [load_day 2026-06-01] attempt 1 started
2026-11-07T06:06:37Z [load_day 2026-06-01] 2026-06-01 hour 0: 151349 events in 4 files, snapshot 936278663473442763 (task 5006 ms: download 1845 ms overlapping gunzip 291 ms, parse 1013 ms, sort 131 ms, write 2317 ms, index 431 ms: 4 candidates, 68556 repo-hours, 453 releases; waiting 504 ms; commit 1100 ms)
2026-11-07T06:06:38Z [load_day 2026-06-01] 2026-06-01 hour 1: 151558 events in 4 files, snapshot 519157441662431046 (task 5194 ms: download 2171 ms overlapping gunzip 301 ms, parse 1063 ms, sort 156 ms, write 2398 ms, index 452 ms: 10 candidates, 67485 repo-hours, 557 releases; waiting 591 ms; commit 975 ms)
2026-11-07T06:06:42Z [load_day 2026-06-01] 2026-06-01 hour 2: 156960 events in 4 files, snapshot 497814951704911417 (task 4285 ms: download 1391 ms overlapping gunzip 267 ms, parse 924 ms, sort 126 ms, write 1636 ms, index 571 ms: 5 candidates, 80263 repo-hours, 211 releases; waiting 498 ms; commit 1075 ms)
2026-11-07T06:06:43Z [load_day 2026-06-01] 2026-06-01 hour 3: 158737 events in 4 files, snapshot 6685113194504837353 (task 4316 ms: download 1578 ms overlapping gunzip 276 ms, parse 932 ms, sort 115 ms, write 1647 ms, index 464 ms: 2 candidates, 75534 repo-hours, 165 releases; waiting 510 ms; commit 1073 ms)
2026-11-07T06:06:47Z [load_day 2026-06-01] 2026-06-01 hour 4: 162273 events in 4 files, snapshot 3633684101679940810 (task 4247 ms: download 1560 ms overlapping gunzip 266 ms, parse 926 ms, sort 114 ms, write 1572 ms, index 527 ms: 5 candidates, 82741 repo-hours, 143 releases; waiting 525 ms; commit 1078 ms)
2026-11-07T06:06:48Z [load_day 2026-06-01] 2026-06-01 hour 5: 158466 events in 4 files, snapshot 1592132608732758565 (task 4208 ms: download 1414 ms overlapping gunzip 275 ms, parse 887 ms, sort 120 ms, write 1630 ms, index 466 ms: 5 candidates, 74025 repo-hours, 169 releases; waiting 539 ms; commit 964 ms)
2026-11-07T06:06:51Z [load_day 2026-06-01] 2026-06-01 hour 6: 158990 events in 4 files, snapshot 2282827084672272721 (task 3757 ms: download 1061 ms overlapping gunzip 226 ms, parse 797 ms, sort 106 ms, write 1624 ms, index 534 ms: 5 candidates, 75781 repo-hours, 123 releases; waiting 267 ms; commit 1292 ms)
2026-11-07T06:06:52Z [load_day 2026-06-01] 2026-06-01 hour 7: 155864 events in 4 files, snapshot 1573119212627622061 (task 3838 ms: download 1677 ms overlapping gunzip 208 ms, parse 752 ms, sort 98 ms, write 1447 ms, index 504 ms: 6 candidates, 76835 repo-hours, 72 releases; waiting 545 ms; commit 968 ms)
2026-11-07T06:06:55Z [load_day 2026-06-01] 2026-06-01 hour 8: 155600 events in 4 files, snapshot 251348519046977630 (task 3885 ms: download 1244 ms overlapping gunzip 205 ms, parse 758 ms, sort 101 ms, write 1456 ms, index 549 ms: 4 candidates, 76340 repo-hours, 45 releases; waiting 522 ms; commit 1066 ms)
2026-11-07T06:06:57Z [load_day 2026-06-01] 2026-06-01 hour 9: 156736 events in 4 files, snapshot 6699017611669115340 (task 4028 ms: download 1360 ms overlapping gunzip 211 ms, parse 777 ms, sort 104 ms, write 1587 ms, index 499 ms: 5 candidates, 78328 repo-hours, 57 releases; waiting 527 ms; commit 999 ms)
2026-11-07T06:07:00Z [load_day 2026-06-01] 2026-06-01 hour 10: 156563 events in 4 files, snapshot 4815523720033244658 (task 3910 ms: download 1477 ms overlapping gunzip 207 ms, parse 755 ms, sort 102 ms, write 1527 ms, index 524 ms: 2 candidates, 76885 repo-hours, 63 releases; waiting 527 ms; commit 976 ms)
2026-11-07T06:07:01Z [load_day 2026-06-01] 2026-06-01 hour 11: 155613 events in 4 files, snapshot 6444614881961475097 (task 3892 ms: download 1446 ms overlapping gunzip 200 ms, parse 727 ms, sort 103 ms, write 1440 ms, index 539 ms: 4 candidates, 80960 repo-hours, 34 releases; waiting 539 ms; commit 1127 ms)
2026-11-07T06:07:04Z [load_day 2026-06-01] 2026-06-01 hour 12: 158152 events in 4 files, snapshot 5384128591454562077 (task 3781 ms: download 1138 ms overlapping gunzip 208 ms, parse 762 ms, sort 108 ms, write 1485 ms, index 568 ms: 6 candidates, 82360 repo-hours, 33 releases; waiting 313 ms; commit 925 ms)
2026-11-07T06:07:06Z [load_day 2026-06-01] 2026-06-01 hour 13: 154946 events in 4 files, snapshot 8227389833906820583 (task 3880 ms: download 1241 ms overlapping gunzip 214 ms, parse 763 ms, sort 105 ms, write 1442 ms, index 558 ms: 7 candidates, 81285 repo-hours, 61 releases; waiting 526 ms; commit 1066 ms)
2026-11-07T06:07:08Z [load_day 2026-06-01] 2026-06-01 hour 14: 152075 events in 4 files, snapshot 5124287121084609938 (task 3800 ms: download 1602 ms overlapping gunzip 201 ms, parse 735 ms, sort 101 ms, write 1361 ms, index 515 ms: 7 candidates, 79728 repo-hours, 53 releases; waiting 545 ms; commit 974 ms)
2026-11-07T06:07:10Z [load_day 2026-06-01] 2026-06-01 hour 15: 149565 events in 3 files, snapshot 5281501380258978445 (task 3776 ms: download 1286 ms overlapping gunzip 200 ms, parse 727 ms, sort 104 ms, write 1444 ms, index 577 ms: 6 candidates, 79890 repo-hours, 58 releases; waiting 412 ms; commit 1136 ms)
2026-11-07T06:07:13Z [load_day 2026-06-01] 2026-06-01 hour 16: 157485 events in 4 files, snapshot 3357809861367361391 (task 3763 ms: download 759 ms overlapping gunzip 200 ms, parse 742 ms, sort 112 ms, write 1468 ms, index 538 ms: 13 candidates, 81963 repo-hours, 45 releases; waiting 404 ms; commit 1148 ms)
2026-11-07T06:07:15Z [load_day 2026-06-01] 2026-06-01 hour 17: 158320 events in 4 files, snapshot 1500184298257281051 (task 3876 ms: download 1144 ms overlapping gunzip 195 ms, parse 739 ms, sort 109 ms, write 1423 ms, index 588 ms: 12 candidates, 90367 repo-hours, 28 releases; waiting 534 ms; commit 1016 ms)
2026-11-07T06:07:17Z [load_day 2026-06-01] 2026-06-01 hour 18: 153605 events in 4 files, snapshot 4722449572899456888 (task 3755 ms: download 1385 ms overlapping gunzip 195 ms, parse 722 ms, sort 105 ms, write 1421 ms, index 516 ms: 5 candidates, 76156 repo-hours, 29 releases; waiting 520 ms; commit 1127 ms)
2026-11-07T06:07:19Z [load_day 2026-06-01] 2026-06-01 hour 19: 156331 events in 4 files, snapshot 2400228551631802026 (task 3817 ms: download 1391 ms overlapping gunzip 199 ms, parse 758 ms, sort 108 ms, write 1382 ms, index 554 ms: 9 candidates, 77332 repo-hours, 42 releases; waiting 534 ms; commit 1214 ms)
2026-11-07T06:07:22Z [load_day 2026-06-01] 2026-06-01 hour 20: 154037 events in 4 files, snapshot 5766110182420044777 (task 3921 ms: download 1244 ms overlapping gunzip 206 ms, parse 791 ms, sort 114 ms, write 1373 ms, index 620 ms: 9 candidates, 74930 repo-hours, 50 releases; waiting 525 ms; commit 1100 ms)
2026-11-07T06:07:24Z [load_day 2026-06-01] 2026-06-01 hour 21: 160479 events in 4 files, snapshot 1231842946160222144 (task 4190 ms: download 1373 ms overlapping gunzip 230 ms, parse 826 ms, sort 115 ms, write 1570 ms, index 584 ms: 9 candidates, 77505 repo-hours, 89 releases; waiting 540 ms; commit 1230 ms)
2026-11-07T06:07:27Z [load_day 2026-06-01] 2026-06-01 hour 22: 158930 events in 4 files, snapshot 6723491918237754306 (task 4246 ms: download 1307 ms overlapping gunzip 263 ms, parse 910 ms, sort 111 ms, write 1688 ms, index 515 ms: 7 candidates, 74426 repo-hours, 109 releases; waiting 518 ms; commit 1202 ms)
2026-11-07T06:07:28Z [load_day 2026-06-01] 2026-06-01 hour 23: 156838 events in 4 files, snapshot 7245002130266190490 (task 3950 ms: download 959 ms overlapping gunzip 240 ms, parse 846 ms, sort 123 ms, write 1712 ms, index 478 ms: 5 candidates, 72097 repo-hours, 211 releases; waiting 216 ms; commit 1023 ms)
2026-11-07T06:07:36Z [load_day 2026-06-01] 2026-06-01: repo_hour merged from 24 files to 1 (1861772 rows, 7541 ms)
2026-11-07T06:07:38Z [load_day 2026-06-01] 2026-06-01: index committed in 9576 ms (24 + 1 + 24 files)
2026-11-07T06:07:38Z [load_day 2026-06-01] 2026-06-01: 3749472 events in 24 hours
2026-11-07T06:07:38Z [load_day 2026-06-01] attempt 1 succeeded