orcaLog in

Runs · run 491

load_day 2026-06-07, attempt 1 succeeded

Host
4e84322b8c45:106125
Started
2026-11-07T05:59:04Z
Ended
2026-11-07T06:00:50Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/491/load_day/2026-06-07/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:59:04Z [load_day 2026-06-07] attempt 1 started
2026-11-07T05:59:13Z [load_day 2026-06-07] 2026-06-07 hour 0: 148552 events in 3 files, snapshot 5745660670462878946 (task 5187 ms: download 1494 ms overlapping gunzip 350 ms, parse 1181 ms, sort 171 ms, write 2530 ms, index 365 ms: 3 candidates, 59897 repo-hours, 831 releases; waiting 283 ms; commit 998 ms)
2026-11-07T05:59:13Z [load_day 2026-06-07] 2026-06-07 hour 1: 151344 events in 4 files, snapshot 2713869492489790177 (task 5365 ms: download 1808 ms overlapping gunzip 391 ms, parse 1377 ms, sort 166 ms, write 2234 ms, index 410 ms: 6 candidates, 61874 repo-hours, 764 releases; waiting 392 ms; commit 878 ms)
2026-11-07T05:59:18Z [load_day 2026-06-07] 2026-06-07 hour 2: 163019 events in 4 files, snapshot 1435047355061771925 (task 4785 ms: download 1567 ms overlapping gunzip 287 ms, parse 1008 ms, sort 116 ms, write 2056 ms, index 476 ms: 9 candidates, 78577 repo-hours, 314 releases; waiting 526 ms; commit 943 ms)
2026-11-07T05:59:19Z [load_day 2026-06-07] 2026-06-07 hour 3: 159999 events in 4 files, snapshot 2672552307311900241 (task 4438 ms: download 1267 ms overlapping gunzip 267 ms, parse 928 ms, sort 111 ms, write 2110 ms, index 476 ms: 5 candidates, 71536 repo-hours, 385 releases; waiting 328 ms; commit 1009 ms)
2026-11-07T05:59:23Z [load_day 2026-06-07] 2026-06-07 hour 4: 163005 events in 4 files, snapshot 6601231469430712680 (task 4488 ms: download 1490 ms overlapping gunzip 317 ms, parse 998 ms, sort 115 ms, write 1779 ms, index 493 ms: 10 candidates, 78337 repo-hours, 337 releases; waiting 515 ms; commit 979 ms)
2026-11-07T05:59:24Z [load_day 2026-06-07] 2026-06-07 hour 5: 158311 events in 4 files, snapshot 320657659562033197 (task 4591 ms: download 1663 ms overlapping gunzip 293 ms, parse 1065 ms, sort 139 ms, write 1838 ms, index 438 ms: 6 candidates, 67121 repo-hours, 475 releases; waiting 531 ms; commit 834 ms)
2026-11-07T05:59:28Z [load_day 2026-06-07] 2026-06-07 hour 6: 156111 events in 4 files, snapshot 7398175542672629750 (task 4955 ms: download 1694 ms overlapping gunzip 290 ms, parse 982 ms, sort 109 ms, write 2332 ms, index 414 ms: 5 candidates, 64778 repo-hours, 462 releases; waiting 530 ms; commit 1025 ms)
2026-11-07T05:59:29Z [load_day 2026-06-07] 2026-06-07 hour 7: 156083 events in 4 files, snapshot 2070270718115416171 (task 4607 ms: download 1443 ms overlapping gunzip 279 ms, parse 932 ms, sort 126 ms, write 2059 ms, index 449 ms: 13 candidates, 68416 repo-hours, 457 releases; waiting 542 ms; commit 977 ms)
2026-11-07T06:00:03Z [load_day 2026-06-07] 2026-06-07 hour 8: 162075 events in 4 files, snapshot 157781086734727317 (task 33974 ms: download 30327 ms overlapping gunzip 278 ms, parse 950 ms, sort 132 ms, write 1908 ms, index 559 ms: 6 candidates, 78390 repo-hours, 371 releases; waiting 29264 ms; commit 1161 ms)
2026-11-07T06:00:04Z [load_day 2026-06-07] 2026-06-07 hour 9: 153805 events in 4 files, snapshot 2362491259369005426 (task 4366 ms: download 1976 ms overlapping gunzip 269 ms, parse 919 ms, sort 115 ms, write 1658 ms, index 526 ms: 8 candidates, 75346 repo-hours, 328 releases; waiting 539 ms; commit 1146 ms)
2026-11-07T06:00:09Z [load_day 2026-06-07] 2026-06-07 hour 10: 156857 events in 4 files, snapshot 4574778255425739752 (task 4535 ms: download 1220 ms overlapping gunzip 273 ms, parse 930 ms, sort 126 ms, write 2128 ms, index 472 ms: 6 candidates, 72894 repo-hours, 433 releases; waiting 275 ms; commit 1159 ms)
2026-11-07T06:00:10Z [load_day 2026-06-07] 2026-06-07 hour 11: 160085 events in 4 files, snapshot 4718571664825473692 (task 4215 ms: download 1598 ms overlapping gunzip 235 ms, parse 873 ms, sort 111 ms, write 1619 ms, index 534 ms: 6 candidates, 74121 repo-hours, 136 releases; waiting 524 ms; commit 1181 ms)
2026-11-07T06:00:13Z [load_day 2026-06-07] 2026-06-07 hour 12: 165922 events in 4 files, snapshot 7443615320512292828 (task 3909 ms: download 1184 ms overlapping gunzip 232 ms, parse 836 ms, sort 115 ms, write 1617 ms, index 507 ms: 4 candidates, 76914 repo-hours, 126 releases; waiting 255 ms; commit 969 ms)
2026-11-07T06:00:15Z [load_day 2026-06-07] 2026-06-07 hour 13: 162660 events in 4 files, snapshot 9127176966363499914 (task 4483 ms: download 1315 ms overlapping gunzip 199 ms, parse 780 ms, sort 105 ms, write 1523 ms, index 577 ms: 6 candidates, 87076 repo-hours, 44 releases; waiting 527 ms; commit 983 ms)
2026-11-07T06:00:18Z [load_day 2026-06-07] 2026-06-07 hour 14: 163528 events in 4 files, snapshot 6422560238327601834 (task 4025 ms: download 1272 ms overlapping gunzip 214 ms, parse 794 ms, sort 107 ms, write 1562 ms, index 544 ms: 9 candidates, 82032 repo-hours, 78 releases; waiting 528 ms; commit 1012 ms)
2026-11-07T06:00:20Z [load_day 2026-06-07] 2026-06-07 hour 15: 164985 events in 4 files, snapshot 9206960846530443975 (task 4186 ms: download 1173 ms overlapping gunzip 213 ms, parse 823 ms, sort 147 ms, write 1585 ms, index 551 ms: 13 candidates, 81981 repo-hours, 88 releases; waiting 515 ms; commit 1046 ms)
2026-11-07T06:00:23Z [load_day 2026-06-07] 2026-06-07 hour 16: 163919 events in 4 files, snapshot 5586401245836967836 (task 4258 ms: download 1260 ms overlapping gunzip 223 ms, parse 849 ms, sort 118 ms, write 1625 ms, index 553 ms: 9 candidates, 82185 repo-hours, 60 releases; waiting 519 ms; commit 1153 ms)
2026-11-07T06:00:24Z [load_day 2026-06-07] 2026-06-07 hour 17: 161275 events in 4 files, snapshot 3858208189030405092 (task 4136 ms: download 1312 ms overlapping gunzip 221 ms, parse 816 ms, sort 109 ms, write 1670 ms, index 545 ms: 8 candidates, 76813 repo-hours, 96 releases; waiting 531 ms; commit 1049 ms)
2026-11-07T06:00:28Z [load_day 2026-06-07] 2026-06-07 hour 18: 160572 events in 4 files, snapshot 7422788271074754353 (task 4301 ms: download 1500 ms overlapping gunzip 234 ms, parse 900 ms, sort 114 ms, write 1712 ms, index 480 ms: 16 candidates, 74346 repo-hours, 195 releases; waiting 517 ms; commit 998 ms)
2026-11-07T06:00:30Z [load_day 2026-06-07] 2026-06-07 hour 19: 165292 events in 4 files, snapshot 8535044242597161933 (task 4435 ms: download 1202 ms overlapping gunzip 241 ms, parse 871 ms, sort 104 ms, write 1841 ms, index 632 ms: 10 candidates, 78563 repo-hours, 138 releases; waiting 529 ms; commit 1250 ms)
2026-11-07T06:00:33Z [load_day 2026-06-07] 2026-06-07 hour 20: 160638 events in 4 files, snapshot 7109344483779570275 (task 3983 ms: download 1011 ms overlapping gunzip 248 ms, parse 891 ms, sort 120 ms, write 1740 ms, index 472 ms: 3 candidates, 73115 repo-hours, 248 releases; waiting 246 ms; commit 1458 ms)
2026-11-07T06:00:35Z [load_day 2026-06-07] 2026-06-07 hour 21: 158359 events in 4 files, snapshot 3841640730898414459 (task 4736 ms: download 1361 ms overlapping gunzip 302 ms, parse 1016 ms, sort 136 ms, write 1933 ms, index 486 ms: 5 candidates, 73034 repo-hours, 445 releases; waiting 533 ms; commit 1030 ms)
2026-11-07T06:00:38Z [load_day 2026-06-07] 2026-06-07 hour 22: 154161 events in 4 files, snapshot 4908719112524249191 (task 4679 ms: download 1493 ms overlapping gunzip 279 ms, parse 963 ms, sort 106 ms, write 1950 ms, index 487 ms: 5 candidates, 68453 repo-hours, 480 releases; waiting 537 ms; commit 1046 ms)
2026-11-07T06:00:40Z [load_day 2026-06-07] 2026-06-07 hour 23: 150756 events in 4 files, snapshot 9120332433976409506 (task 5014 ms: download 1908 ms overlapping gunzip 356 ms, parse 1246 ms, sort 143 ms, write 2163 ms, index 437 ms: 2 candidates, 67527 repo-hours, 787 releases; waiting 382 ms; commit 959 ms)
2026-11-07T06:00:48Z [load_day 2026-06-07] 2026-06-07: repo_hour merged from 24 files to 1 (1773326 rows, 7311 ms)
2026-11-07T06:00:50Z [load_day 2026-06-07] 2026-06-07: index committed in 9488 ms (24 + 1 + 24 files)
2026-11-07T06:00:50Z [load_day 2026-06-07] 2026-06-07: 3821313 events in 24 hours
2026-11-07T06:00:50Z [load_day 2026-06-07] attempt 1 succeeded