orcaLog in

Runs · run 678

load_day 2026-04-06, attempt 1 succeeded

Host
4e84322b8c45:166791
Started
2026-11-07T13:06:41Z
Ended
2026-11-07T13:08:21Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/678/load_day/2026-04-06/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T13:06:41Z [load_day 2026-04-06] attempt 1 started
2026-11-07T13:06:51Z [load_day 2026-04-06] 2026-04-06 hour 0: 152345 events in 4 files, snapshot 5848732321759074511 (task 5745 ms: download 1869 ms overlapping gunzip 419 ms, parse 1400 ms, sort 164 ms, write 2700 ms, index 462 ms: 7 candidates, 67819 repo-hours, 885 releases; waiting 227 ms; commit 1180 ms)
2026-11-07T13:06:52Z [load_day 2026-04-06] 2026-04-06 hour 1: 150218 events in 4 files, snapshot 3562750935284329133 (task 5760 ms: download 2184 ms overlapping gunzip 379 ms, parse 1346 ms, sort 169 ms, write 2319 ms, index 511 ms: 10 candidates, 79214 repo-hours, 672 releases; waiting 686 ms; commit 1284 ms)
2026-11-07T13:06:58Z [load_day 2026-04-06] 2026-04-06 hour 2: 155475 events in 4 files, snapshot 2420906605644659659 (task 6921 ms: download 2023 ms overlapping gunzip 456 ms, parse 1607 ms, sort 161 ms, write 3274 ms, index 576 ms: 6 candidates, 83833 repo-hours, 660 releases; waiting 527 ms; commit 1293 ms)
2026-11-07T13:07:01Z [load_day 2026-04-06] 2026-04-06 hour 3: 159294 events in 4 files, snapshot 8189486181471495434 (task 8410 ms: download 2356 ms overlapping gunzip 590 ms, parse 2053 ms, sort 220 ms, write 4078 ms, index 596 ms: 7 candidates, 76265 repo-hours, 720 releases; waiting 551 ms; commit 1305 ms)
2026-11-07T13:07:06Z [load_day 2026-04-06] 2026-04-06 hour 4: 148383 events in 3 files, snapshot 927397479702241501 (task 7101 ms: download 1677 ms overlapping gunzip 532 ms, parse 1754 ms, sort 200 ms, write 3526 ms, index 448 ms: 3 candidates, 69134 repo-hours, 732 releases; waiting 183 ms; commit 1444 ms)
2026-11-07T13:07:11Z [load_day 2026-04-06] 2026-04-06 hour 5: 154875 events in 4 files, snapshot 5091491839800259448 (task 8637 ms: download 2893 ms overlapping gunzip 625 ms, parse 2114 ms, sort 188 ms, write 4347 ms, index 472 ms: 3 candidates, 72393 repo-hours, 693 releases; waiting 573 ms; commit 1809 ms)
2026-11-07T13:07:15Z [load_day 2026-04-06] 2026-04-06 hour 6: 147455 events in 3 files, snapshot 2577586804058896253 (task 7609 ms: download 3110 ms overlapping gunzip 520 ms, parse 1629 ms, sort 146 ms, write 3602 ms, index 503 ms: 2 candidates, 71467 repo-hours, 644 releases; waiting 867 ms; commit 1361 ms)
2026-11-07T13:07:18Z [load_day 2026-04-06] 2026-04-06 hour 7: 153750 events in 4 files, snapshot 8945866348494620503 (task 7010 ms: download 2694 ms overlapping gunzip 461 ms, parse 1555 ms, sort 137 ms, write 3479 ms, index 530 ms: 5 candidates, 78655 repo-hours, 764 releases; waiting 533 ms; commit 1136 ms)
2026-11-07T13:07:22Z [load_day 2026-04-06] 2026-04-06 hour 8: 150653 events in 4 files, snapshot 874700815189084098 (task 6588 ms: download 2578 ms overlapping gunzip 464 ms, parse 1520 ms, sort 201 ms, write 3024 ms, index 528 ms: 5 candidates, 77026 repo-hours, 671 releases; waiting 551 ms; commit 1242 ms)
2026-11-07T13:07:26Z [load_day 2026-04-06] 2026-04-06 hour 9: 153133 events in 4 files, snapshot 1967604626337102201 (task 7042 ms: download 2034 ms overlapping gunzip 448 ms, parse 1524 ms, sort 143 ms, write 3412 ms, index 544 ms: 5 candidates, 79512 repo-hours, 809 releases; waiting 535 ms; commit 1378 ms)
2026-11-07T13:07:29Z [load_day 2026-04-06] 2026-04-06 hour 10: 149907 events in 3 files, snapshot 2457220805211637051 (task 5624 ms: download 1698 ms overlapping gunzip 382 ms, parse 1169 ms, sort 145 ms, write 2659 ms, index 586 ms: 5 candidates, 79211 repo-hours, 762 releases; waiting 350 ms; commit 1401 ms)
2026-11-07T13:07:33Z [load_day 2026-04-06] 2026-04-06 hour 11: 155031 events in 4 files, snapshot 7167133865474197625 (task 6120 ms: download 1898 ms overlapping gunzip 404 ms, parse 1291 ms, sort 155 ms, write 2558 ms, index 750 ms: 7 candidates, 81631 repo-hours, 671 releases; waiting 649 ms; commit 1211 ms)
2026-11-07T13:07:35Z [load_day 2026-04-06] 2026-04-06 hour 12: 155432 events in 4 files, snapshot 4166155864841421353 (task 5891 ms: download 2104 ms overlapping gunzip 391 ms, parse 1253 ms, sort 164 ms, write 2554 ms, index 657 ms: 7 candidates, 85409 repo-hours, 654 releases; waiting 546 ms; commit 1339 ms)
2026-11-07T13:07:40Z [load_day 2026-04-06] 2026-04-06 hour 13: 157707 events in 4 files, snapshot 4706644653281461454 (task 5704 ms: download 1484 ms overlapping gunzip 383 ms, parse 1237 ms, sort 136 ms, write 2596 ms, index 630 ms: 12 candidates, 94737 repo-hours, 547 releases; waiting 392 ms; commit 1454 ms)
2026-11-07T13:07:41Z [load_day 2026-04-06] 2026-04-06 hour 14: 156676 events in 4 files, snapshot 851012979840428214 (task 5333 ms: download 1507 ms overlapping gunzip 410 ms, parse 1223 ms, sort 166 ms, write 2400 ms, index 605 ms: 8 candidates, 89163 repo-hours, 547 releases; waiting 252 ms; commit 1381 ms)
2026-11-07T13:07:47Z [load_day 2026-04-06] 2026-04-06 hour 15: 158506 events in 4 files, snapshot 3152906937817443373 (task 6146 ms: download 2106 ms overlapping gunzip 437 ms, parse 1328 ms, sort 169 ms, write 2667 ms, index 599 ms: 7 candidates, 87076 repo-hours, 611 releases; waiting 614 ms; commit 1395 ms)
2026-11-07T13:07:48Z [load_day 2026-04-06] 2026-04-06 hour 16: 156993 events in 4 files, snapshot 7132180676974769016 (task 5217 ms: download 855 ms overlapping gunzip 431 ms, parse 1332 ms, sort 152 ms, write 2431 ms, index 617 ms: 6 candidates, 88126 repo-hours, 514 releases; waiting 22 ms; commit 1514 ms)
2026-11-07T13:07:53Z [load_day 2026-04-06] 2026-04-06 hour 17: 156140 events in 4 files, snapshot 2733436978771421013 (task 5861 ms: download 1820 ms overlapping gunzip 387 ms, parse 1204 ms, sort 142 ms, write 2712 ms, index 573 ms: 7 candidates, 85401 repo-hours, 523 releases; waiting 550 ms; commit 1336 ms)
2026-11-07T13:07:54Z [load_day 2026-04-06] 2026-04-06 hour 18: 158720 events in 4 files, snapshot 8514161414878023 (task 4941 ms: download 800 ms overlapping gunzip 426 ms, parse 1335 ms, sort 123 ms, write 2261 ms, index 561 ms: 11 candidates, 85016 repo-hours, 467 releases; waiting 21 ms; commit 1363 ms)
2026-11-07T13:07:59Z [load_day 2026-04-06] 2026-04-06 hour 19: 152510 events in 4 files, snapshot 4694100001594702453 (task 4765 ms: download 1458 ms overlapping gunzip 313 ms, parse 1002 ms, sort 127 ms, write 2247 ms, index 571 ms: 8 candidates, 79011 repo-hours, 485 releases; waiting 290 ms; commit 1356 ms)
2026-11-07T13:08:01Z [load_day 2026-04-06] 2026-04-06 hour 20: 149783 events in 3 files, snapshot 5370251412301942345 (task 5542 ms: download 2328 ms overlapping gunzip 336 ms, parse 1131 ms, sort 117 ms, write 2385 ms, index 577 ms: 10 candidates, 80307 repo-hours, 498 releases; waiting 735 ms; commit 1395 ms)
2026-11-07T13:08:05Z [load_day 2026-04-06] 2026-04-06 hour 21: 153259 events in 4 files, snapshot 7313457010429447575 (task 6049 ms: download 1756 ms overlapping gunzip 364 ms, parse 1207 ms, sort 185 ms, write 2785 ms, index 574 ms: 8 candidates, 78715 repo-hours, 641 releases; waiting 627 ms; commit 1131 ms)
2026-11-07T13:08:10Z [load_day 2026-04-06] 2026-04-06 hour 22: 151256 events in 4 files, snapshot 3022541249333308895 (task 6070 ms: download 2266 ms overlapping gunzip 350 ms, parse 1187 ms, sort 148 ms, write 2745 ms, index 537 ms: 8 candidates, 75892 repo-hours, 595 releases; waiting 801 ms; commit 3491 ms)
2026-11-07T13:08:11Z [load_day 2026-04-06] 2026-04-06 hour 23: 147106 events in 3 files, snapshot 5778317576892518884 (task 5313 ms: download 1989 ms overlapping gunzip 350 ms, parse 1254 ms, sort 134 ms, write 2283 ms, index 484 ms: 6 candidates, 71537 repo-hours, 759 releases; waiting 543 ms; commit 1407 ms)
2026-11-07T13:08:19Z [load_day 2026-04-06] 2026-04-06: repo_hour merged from 24 files to 1 (1916550 rows, 7926 ms)
2026-11-07T13:08:21Z [load_day 2026-04-06] 2026-04-06: index committed in 9538 ms (24 + 1 + 24 files)
2026-11-07T13:08:21Z [load_day 2026-04-06] 2026-04-06: 3684607 events in 24 hours
2026-11-07T13:08:21Z [load_day 2026-04-06] attempt 1 succeeded