orcaLog in

Runs · run 236

load_day 2026-08-31, attempt 1 succeeded

Host
4e84322b8c45:39715
Started
2026-11-07T04:20:50Z
Ended
2026-11-07T04:21:28Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/236/load_day/2026-08-31/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:20:50Z [load_day 2026-08-31] attempt 1 started
2026-11-07T04:20:54Z [load_day 2026-08-31] 2026-08-31 hour 0: 30941 events in 1 files, snapshot 7519924977325174047 (task 1653 ms: download 755 ms overlapping gunzip 64 ms, parse 250 ms, sort 23 ms, write 412 ms, index 77 ms: 0 candidates, 10902 repo-hours, 39 releases; waiting 525 ms; commit 680 ms)
2026-11-07T04:20:55Z [load_day 2026-08-31] 2026-08-31 hour 1: 36327 events in 1 files, snapshot 6677651713754966973 (task 1567 ms: download 785 ms overlapping gunzip 58 ms, parse 230 ms, sort 23 ms, write 401 ms, index 92 ms: 0 candidates, 12018 repo-hours, 33 releases; waiting 540 ms; commit 855 ms)
2026-11-07T04:20:57Z [load_day 2026-08-31] 2026-08-31 hour 2: 42807 events in 1 files, snapshot 3014228424798557149 (task 1705 ms: download 795 ms overlapping gunzip 62 ms, parse 249 ms, sort 27 ms, write 412 ms, index 106 ms: 1 candidates, 13740 repo-hours, 29 releases; waiting 536 ms; commit 784 ms)
2026-11-07T04:20:57Z [load_day 2026-08-31] 2026-08-31 hour 3: 64431 events in 2 files, snapshot 6195022444676162093 (task 2074 ms: download 839 ms overlapping gunzip 92 ms, parse 373 ms, sort 46 ms, write 709 ms, index 117 ms: 2 candidates, 16191 repo-hours, 20 releases; waiting 516 ms; commit 764 ms)
2026-11-07T04:20:59Z [load_day 2026-08-31] 2026-08-31 hour 4: 75472 events in 2 files, snapshot 5387131154802888055 (task 2272 ms: download 920 ms overlapping gunzip 111 ms, parse 419 ms, sort 46 ms, write 770 ms, index 132 ms: 1 candidates, 17174 repo-hours, 30 releases; waiting 534 ms; commit 745 ms)
2026-11-07T04:21:01Z [load_day 2026-08-31] 2026-08-31 hour 5: 78486 events in 2 files, snapshot 3581054964614072671 (task 2314 ms: download 908 ms overlapping gunzip 112 ms, parse 428 ms, sort 49 ms, write 783 ms, index 111 ms: 0 candidates, 17006 repo-hours, 41 releases; waiting 537 ms; commit 769 ms)
2026-11-07T04:21:02Z [load_day 2026-08-31] 2026-08-31 hour 6: 88278 events in 2 files, snapshot 3115954970176333010 (task 2533 ms: download 960 ms overlapping gunzip 124 ms, parse 478 ms, sort 65 ms, write 912 ms, index 129 ms: 2 candidates, 16878 repo-hours, 22 releases; waiting 511 ms; commit 836 ms)
2026-11-07T04:21:04Z [load_day 2026-08-31] 2026-08-31 hour 7: 84105 events in 2 files, snapshot 5027067622184777906 (task 2472 ms: download 899 ms overlapping gunzip 133 ms, parse 473 ms, sort 57 ms, write 833 ms, index 116 ms: 0 candidates, 17842 repo-hours, 29 releases; waiting 521 ms; commit 755 ms)
2026-11-07T04:21:06Z [load_day 2026-08-31] 2026-08-31 hour 8: 84000 events in 2 files, snapshot 4327120324523450646 (task 2449 ms: download 927 ms overlapping gunzip 122 ms, parse 455 ms, sort 58 ms, write 815 ms, index 132 ms: 2 candidates, 18064 repo-hours, 57 releases; waiting 541 ms; commit 835 ms)
2026-11-07T04:21:07Z [load_day 2026-08-31] 2026-08-31 hour 9: 79668 events in 2 files, snapshot 8254796313586687146 (task 2286 ms: download 931 ms overlapping gunzip 122 ms, parse 450 ms, sort 56 ms, write 788 ms, index 112 ms: 0 candidates, 17458 repo-hours, 58 releases; waiting 524 ms; commit 806 ms)
2026-11-07T04:21:09Z [load_day 2026-08-31] 2026-08-31 hour 10: 77156 events in 2 files, snapshot 7970430409925169768 (task 2248 ms: download 935 ms overlapping gunzip 109 ms, parse 402 ms, sort 52 ms, write 765 ms, index 120 ms: 2 candidates, 17049 repo-hours, 50 releases; waiting 528 ms; commit 825 ms)
2026-11-07T04:21:10Z [load_day 2026-08-31] 2026-08-31 hour 11: 77807 events in 2 files, snapshot 4806578252750999838 (task 2570 ms: download 1231 ms overlapping gunzip 113 ms, parse 423 ms, sort 46 ms, write 757 ms, index 131 ms: 0 candidates, 17145 repo-hours, 64 releases; waiting 807 ms; commit 653 ms)
2026-11-07T04:21:12Z [load_day 2026-08-31] 2026-08-31 hour 12: 74819 events in 2 files, snapshot 8316503417085241996 (task 2383 ms: download 907 ms overlapping gunzip 106 ms, parse 392 ms, sort 50 ms, write 819 ms, index 129 ms: 1 candidates, 17314 repo-hours, 60 releases; waiting 540 ms; commit 773 ms)
2026-11-07T04:21:12Z [load_day 2026-08-31] 2026-08-31 hour 13: 65276 events in 2 files, snapshot 5481222985199592004 (task 1879 ms: download 406 ms overlapping gunzip 85 ms, parse 307 ms, sort 44 ms, write 818 ms, index 113 ms: 0 candidates, 16675 repo-hours, 71 releases; waiting 215 ms; commit 708 ms)
2026-11-07T04:21:14Z [load_day 2026-08-31] 2026-08-31 hour 14: 55857 events in 2 files, snapshot 8220807879926413816 (task 1846 ms: download 853 ms overlapping gunzip 77 ms, parse 292 ms, sort 36 ms, write 553 ms, index 121 ms: 1 candidates, 15841 repo-hours, 52 releases; waiting 550 ms; commit 646 ms)
2026-11-07T04:21:15Z [load_day 2026-08-31] 2026-08-31 hour 15: 44960 events in 1 files, snapshot 4134012803027284946 (task 1712 ms: download 792 ms overlapping gunzip 74 ms, parse 276 ms, sort 30 ms, write 465 ms, index 96 ms: 0 candidates, 12903 repo-hours, 60 releases; waiting 533 ms; commit 664 ms)
2026-11-07T04:21:16Z [load_day 2026-08-31] 2026-08-31 hour 16: 33844 events in 1 files, snapshot 3267833434632619982 (task 1564 ms: download 770 ms overlapping gunzip 58 ms, parse 206 ms, sort 20 ms, write 404 ms, index 107 ms: 2 candidates, 11683 repo-hours, 60 releases; waiting 543 ms; commit 844 ms)
2026-11-07T04:21:17Z [load_day 2026-08-31] 2026-08-31 hour 17: 26942 events in 1 files, snapshot 2944058264051794719 (task 1477 ms: download 756 ms overlapping gunzip 54 ms, parse 191 ms, sort 15 ms, write 363 ms, index 85 ms: 2 candidates, 9934 repo-hours, 46 releases; waiting 550 ms; commit 756 ms)
2026-11-07T04:21:18Z [load_day 2026-08-31] 2026-08-31 hour 18: 19049 events in 1 files, snapshot 5774165447760004389 (task 1402 ms: download 707 ms overlapping gunzip 43 ms, parse 146 ms, sort 10 ms, write 303 ms, index 72 ms: 0 candidates, 8736 repo-hours, 52 releases; waiting 531 ms; commit 743 ms)
2026-11-07T04:21:19Z [load_day 2026-08-31] 2026-08-31 hour 19: 16724 events in 1 files, snapshot 766775406897182828 (task 1357 ms: download 692 ms overlapping gunzip 39 ms, parse 146 ms, sort 9 ms, write 276 ms, index 60 ms: 0 candidates, 7846 repo-hours, 35 releases; waiting 520 ms; commit 622 ms)
2026-11-07T04:21:21Z [load_day 2026-08-31] 2026-08-31 hour 20: 12927 events in 1 files, snapshot 8225235801578747380 (task 1527 ms: download 830 ms overlapping gunzip 32 ms, parse 103 ms, sort 6 ms, write 264 ms, index 121 ms: 1 candidates, 6872 repo-hours, 35 releases; waiting 706 ms; commit 806 ms)
2026-11-07T04:21:21Z [load_day 2026-08-31] 2026-08-31 hour 21: 13817 events in 1 files, snapshot 6154564473330892454 (task 1425 ms: download 676 ms overlapping gunzip 37 ms, parse 124 ms, sort 6 ms, write 284 ms, index 58 ms: 0 candidates, 7076 repo-hours, 41 releases; waiting 525 ms; commit 714 ms)
2026-11-07T04:21:23Z [load_day 2026-08-31] 2026-08-31 hour 22: 30257 events in 1 files, snapshot 1906581355226433024 (task 1508 ms: download 752 ms overlapping gunzip 49 ms, parse 181 ms, sort 17 ms, write 347 ms, index 73 ms: 0 candidates, 9599 repo-hours, 23 releases; waiting 546 ms; commit 736 ms)
2026-11-07T04:21:24Z [load_day 2026-08-31] 2026-08-31 hour 23: 34755 events in 1 files, snapshot 5982397208648965413 (task 1589 ms: download 764 ms overlapping gunzip 55 ms, parse 205 ms, sort 21 ms, write 369 ms, index 121 ms: 1 candidates, 10161 repo-hours, 26 releases; waiting 538 ms; commit 913 ms)
2026-11-07T04:21:26Z [load_day 2026-08-31] 2026-08-31: repo_hour merged from 24 files to 1 (326107 rows, 2285 ms)
2026-11-07T04:21:28Z [load_day 2026-08-31] 2026-08-31: index committed in 3826 ms (12 + 1 + 24 files)
2026-11-07T04:21:28Z [load_day 2026-08-31] 2026-08-31: 1248705 events in 24 hours
2026-11-07T04:21:28Z [load_day 2026-08-31] attempt 1 succeeded