orcaLog in

Runs · run 254

load_day 2026-08-25, attempt 1 succeeded

Host
4e84322b8c45:42009
Started
2026-11-07T04:25:03Z
Ended
2026-11-07T04:25:45Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/254/load_day/2026-08-25/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:25:03Z [load_day 2026-08-25] attempt 1 started
2026-11-07T04:25:08Z [load_day 2026-08-25] 2026-08-25 hour 0: 74087 events in 2 files, snapshot 4832493312165007683 (task 2366 ms: download 875 ms overlapping gunzip 109 ms, parse 382 ms, sort 54 ms, write 846 ms, index 173 ms: 3 candidates, 21309 repo-hours, 22 releases; waiting 522 ms; commit 861 ms)
2026-11-07T04:25:09Z [load_day 2026-08-25] 2026-08-25 hour 1: 76722 events in 2 files, snapshot 968676804085881231 (task 2351 ms: download 883 ms overlapping gunzip 99 ms, parse 391 ms, sort 53 ms, write 797 ms, index 172 ms: 1 candidates, 23502 repo-hours, 28 releases; waiting 510 ms; commit 723 ms)
2026-11-07T04:25:11Z [load_day 2026-08-25] 2026-08-25 hour 2: 72520 events in 2 files, snapshot 427259252612602098 (task 2197 ms: download 574 ms overlapping gunzip 95 ms, parse 370 ms, sort 46 ms, write 749 ms, index 141 ms: 2 candidates, 19966 repo-hours, 25 releases; waiting 222 ms; commit 714 ms)
2026-11-07T04:25:12Z [load_day 2026-08-25] 2026-08-25 hour 3: 74221 events in 2 files, snapshot 959502271718578458 (task 2331 ms: download 902 ms overlapping gunzip 115 ms, parse 443 ms, sort 45 ms, write 732 ms, index 134 ms: 0 candidates, 20008 repo-hours, 29 releases; waiting 525 ms; commit 710 ms)
2026-11-07T04:25:14Z [load_day 2026-08-25] 2026-08-25 hour 4: 80641 events in 2 files, snapshot 3852817712079501291 (task 2245 ms: download 779 ms overlapping gunzip 109 ms, parse 421 ms, sort 53 ms, write 792 ms, index 187 ms: 2 candidates, 20232 repo-hours, 20 releases; waiting 413 ms; commit 738 ms)
2026-11-07T04:25:15Z [load_day 2026-08-25] 2026-08-25 hour 5: 99327 events in 2 files, snapshot 8373209858141667444 (task 2591 ms: download 974 ms overlapping gunzip 129 ms, parse 502 ms, sort 87 ms, write 887 ms, index 157 ms: 1 candidates, 19414 repo-hours, 23 releases; waiting 524 ms; commit 984 ms)
2026-11-07T04:25:17Z [load_day 2026-08-25] 2026-08-25 hour 6: 103265 events in 3 files, snapshot 6513819834972385555 (task 2717 ms: download 1014 ms overlapping gunzip 140 ms, parse 524 ms, sort 88 ms, write 934 ms, index 152 ms: 0 candidates, 18684 repo-hours, 12 releases; waiting 528 ms; commit 927 ms)
2026-11-07T04:25:18Z [load_day 2026-08-25] 2026-08-25 hour 7: 95976 events in 2 files, snapshot 8462652770367753617 (task 2447 ms: download 1117 ms overlapping gunzip 118 ms, parse 457 ms, sort 60 ms, write 864 ms, index 111 ms: 0 candidates, 17592 repo-hours, 17 releases; waiting 524 ms; commit 823 ms)
2026-11-07T04:25:20Z [load_day 2026-08-25] 2026-08-25 hour 8: 87684 events in 2 files, snapshot 4443755262461552867 (task 2593 ms: download 1148 ms overlapping gunzip 109 ms, parse 428 ms, sort 54 ms, write 870 ms, index 146 ms: 1 candidates, 17831 repo-hours, 21 releases; waiting 538 ms; commit 767 ms)
2026-11-07T04:25:21Z [load_day 2026-08-25] 2026-08-25 hour 9: 80257 events in 2 files, snapshot 8846906145241814190 (task 2305 ms: download 1084 ms overlapping gunzip 111 ms, parse 413 ms, sort 56 ms, write 745 ms, index 121 ms: 1 candidates, 17576 repo-hours, 16 releases; waiting 533 ms; commit 837 ms)
2026-11-07T04:25:23Z [load_day 2026-08-25] 2026-08-25 hour 10: 83371 events in 2 files, snapshot 7750476652746224290 (task 2265 ms: download 918 ms overlapping gunzip 104 ms, parse 402 ms, sort 51 ms, write 772 ms, index 126 ms: 2 candidates, 18194 repo-hours, 21 releases; waiting 526 ms; commit 764 ms)
2026-11-07T04:25:24Z [load_day 2026-08-25] 2026-08-25 hour 11: 88715 events in 2 files, snapshot 4768210486930836128 (task 2249 ms: download 938 ms overlapping gunzip 107 ms, parse 424 ms, sort 56 ms, write 792 ms, index 116 ms: 0 candidates, 18850 repo-hours, 21 releases; waiting 537 ms; commit 846 ms)
2026-11-07T04:25:26Z [load_day 2026-08-25] 2026-08-25 hour 12: 94471 events in 2 files, snapshot 1758924834391259841 (task 2209 ms: download 718 ms overlapping gunzip 117 ms, parse 447 ms, sort 58 ms, write 865 ms, index 144 ms: 2 candidates, 21009 repo-hours, 12 releases; waiting 315 ms; commit 799 ms)
2026-11-07T04:25:27Z [load_day 2026-08-25] 2026-08-25 hour 13: 82709 events in 2 files, snapshot 1224369764472399399 (task 2367 ms: download 919 ms overlapping gunzip 106 ms, parse 403 ms, sort 55 ms, write 799 ms, index 129 ms: 0 candidates, 20371 repo-hours, 32 releases; waiting 527 ms; commit 755 ms)
2026-11-07T04:25:29Z [load_day 2026-08-25] 2026-08-25 hour 14: 68097 events in 2 files, snapshot 4213066297680879550 (task 2241 ms: download 886 ms overlapping gunzip 97 ms, parse 355 ms, sort 40 ms, write 723 ms, index 133 ms: 3 candidates, 17596 repo-hours, 24 releases; waiting 526 ms; commit 853 ms)
2026-11-07T04:25:30Z [load_day 2026-08-25] 2026-08-25 hour 15: 66239 events in 2 files, snapshot 3317756985258098464 (task 2114 ms: download 884 ms overlapping gunzip 103 ms, parse 378 ms, sort 46 ms, write 717 ms, index 107 ms: 0 candidates, 17263 repo-hours, 45 releases; waiting 544 ms; commit 779 ms)
2026-11-07T04:25:31Z [load_day 2026-08-25] 2026-08-25 hour 16: 58355 events in 2 files, snapshot 3514334795300891118 (task 1729 ms: download 386 ms overlapping gunzip 90 ms, parse 311 ms, sort 38 ms, write 622 ms, index 119 ms: 0 candidates, 15686 repo-hours, 40 releases; waiting 217 ms; commit 727 ms)
2026-11-07T04:25:32Z [load_day 2026-08-25] 2026-08-25 hour 17: 60783 events in 2 files, snapshot 7070771875039618426 (task 2034 ms: download 855 ms overlapping gunzip 91 ms, parse 315 ms, sort 34 ms, write 592 ms, index 129 ms: 2 candidates, 16681 repo-hours, 44 releases; waiting 548 ms; commit 904 ms)
2026-11-07T04:25:34Z [load_day 2026-08-25] 2026-08-25 hour 18: 63252 events in 2 files, snapshot 196868233684852781 (task 2314 ms: download 855 ms overlapping gunzip 89 ms, parse 325 ms, sort 41 ms, write 648 ms, index 124 ms: 3 candidates, 17684 repo-hours, 24 releases; waiting 540 ms; commit 795 ms)
2026-11-07T04:25:35Z [load_day 2026-08-25] 2026-08-25 hour 19: 71824 events in 2 files, snapshot 91115309582962418 (task 2250 ms: download 888 ms overlapping gunzip 94 ms, parse 362 ms, sort 43 ms, write 739 ms, index 135 ms: 1 candidates, 19068 repo-hours, 25 releases; waiting 535 ms; commit 864 ms)
2026-11-07T04:25:37Z [load_day 2026-08-25] 2026-08-25 hour 20: 88560 events in 2 files, snapshot 1660247269850926992 (task 2308 ms: download 949 ms overlapping gunzip 114 ms, parse 433 ms, sort 57 ms, write 839 ms, index 131 ms: 4 candidates, 19768 repo-hours, 33 releases; waiting 517 ms; commit 996 ms)
2026-11-07T04:25:38Z [load_day 2026-08-25] 2026-08-25 hour 21: 92726 events in 2 files, snapshot 3092411221297339984 (task 2494 ms: download 916 ms overlapping gunzip 122 ms, parse 479 ms, sort 65 ms, write 868 ms, index 148 ms: 6 candidates, 19556 repo-hours, 24 releases; waiting 522 ms; commit 847 ms)
2026-11-07T04:25:39Z [load_day 2026-08-25] 2026-08-25 hour 22: 89247 events in 2 files, snapshot 5148936860137272035 (task 2093 ms: download 605 ms overlapping gunzip 119 ms, parse 458 ms, sort 72 ms, write 818 ms, index 136 ms: 4 candidates, 18615 repo-hours, 24 releases; waiting 184 ms; commit 816 ms)
2026-11-07T04:25:41Z [load_day 2026-08-25] 2026-08-25 hour 23: 88517 events in 2 files, snapshot 7133635130120486052 (task 2168 ms: download 516 ms overlapping gunzip 121 ms, parse 468 ms, sort 58 ms, write 804 ms, index 147 ms: 4 candidates, 18823 repo-hours, 24 releases; waiting 183 ms; commit 988 ms)
2026-11-07T04:25:44Z [load_day 2026-08-25] 2026-08-25: repo_hour merged from 24 files to 1 (455278 rows, 2847 ms)
2026-11-07T04:25:45Z [load_day 2026-08-25] 2026-08-25: index committed in 4284 ms (17 + 1 + 24 files)
2026-11-07T04:25:45Z [load_day 2026-08-25] 2026-08-25: 1941566 events in 24 hours
2026-11-07T04:25:45Z [load_day 2026-08-25] attempt 1 succeeded