orcaLog in

Runs · run 227

load_day 2026-09-03, attempt 1 succeeded

Host
4e84322b8c45:38877
Started
2026-11-07T04:19:11Z
Ended
2026-11-07T04:19:47Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/227/load_day/2026-09-03/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:19:11Z [load_day 2026-09-03] attempt 1 started
2026-11-07T04:19:15Z [load_day 2026-09-03] 2026-09-03 hour 0: 2466 events in 1 files, snapshot 8259092067675975500 (task 1319 ms: download 662 ms overlapping gunzip 29 ms, parse 107 ms, sort 3 ms, write 281 ms, index 52 ms: 2 candidates, 2233 repo-hours, 49 releases; waiting 541 ms; commit 729 ms)
2026-11-07T04:19:16Z [load_day 2026-09-03] 2026-09-03 hour 1: 2720 events in 1 files, snapshot 4967706973005563065 (task 1296 ms: download 669 ms overlapping gunzip 32 ms, parse 101 ms, sort 2 ms, write 309 ms, index 44 ms: 2 candidates, 2420 repo-hours, 71 releases; waiting 547 ms; commit 730 ms)
2026-11-07T04:19:17Z [load_day 2026-09-03] 2026-09-03 hour 2: 2607 events in 1 files, snapshot 1690807681333738209 (task 1362 ms: download 663 ms overlapping gunzip 30 ms, parse 90 ms, sort 2 ms, write 254 ms, index 30 ms: 0 candidates, 2353 repo-hours, 78 releases; waiting 557 ms; commit 708 ms)
2026-11-07T04:19:18Z [load_day 2026-09-03] 2026-09-03 hour 3: 2528 events in 1 files, snapshot 4727399873106643685 (task 1268 ms: download 651 ms overlapping gunzip 30 ms, parse 94 ms, sort 2 ms, write 253 ms, index 38 ms: 0 candidates, 2269 repo-hours, 62 releases; waiting 536 ms; commit 899 ms)
2026-11-07T04:19:18Z [load_day 2026-09-03] 2026-09-03 hour 4: 2448 events in 1 files, snapshot 3161815074885341193 (task 1497 ms: download 887 ms overlapping gunzip 30 ms, parse 91 ms, sort 3 ms, write 241 ms, index 60 ms: 1 candidates, 2179 repo-hours, 73 releases; waiting 775 ms; commit 674 ms)
2026-11-07T04:19:19Z [load_day 2026-09-03] 2026-09-03 hour 5: 2228 events in 1 files, snapshot 1191295832345427516 (task 1240 ms: download 641 ms overlapping gunzip 30 ms, parse 90 ms, sort 2 ms, write 229 ms, index 39 ms: 2 candidates, 1972 repo-hours, 62 releases; waiting 534 ms; commit 857 ms)
2026-11-07T04:19:20Z [load_day 2026-09-03] 2026-09-03 hour 6: 2158 events in 1 files, snapshot 8696456946455668154 (task 1144 ms: download 587 ms overlapping gunzip 25 ms, parse 69 ms, sort 2 ms, write 210 ms, index 36 ms: 0 candidates, 1992 repo-hours, 65 releases; waiting 500 ms; commit 890 ms)
2026-11-07T04:19:21Z [load_day 2026-09-03] 2026-09-03 hour 7: 2205 events in 1 files, snapshot 7868992836270716933 (task 1227 ms: download 645 ms overlapping gunzip 33 ms, parse 91 ms, sort 2 ms, write 230 ms, index 29 ms: 0 candidates, 2035 repo-hours, 58 releases; waiting 534 ms; commit 893 ms)
2026-11-07T04:19:22Z [load_day 2026-09-03] 2026-09-03 hour 8: 2459 events in 1 files, snapshot 3440396325219382649 (task 1213 ms: download 660 ms overlapping gunzip 30 ms, parse 94 ms, sort 3 ms, write 233 ms, index 36 ms: 0 candidates, 2224 repo-hours, 70 releases; waiting 549 ms; commit 735 ms)
2026-11-07T04:19:23Z [load_day 2026-09-03] 2026-09-03 hour 9: 2503 events in 1 files, snapshot 8339635756267744925 (task 1285 ms: download 671 ms overlapping gunzip 34 ms, parse 97 ms, sort 2 ms, write 255 ms, index 101 ms: 0 candidates, 2305 repo-hours, 86 releases; waiting 547 ms; commit 737 ms)
2026-11-07T04:19:24Z [load_day 2026-09-03] 2026-09-03 hour 10: 2254 events in 1 files, snapshot 703400070495006590 (task 1298 ms: download 657 ms overlapping gunzip 30 ms, parse 87 ms, sort 2 ms, write 240 ms, index 36 ms: 0 candidates, 2083 repo-hours, 70 releases; waiting 551 ms; commit 712 ms)
2026-11-07T04:19:25Z [load_day 2026-09-03] 2026-09-03 hour 11: 2693 events in 1 files, snapshot 5961617695594021689 (task 1250 ms: download 685 ms overlapping gunzip 32 ms, parse 97 ms, sort 3 ms, write 251 ms, index 34 ms: 0 candidates, 2472 repo-hours, 90 releases; waiting 567 ms; commit 744 ms)
2026-11-07T04:19:26Z [load_day 2026-09-03] 2026-09-03 hour 12: 2247 events in 1 files, snapshot 3342985067538174842 (task 1062 ms: download 484 ms overlapping gunzip 29 ms, parse 76 ms, sort 2 ms, write 235 ms, index 34 ms: 0 candidates, 2065 repo-hours, 61 releases; waiting 390 ms; commit 776 ms)
2026-11-07T04:19:27Z [load_day 2026-09-03] 2026-09-03 hour 13: 2344 events in 1 files, snapshot 1952433236679815737 (task 1162 ms: download 670 ms overlapping gunzip 32 ms, parse 89 ms, sort 2 ms, write 232 ms, index 34 ms: 0 candidates, 2158 repo-hours, 84 releases; waiting 558 ms; commit 804 ms)
2026-11-07T04:19:28Z [load_day 2026-09-03] 2026-09-03 hour 14: 2564 events in 1 files, snapshot 7113732368130473093 (task 1247 ms: download 654 ms overlapping gunzip 29 ms, parse 85 ms, sort 3 ms, write 232 ms, index 33 ms: 0 candidates, 2325 repo-hours, 97 releases; waiting 552 ms; commit 703 ms)
2026-11-07T04:19:29Z [load_day 2026-09-03] 2026-09-03 hour 15: 2149 events in 1 files, snapshot 6232020300995138037 (task 1259 ms: download 655 ms overlapping gunzip 28 ms, parse 82 ms, sort 2 ms, write 233 ms, index 63 ms: 0 candidates, 1974 repo-hours, 70 releases; waiting 553 ms; commit 807 ms)
2026-11-07T04:19:30Z [load_day 2026-09-03] 2026-09-03 hour 16: 2210 events in 1 files, snapshot 8711255136833895047 (task 1165 ms: download 656 ms overlapping gunzip 31 ms, parse 87 ms, sort 2 ms, write 241 ms, index 44 ms: 1 candidates, 2030 repo-hours, 71 releases; waiting 546 ms; commit 853 ms)
2026-11-07T04:19:30Z [load_day 2026-09-03] 2026-09-03 hour 17: 2205 events in 1 files, snapshot 1301417642251904589 (task 1219 ms: download 652 ms overlapping gunzip 30 ms, parse 85 ms, sort 2 ms, write 242 ms, index 41 ms: 1 candidates, 2043 repo-hours, 66 releases; waiting 545 ms; commit 734 ms)
2026-11-07T04:19:31Z [load_day 2026-09-03] 2026-09-03 hour 18: 2101 events in 1 files, snapshot 6922884818564396769 (task 1145 ms: download 652 ms overlapping gunzip 27 ms, parse 77 ms, sort 2 ms, write 237 ms, index 40 ms: 1 candidates, 1843 repo-hours, 47 releases; waiting 560 ms; commit 636 ms)
2026-11-07T04:19:32Z [load_day 2026-09-03] 2026-09-03 hour 19: 2047 events in 1 files, snapshot 1389154677215902930 (task 1161 ms: download 657 ms overlapping gunzip 25 ms, parse 73 ms, sort 2 ms, write 246 ms, index 29 ms: 0 candidates, 1853 repo-hours, 45 releases; waiting 568 ms; commit 539 ms)
2026-11-07T04:19:33Z [load_day 2026-09-03] 2026-09-03 hour 20: 2392 events in 1 files, snapshot 6367756455214161343 (task 1293 ms: download 692 ms overlapping gunzip 34 ms, parse 98 ms, sort 3 ms, write 258 ms, index 32 ms: 0 candidates, 2099 repo-hours, 57 releases; waiting 569 ms; commit 563 ms)
2026-11-07T04:19:37Z [load_day 2026-09-03] 2026-09-03 hour 21: 27505 events in 1 files, snapshot 6985752592631243525 (task 4361 ms: download 1484 ms overlapping gunzip 267 ms, parse 789 ms, sort 85 ms, write 2233 ms, index 156 ms: 1 candidates, 16280 repo-hours, 649 releases; waiting 608 ms; commit 815 ms)
2026-11-07T04:19:39Z [load_day 2026-09-03] 2026-09-03 hour 22: 37224 events in 1 files, snapshot 631385229679767607 (task 5651 ms: download 2126 ms overlapping gunzip 420 ms, parse 1298 ms, sort 128 ms, write 2592 ms, index 176 ms: 3 candidates, 20434 repo-hours, 888 releases; waiting 722 ms; commit 736 ms)
2026-11-07T04:19:44Z [load_day 2026-09-03] 2026-09-03 hour 23: 45019 events in 1 files, snapshot 518084693822534456 (task 5741 ms: download 2304 ms overlapping gunzip 415 ms, parse 1237 ms, sort 147 ms, write 2730 ms, index 150 ms: 8 candidates, 22507 repo-hours, 1232 releases; waiting 757 ms; commit 884 ms)
2026-11-07T04:19:45Z [load_day 2026-09-03] 2026-09-03: repo_hour merged from 24 files to 1 (104148 rows, 1590 ms)
2026-11-07T04:19:47Z [load_day 2026-09-03] 2026-09-03: index committed in 3135 ms (10 + 1 + 24 files)
2026-11-07T04:19:47Z [load_day 2026-09-03] 2026-09-03: 159276 events in 24 hours
2026-11-07T04:19:47Z [load_day 2026-09-03] attempt 1 succeeded