orcaLog in

Runs · run 47

load_day 2026-11-02, attempt 1 succeeded

Host
4e84322b8c45:13879
Started
2026-11-07T03:24:09Z
Ended
2026-11-07T03:24:34Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/47/load_day/2026-11-02/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:24:09Z [load_day 2026-11-02] attempt 1 started
2026-11-07T03:24:13Z [load_day 2026-11-02] 2026-11-02 hour 0: 4716 events in 1 files, snapshot 8116538481195112937 (task 1061 ms: download 134 ms overlapping gunzip 48 ms, parse 150 ms, sort 14 ms, write 561 ms, index 80 ms: 1 candidates, 3981 repo-hours, 146 releases; waiting 9 ms; commit 602 ms)
2026-11-07T03:24:13Z [load_day 2026-11-02] 2026-11-02 hour 1: 4871 events in 1 files, snapshot 8189414228598564862 (task 1136 ms: download 105 ms overlapping gunzip 68 ms, parse 180 ms, sort 14 ms, write 612 ms, index 47 ms: 0 candidates, 4253 repo-hours, 168 releases; waiting 11 ms; commit 582 ms)
2026-11-07T03:24:15Z [load_day 2026-11-02] 2026-11-02 hour 2: 5176 events in 1 files, snapshot 2380752832791129299 (task 1765 ms: download 786 ms overlapping gunzip 59 ms, parse 178 ms, sort 7 ms, write 587 ms, index 41 ms: 0 candidates, 4455 repo-hours, 173 releases; waiting 575 ms; commit 437 ms)
2026-11-07T03:24:15Z [load_day 2026-11-02] 2026-11-02 hour 3: 4566 events in 1 files, snapshot 4608166065853241215 (task 1036 ms: download 124 ms overlapping gunzip 46 ms, parse 124 ms, sort 6 ms, write 596 ms, index 60 ms: 1 candidates, 3935 repo-hours, 150 releases; waiting 17 ms; commit 722 ms)
2026-11-07T03:24:16Z [load_day 2026-11-02] 2026-11-02 hour 4: 4567 events in 1 files, snapshot 5841143727086042308 (task 900 ms: download 96 ms overlapping gunzip 47 ms, parse 132 ms, sort 6 ms, write 464 ms, index 39 ms: 0 candidates, 3979 repo-hours, 166 releases; waiting 17 ms; commit 591 ms)
2026-11-07T03:24:17Z [load_day 2026-11-02] 2026-11-02 hour 5: 4733 events in 1 files, snapshot 5117536716715575560 (task 925 ms: download 103 ms overlapping gunzip 46 ms, parse 127 ms, sort 6 ms, write 459 ms, index 82 ms: 1 candidates, 4041 repo-hours, 143 releases; waiting 17 ms; commit 560 ms)
2026-11-07T03:24:17Z [load_day 2026-11-02] 2026-11-02 hour 6: 4546 events in 1 files, snapshot 7689216212574099772 (task 872 ms: download 110 ms overlapping gunzip 47 ms, parse 121 ms, sort 5 ms, write 452 ms, index 44 ms: 0 candidates, 3978 repo-hours, 205 releases; waiting 20 ms; commit 517 ms)
2026-11-07T03:24:19Z [load_day 2026-11-02] 2026-11-02 hour 7: 4840 events in 1 files, snapshot 957109107542898365 (task 1677 ms: download 787 ms overlapping gunzip 61 ms, parse 183 ms, sort 6 ms, write 493 ms, index 56 ms: 0 candidates, 4268 repo-hours, 280 releases; waiting 568 ms; commit 576 ms)
2026-11-07T03:24:20Z [load_day 2026-11-02] 2026-11-02 hour 8: 4524 events in 1 files, snapshot 5360586453966863183 (task 918 ms: download 164 ms overlapping gunzip 52 ms, parse 151 ms, sort 5 ms, write 451 ms, index 44 ms: 0 candidates, 4033 repo-hours, 205 releases; waiting 21 ms; commit 816 ms)
2026-11-07T03:24:20Z [load_day 2026-11-02] 2026-11-02 hour 9: 4585 events in 1 files, snapshot 4824559249047138632 (task 860 ms: download 89 ms overlapping gunzip 42 ms, parse 120 ms, sort 4 ms, write 423 ms, index 58 ms: 0 candidates, 4146 repo-hours, 166 releases; waiting 16 ms; commit 619 ms)
2026-11-07T03:24:21Z [load_day 2026-11-02] 2026-11-02 hour 10: 4108 events in 1 files, snapshot 2878236720396864548 (task 787 ms: download 88 ms overlapping gunzip 37 ms, parse 94 ms, sort 4 ms, write 395 ms, index 41 ms: 0 candidates, 3692 repo-hours, 172 releases; waiting 16 ms; commit 557 ms)
2026-11-07T03:24:22Z [load_day 2026-11-02] 2026-11-02 hour 11: 4387 events in 1 files, snapshot 1514689454641500762 (task 806 ms: download 95 ms overlapping gunzip 40 ms, parse 113 ms, sort 5 ms, write 413 ms, index 37 ms: 0 candidates, 3949 repo-hours, 182 releases; waiting 15 ms; commit 466 ms)
2026-11-07T03:24:23Z [load_day 2026-11-02] 2026-11-02 hour 12: 4497 events in 1 files, snapshot 3077979092524000526 (task 756 ms: download 95 ms overlapping gunzip 46 ms, parse 128 ms, sort 5 ms, write 444 ms, index 58 ms: 1 candidates, 4068 repo-hours, 236 releases; waiting 15 ms; commit 860 ms)
2026-11-07T03:24:24Z [load_day 2026-11-02] 2026-11-02 hour 13: 4333 events in 1 files, snapshot 3673977503571488194 (task 653 ms: download 86 ms overlapping gunzip 37 ms, parse 101 ms, sort 4 ms, write 394 ms, index 40 ms: 0 candidates, 3972 repo-hours, 272 releases; waiting 16 ms; commit 1277 ms)
2026-11-07T03:24:24Z [load_day 2026-11-02] 2026-11-02 hour 14: 4368 events in 1 files, snapshot 8692935038325057613 (task 745 ms: download 89 ms overlapping gunzip 39 ms, parse 104 ms, sort 4 ms, write 402 ms, index 112 ms: 0 candidates, 4011 repo-hours, 288 releases; waiting 17 ms; commit 528 ms)
2026-11-07T03:24:25Z [load_day 2026-11-02] 2026-11-02 hour 15: 4630 events in 1 files, snapshot 2921704812827416947 (task 745 ms: download 93 ms overlapping gunzip 45 ms, parse 117 ms, sort 6 ms, write 443 ms, index 56 ms: 1 candidates, 4197 repo-hours, 275 releases; waiting 16 ms; commit 609 ms)
2026-11-07T03:24:26Z [load_day 2026-11-02] 2026-11-02 hour 16: 7256 events in 1 files, snapshot 6363920573380958365 (task 649 ms: download 85 ms overlapping gunzip 40 ms, parse 102 ms, sort 5 ms, write 366 ms, index 56 ms: 0 candidates, 6580 repo-hours, 157 releases; waiting 19 ms; commit 630 ms)
2026-11-07T03:24:26Z [load_day 2026-11-02] 2026-11-02 hour 17: 17645 events in 1 files, snapshot 238987266715464840 (task 976 ms: download 121 ms overlapping gunzip 56 ms, parse 164 ms, sort 12 ms, write 511 ms, index 142 ms: 4 candidates, 14730 repo-hours, 195 releases; waiting 18 ms; commit 551 ms)
2026-11-07T03:24:27Z [load_day 2026-11-02] 2026-11-02 hour 18: 9772 events in 1 files, snapshot 3035221000831586217 (task 677 ms: download 87 ms overlapping gunzip 43 ms, parse 119 ms, sort 6 ms, write 361 ms, index 83 ms: 1 candidates, 8597 repo-hours, 175 releases; waiting 17 ms; commit 701 ms)
2026-11-07T03:24:28Z [load_day 2026-11-02] 2026-11-02 hour 19: 3946 events in 1 files, snapshot 7265923455251150466 (task 603 ms: download 79 ms overlapping gunzip 37 ms, parse 95 ms, sort 4 ms, write 322 ms, index 69 ms: 2 candidates, 3550 repo-hours, 146 releases; waiting 17 ms; commit 474 ms)
2026-11-07T03:24:28Z [load_day 2026-11-02] 2026-11-02 hour 20: 3588 events in 1 files, snapshot 7860684947060355757 (task 587 ms: download 74 ms overlapping gunzip 36 ms, parse 89 ms, sort 4 ms, write 322 ms, index 54 ms: 2 candidates, 3211 repo-hours, 132 releases; waiting 15 ms; commit 471 ms)
2026-11-07T03:24:29Z [load_day 2026-11-02] 2026-11-02 hour 21: 3957 events in 1 files, snapshot 971893672912890376 (task 579 ms: download 81 ms overlapping gunzip 37 ms, parse 93 ms, sort 4 ms, write 320 ms, index 48 ms: 1 candidates, 3528 repo-hours, 158 releases; waiting 21 ms; commit 595 ms)
2026-11-07T03:24:30Z [load_day 2026-11-02] 2026-11-02 hour 22: 3710 events in 1 files, snapshot 1999262885665131245 (task 588 ms: download 75 ms overlapping gunzip 32 ms, parse 87 ms, sort 3 ms, write 354 ms, index 36 ms: 0 candidates, 3300 repo-hours, 149 releases; waiting 17 ms; commit 718 ms)
2026-11-07T03:24:30Z [load_day 2026-11-02] 2026-11-02 hour 23: 3744 events in 1 files, snapshot 160664721153727463 (task 598 ms: download 78 ms overlapping gunzip 37 ms, parse 103 ms, sort 4 ms, write 340 ms, index 41 ms: 0 candidates, 3256 repo-hours, 161 releases; waiting 16 ms; commit 504 ms)
2026-11-07T03:24:32Z [load_day 2026-11-02] 2026-11-02: repo_hour merged from 24 files to 1 (111710 rows, 1544 ms)
2026-11-07T03:24:34Z [load_day 2026-11-02] 2026-11-02: index committed in 3518 ms (10 + 1 + 24 files)
2026-11-07T03:24:34Z [load_day 2026-11-02] 2026-11-02: 127065 events in 24 hours
2026-11-07T03:24:34Z [load_day 2026-11-02] attempt 1 succeeded