orcaLog in

Runs · run 14

load_day 2026-11-06, attempt 1 succeeded

Host
4e84322b8c45:5647
Started
2026-11-07T03:00:00Z
Ended
2026-11-07T03:00:32Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/14/load_day/2026-11-06/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:00:00Z [load_day 2026-11-06] attempt 1 started
2026-11-07T03:00:11Z [load_day 2026-11-06] 2026-11-06 hour 0: 3178 events in 1 files, snapshot 7915228580281789 (task 902 ms: download 178 ms overlapping gunzip 51 ms, parse 174 ms, sort 4 ms, write 524 ms, index 68 ms: 1 candidates, 2824 repo-hours, 103 releases; waiting 5 ms; commit 7517 ms)
2026-11-07T03:00:12Z [load_day 2026-11-06] 2026-11-06 hour 1: 3163 events in 1 files, snapshot 3512916714311598460 (task 938 ms: download 136 ms overlapping gunzip 51 ms, parse 177 ms, sort 7 ms, write 555 ms, index 48 ms: 0 candidates, 2823 repo-hours, 124 releases; waiting 0 ms; commit 692 ms)
2026-11-07T03:00:12Z [load_day 2026-11-06] 2026-11-06 hour 2: 3846 events in 1 files, snapshot 5927953495766755521 (task 1654 ms: download 160 ms overlapping gunzip 111 ms, parse 275 ms, sort 5 ms, write 469 ms, index 666 ms: 0 candidates, 3402 repo-hours, 189 releases; waiting 21 ms; commit 600 ms)
2026-11-07T03:00:13Z [load_day 2026-11-06] 2026-11-06 hour 3: 3768 events in 1 files, snapshot 1165041323438540631 (task 733 ms: download 125 ms overlapping gunzip 44 ms, parse 121 ms, sort 4 ms, write 418 ms, index 39 ms: 0 candidates, 3389 repo-hours, 188 releases; waiting 25 ms; commit 554 ms)
2026-11-07T03:00:14Z [load_day 2026-11-06] 2026-11-06 hour 4: 3565 events in 1 files, snapshot 4110794407929414774 (task 684 ms: download 83 ms overlapping gunzip 34 ms, parse 108 ms, sort 5 ms, write 395 ms, index 78 ms: 0 candidates, 3171 repo-hours, 171 releases; waiting 16 ms; commit 561 ms)
2026-11-07T03:00:14Z [load_day 2026-11-06] 2026-11-06 hour 5: 4104 events in 1 files, snapshot 5457611764594439440 (task 812 ms: download 105 ms overlapping gunzip 41 ms, parse 130 ms, sort 4 ms, write 461 ms, index 114 ms: 1 candidates, 3631 repo-hours, 229 releases; waiting 11 ms; commit 640 ms)
2026-11-07T03:00:16Z [load_day 2026-11-06] 2026-11-06 hour 6: 11966 events in 1 files, snapshot 2724027633467207135 (task 1148 ms: download 275 ms overlapping gunzip 135 ms, parse 341 ms, sort 16 ms, write 484 ms, index 92 ms: 0 candidates, 10030 repo-hours, 216 releases; waiting 22 ms; commit 930 ms)
2026-11-07T03:00:16Z [load_day 2026-11-06] 2026-11-06 hour 7: 15633 events in 1 files, snapshot 8833160305628196603 (task 848 ms: download 101 ms overlapping gunzip 46 ms, parse 124 ms, sort 9 ms, write 488 ms, index 110 ms: 3 candidates, 12887 repo-hours, 113 releases; waiting 19 ms; commit 649 ms)
2026-11-07T03:00:17Z [load_day 2026-11-06] 2026-11-06 hour 8: 13102 events in 1 files, snapshot 3296673235507158929 (task 1071 ms: download 193 ms overlapping gunzip 54 ms, parse 169 ms, sort 9 ms, write 559 ms, index 182 ms: 2 candidates, 10929 repo-hours, 179 releases; waiting 18 ms; commit 473 ms)
2026-11-07T03:00:18Z [load_day 2026-11-06] 2026-11-06 hour 9: 8297 events in 1 files, snapshot 4143995754375391550 (task 913 ms: download 151 ms overlapping gunzip 62 ms, parse 160 ms, sort 6 ms, write 436 ms, index 154 ms: 2 candidates, 7241 repo-hours, 147 releases; waiting 19 ms; commit 559 ms)
2026-11-07T03:00:19Z [load_day 2026-11-06] 2026-11-06 hour 10: 3927 events in 1 files, snapshot 2770327247255425061 (task 904 ms: download 127 ms overlapping gunzip 48 ms, parse 106 ms, sort 9 ms, write 590 ms, index 61 ms: 0 candidates, 3607 repo-hours, 177 releases; waiting 19 ms; commit 909 ms)
2026-11-07T03:00:20Z [load_day 2026-11-06] 2026-11-06 hour 11: 3206 events in 1 files, snapshot 2764371779932321916 (task 654 ms: download 145 ms overlapping gunzip 54 ms, parse 122 ms, sort 6 ms, write 317 ms, index 43 ms: 1 candidates, 2933 repo-hours, 135 releases; waiting 25 ms; commit 574 ms)
2026-11-07T03:00:20Z [load_day 2026-11-06] 2026-11-06 hour 12: 3064 events in 1 files, snapshot 8484430983920416927 (task 501 ms: download 63 ms overlapping gunzip 27 ms, parse 75 ms, sort 3 ms, write 291 ms, index 35 ms: 0 candidates, 2775 repo-hours, 168 releases; waiting 17 ms; commit 766 ms)
2026-11-07T03:00:21Z [load_day 2026-11-06] 2026-11-06 hour 13: 3510 events in 1 files, snapshot 6684919730185109609 (task 677 ms: download 77 ms overlapping gunzip 35 ms, parse 96 ms, sort 3 ms, write 404 ms, index 72 ms: 1 candidates, 3193 repo-hours, 203 releases; waiting 17 ms; commit 727 ms)
2026-11-07T03:00:22Z [load_day 2026-11-06] 2026-11-06 hour 14: 3505 events in 1 files, snapshot 5210718259725724285 (task 733 ms: download 124 ms overlapping gunzip 60 ms, parse 123 ms, sort 3 ms, write 393 ms, index 64 ms: 1 candidates, 3207 repo-hours, 221 releases; waiting 20 ms; commit 619 ms)
2026-11-07T03:00:22Z [load_day 2026-11-06] 2026-11-06 hour 15: 3146 events in 1 files, snapshot 3006229988975072635 (task 717 ms: download 121 ms overlapping gunzip 40 ms, parse 99 ms, sort 3 ms, write 431 ms, index 59 ms: 1 candidates, 2922 repo-hours, 189 releases; waiting 23 ms; commit 651 ms)
2026-11-07T03:00:23Z [load_day 2026-11-06] 2026-11-06 hour 16: 3079 events in 1 files, snapshot 5499733322121171086 (task 975 ms: download 136 ms overlapping gunzip 59 ms, parse 177 ms, sort 6 ms, write 557 ms, index 77 ms: 0 candidates, 2838 repo-hours, 150 releases; waiting 29 ms; commit 619 ms)
2026-11-07T03:00:24Z [load_day 2026-11-06] 2026-11-06 hour 17: 3499 events in 1 files, snapshot 2405858873972784748 (task 904 ms: download 238 ms overlapping gunzip 70 ms, parse 210 ms, sort 4 ms, write 468 ms, index 41 ms: 0 candidates, 3136 repo-hours, 131 releases; waiting 31 ms; commit 556 ms)
2026-11-07T03:00:25Z [load_day 2026-11-06] 2026-11-06 hour 18: 3693 events in 1 files, snapshot 8501059239840110569 (task 631 ms: download 73 ms overlapping gunzip 37 ms, parse 86 ms, sort 3 ms, write 370 ms, index 38 ms: 0 candidates, 3328 repo-hours, 156 releases; waiting 18 ms; commit 763 ms)
2026-11-07T03:00:25Z [load_day 2026-11-06] 2026-11-06 hour 19: 3373 events in 1 files, snapshot 2170113812664989527 (task 614 ms: download 77 ms overlapping gunzip 33 ms, parse 83 ms, sort 4 ms, write 370 ms, index 39 ms: 0 candidates, 3040 repo-hours, 129 releases; waiting 18 ms; commit 628 ms)
2026-11-07T03:00:26Z [load_day 2026-11-06] 2026-11-06 hour 20: 3758 events in 1 files, snapshot 7886868582348379658 (task 719 ms: download 114 ms overlapping gunzip 42 ms, parse 112 ms, sort 4 ms, write 441 ms, index 52 ms: 0 candidates, 3336 repo-hours, 141 releases; waiting 17 ms; commit 713 ms)
2026-11-07T03:00:27Z [load_day 2026-11-06] 2026-11-06 hour 21: 4086 events in 1 files, snapshot 1077811475476972799 (task 1072 ms: download 97 ms overlapping gunzip 44 ms, parse 128 ms, sort 5 ms, write 747 ms, index 62 ms: 2 candidates, 3559 repo-hours, 153 releases; waiting 17 ms; commit 495 ms)
2026-11-07T03:00:28Z [load_day 2026-11-06] 2026-11-06 hour 22: 4219 events in 1 files, snapshot 7186797588376031211 (task 892 ms: download 170 ms overlapping gunzip 102 ms, parse 201 ms, sort 5 ms, write 438 ms, index 51 ms: 0 candidates, 3651 repo-hours, 171 releases; waiting 15 ms; commit 573 ms)
2026-11-07T03:00:29Z [load_day 2026-11-06] 2026-11-06 hour 23: 4370 events in 1 files, snapshot 5719204550882830899 (task 1073 ms: download 227 ms overlapping gunzip 77 ms, parse 189 ms, sort 5 ms, write 654 ms, index 48 ms: 0 candidates, 3717 repo-hours, 176 releases; waiting 30 ms; commit 705 ms)
2026-11-07T03:00:31Z [load_day 2026-11-06] 2026-11-06: repo_hour merged from 24 files to 1 (105569 rows, 1778 ms)
2026-11-07T03:00:32Z [load_day 2026-11-06] 2026-11-06: index committed in 3493 ms (10 + 1 + 24 files)
2026-11-07T03:00:32Z [load_day 2026-11-06] 2026-11-06: 121057 events in 24 hours
2026-11-07T03:00:32Z [load_day 2026-11-06] attempt 1 succeeded