orcaLog in

Runs · run 317

load_day 2026-08-04, attempt 1 succeeded

Host
4e84322b8c45:56383
Started
2026-11-07T04:45:44Z
Ended
2026-11-07T04:46:40Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/317/load_day/2026-08-04/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:45:44Z [load_day 2026-08-04] attempt 1 started
2026-11-07T04:45:50Z [load_day 2026-08-04] 2026-08-04 hour 0: 165861 events in 4 files, snapshot 8648842971505905334 (task 3821 ms: download 1964 ms overlapping gunzip 196 ms, parse 771 ms, sort 108 ms, write 1666 ms, index 268 ms: 1 candidates, 36343 repo-hours, 13 releases; waiting 499 ms; commit 708 ms)
2026-11-07T04:45:51Z [load_day 2026-08-04] 2026-08-04 hour 1: 163670 events in 4 files, snapshot 3447743915318496860 (task 3864 ms: download 1531 ms overlapping gunzip 186 ms, parse 751 ms, sort 108 ms, write 1708 ms, index 311 ms: 6 candidates, 44154 repo-hours, 10 releases; waiting 506 ms; commit 750 ms)
2026-11-07T04:45:55Z [load_day 2026-08-04] 2026-08-04 hour 2: 162850 events in 4 files, snapshot 2536548825291191449 (task 3696 ms: download 1228 ms overlapping gunzip 198 ms, parse 764 ms, sort 110 ms, write 1573 ms, index 320 ms: 6 candidates, 45054 repo-hours, 25 releases; waiting 504 ms; commit 996 ms)
2026-11-07T04:45:56Z [load_day 2026-08-04] 2026-08-04 hour 3: 164124 events in 4 files, snapshot 5017893154024941394 (task 3843 ms: download 1595 ms overlapping gunzip 203 ms, parse 777 ms, sort 101 ms, write 1714 ms, index 188 ms: 3 candidates, 28568 repo-hours, 50 releases; waiting 528 ms; commit 784 ms)
2026-11-07T04:45:59Z [load_day 2026-08-04] 2026-08-04 hour 4: 166573 events in 4 files, snapshot 1332888597611997639 (task 3625 ms: download 1666 ms overlapping gunzip 188 ms, parse 763 ms, sort 117 ms, write 1565 ms, index 147 ms: 0 candidates, 23325 repo-hours, 12 releases; waiting 535 ms; commit 829 ms)
2026-11-07T04:46:00Z [load_day 2026-08-04] 2026-08-04 hour 5: 172302 events in 4 files, snapshot 8020278757669646421 (task 3625 ms: download 1545 ms overlapping gunzip 198 ms, parse 764 ms, sort 115 ms, write 1555 ms, index 161 ms: 1 candidates, 22291 repo-hours, 4 releases; waiting 529 ms; commit 703 ms)
2026-11-07T04:46:03Z [load_day 2026-08-04] 2026-08-04 hour 6: 165112 events in 4 files, snapshot 4297763424932697793 (task 3523 ms: download 1341 ms overlapping gunzip 184 ms, parse 747 ms, sort 107 ms, write 1527 ms, index 152 ms: 4 candidates, 23796 repo-hours, 3 releases; waiting 531 ms; commit 897 ms)
2026-11-07T04:46:04Z [load_day 2026-08-04] 2026-08-04 hour 7: 162331 events in 4 files, snapshot 7467967177410853972 (task 3619 ms: download 1287 ms overlapping gunzip 193 ms, parse 742 ms, sort 100 ms, write 1440 ms, index 312 ms: 1 candidates, 25300 repo-hours, 5 releases; waiting 534 ms; commit 881 ms)
2026-11-07T04:46:08Z [load_day 2026-08-04] 2026-08-04 hour 8: 158971 events in 4 files, snapshot 5915969752226459226 (task 3389 ms: download 1262 ms overlapping gunzip 179 ms, parse 704 ms, sort 100 ms, write 1436 ms, index 170 ms: 2 candidates, 26011 repo-hours, 17 releases; waiting 522 ms; commit 920 ms)
2026-11-07T04:46:08Z [load_day 2026-08-04] 2026-08-04 hour 9: 143383 events in 3 files, snapshot 4522702183521971761 (task 3129 ms: download 1349 ms overlapping gunzip 171 ms, parse 689 ms, sort 93 ms, write 1274 ms, index 160 ms: 1 candidates, 24241 repo-hours, 6 releases; waiting 524 ms; commit 887 ms)
2026-11-07T04:46:11Z [load_day 2026-08-04] 2026-08-04 hour 10: 128438 events in 3 files, snapshot 3353606962374890933 (task 3219 ms: download 1150 ms overlapping gunzip 165 ms, parse 638 ms, sort 84 ms, write 1310 ms, index 178 ms: 0 candidates, 25228 repo-hours, 14 releases; waiting 562 ms; commit 939 ms)
2026-11-07T04:46:12Z [load_day 2026-08-04] 2026-08-04 hour 11: 132991 events in 3 files, snapshot 8782321458342742396 (task 3067 ms: download 1173 ms overlapping gunzip 158 ms, parse 613 ms, sort 85 ms, write 1236 ms, index 200 ms: 4 candidates, 31061 repo-hours, 16 releases; waiting 476 ms; commit 1014 ms)
2026-11-07T04:46:15Z [load_day 2026-08-04] 2026-08-04 hour 12: 146386 events in 3 files, snapshot 366742860777650075 (task 3377 ms: download 1186 ms overlapping gunzip 167 ms, parse 652 ms, sort 89 ms, write 1398 ms, index 176 ms: 3 candidates, 26319 repo-hours, 5 releases; waiting 558 ms; commit 793 ms)
2026-11-07T04:46:17Z [load_day 2026-08-04] 2026-08-04 hour 13: 129707 events in 3 files, snapshot 9007212158208210681 (task 3197 ms: download 1140 ms overlapping gunzip 157 ms, parse 613 ms, sort 92 ms, write 1318 ms, index 153 ms: 1 candidates, 23676 repo-hours, 9 releases; waiting 543 ms; commit 1131 ms)
2026-11-07T04:46:19Z [load_day 2026-08-04] 2026-08-04 hour 14: 103779 events in 3 files, snapshot 8375476591140840481 (task 2854 ms: download 997 ms overlapping gunzip 134 ms, parse 529 ms, sort 77 ms, write 1031 ms, index 165 ms: 2 candidates, 24945 repo-hours, 11 releases; waiting 529 ms; commit 860 ms)
2026-11-07T04:46:20Z [load_day 2026-08-04] 2026-08-04 hour 15: 88619 events in 2 files, snapshot 988039155633440809 (task 2612 ms: download 1013 ms overlapping gunzip 108 ms, parse 440 ms, sort 53 ms, write 795 ms, index 161 ms: 3 candidates, 21838 repo-hours, 12 releases; waiting 542 ms; commit 1180 ms)
2026-11-07T04:46:22Z [load_day 2026-08-04] 2026-08-04 hour 16: 88244 events in 2 files, snapshot 6591308174025611311 (task 2508 ms: download 933 ms overlapping gunzip 117 ms, parse 449 ms, sort 64 ms, write 871 ms, index 141 ms: 2 candidates, 20426 repo-hours, 12 releases; waiting 519 ms; commit 1012 ms)
2026-11-07T04:46:23Z [load_day 2026-08-04] 2026-08-04 hour 17: 87573 events in 2 files, snapshot 4735365814538991289 (task 2497 ms: download 1002 ms overlapping gunzip 114 ms, parse 454 ms, sort 55 ms, write 825 ms, index 148 ms: 1 candidates, 21697 repo-hours, 20 releases; waiting 508 ms; commit 929 ms)
2026-11-07T04:46:25Z [load_day 2026-08-04] 2026-08-04 hour 18: 91601 events in 2 files, snapshot 9071258660058510925 (task 2334 ms: download 973 ms overlapping gunzip 116 ms, parse 440 ms, sort 56 ms, write 794 ms, index 149 ms: 2 candidates, 23228 repo-hours, 29 releases; waiting 545 ms; commit 927 ms)
2026-11-07T04:46:27Z [load_day 2026-08-04] 2026-08-04 hour 19: 106080 events in 3 files, snapshot 3158508335509228529 (task 2628 ms: download 1010 ms overlapping gunzip 131 ms, parse 504 ms, sort 73 ms, write 948 ms, index 165 ms: 1 candidates, 25272 repo-hours, 30 releases; waiting 530 ms; commit 986 ms)
2026-11-07T04:46:29Z [load_day 2026-08-04] 2026-08-04 hour 20: 115135 events in 3 files, snapshot 7568373589998834426 (task 2933 ms: download 1071 ms overlapping gunzip 153 ms, parse 554 ms, sort 78 ms, write 1102 ms, index 202 ms: 2 candidates, 26338 repo-hours, 7 releases; waiting 518 ms; commit 958 ms)
2026-11-07T04:46:30Z [load_day 2026-08-04] 2026-08-04 hour 21: 124668 events in 3 files, snapshot 5217280390796693174 (task 3069 ms: download 1087 ms overlapping gunzip 144 ms, parse 575 ms, sort 80 ms, write 1225 ms, index 195 ms: 1 candidates, 28185 repo-hours, 14 releases; waiting 530 ms; commit 1059 ms)
2026-11-07T04:46:32Z [load_day 2026-08-04] 2026-08-04 hour 22: 147180 events in 3 files, snapshot 8044559743671662732 (task 3363 ms: download 1419 ms overlapping gunzip 174 ms, parse 673 ms, sort 99 ms, write 1435 ms, index 204 ms: 2 candidates, 32276 repo-hours, 23 releases; waiting 534 ms; commit 732 ms)
2026-11-07T04:46:35Z [load_day 2026-08-04] 2026-08-04 hour 23: 166137 events in 4 files, snapshot 5819478236009513038 (task 3628 ms: download 1194 ms overlapping gunzip 201 ms, parse 792 ms, sort 124 ms, write 1515 ms, index 241 ms: 5 candidates, 35781 repo-hours, 13 releases; waiting 525 ms; commit 1015 ms)
2026-11-07T04:46:38Z [load_day 2026-08-04] 2026-08-04: repo_hour merged from 24 files to 1 (665353 rows, 3503 ms)
2026-11-07T04:46:40Z [load_day 2026-08-04] 2026-08-04: index committed in 5291 ms (22 + 1 + 24 files)
2026-11-07T04:46:40Z [load_day 2026-08-04] 2026-08-04: 3281715 events in 24 hours
2026-11-07T04:46:40Z [load_day 2026-08-04] attempt 1 succeeded