orcaLog in

Runs · run 278

load_day 2026-08-17, attempt 1 succeeded

Host
4e84322b8c45:46173
Started
2026-11-07T04:31:10Z
Ended
2026-11-07T04:32:03Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/278/load_day/2026-08-17/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:31:10Z [load_day 2026-08-17] attempt 1 started
2026-11-07T04:31:17Z [load_day 2026-08-17] 2026-08-17 hour 0: 171569 events in 4 files, snapshot 6506015240750152958 (task 4025 ms: download 1345 ms overlapping gunzip 207 ms, parse 837 ms, sort 118 ms, write 1775 ms, index 281 ms: 2 candidates, 45493 repo-hours, 12 releases; waiting 494 ms; commit 855 ms)
2026-11-07T04:31:17Z [load_day 2026-08-17] 2026-08-17 hour 1: 166262 events in 4 files, snapshot 2727296400007978375 (task 3900 ms: download 1204 ms overlapping gunzip 189 ms, parse 764 ms, sort 117 ms, write 1597 ms, index 312 ms: 4 candidates, 51129 repo-hours, 10 releases; waiting 527 ms; commit 746 ms)
2026-11-07T04:31:21Z [load_day 2026-08-17] 2026-08-17 hour 2: 166174 events in 4 files, snapshot 4939050704098312326 (task 3807 ms: download 1230 ms overlapping gunzip 202 ms, parse 785 ms, sort 117 ms, write 1647 ms, index 270 ms: 4 candidates, 40617 repo-hours, 12 releases; waiting 524 ms; commit 982 ms)
2026-11-07T04:31:22Z [load_day 2026-08-17] 2026-08-17 hour 3: 170286 events in 4 files, snapshot 8796656864082067092 (task 3640 ms: download 1297 ms overlapping gunzip 202 ms, parse 762 ms, sort 107 ms, write 1574 ms, index 169 ms: 0 candidates, 27648 repo-hours, 5 releases; waiting 524 ms; commit 783 ms)
2026-11-07T04:31:25Z [load_day 2026-08-17] 2026-08-17 hour 4: 168497 events in 4 files, snapshot 8657793983038746063 (task 3686 ms: download 1650 ms overlapping gunzip 201 ms, parse 791 ms, sort 104 ms, write 1556 ms, index 172 ms: 1 candidates, 26522 repo-hours, 3 releases; waiting 523 ms; commit 825 ms)
2026-11-07T04:31:26Z [load_day 2026-08-17] 2026-08-17 hour 5: 167676 events in 4 files, snapshot 1666427251588314353 (task 3627 ms: download 1354 ms overlapping gunzip 197 ms, parse 805 ms, sort 120 ms, write 1579 ms, index 188 ms: 4 candidates, 27393 repo-hours, 6 releases; waiting 516 ms; commit 786 ms)
2026-11-07T04:31:29Z [load_day 2026-08-17] 2026-08-17 hour 6: 164446 events in 4 files, snapshot 9030127174641440906 (task 3438 ms: download 1178 ms overlapping gunzip 187 ms, parse 731 ms, sort 106 ms, write 1461 ms, index 215 ms: 2 candidates, 28198 repo-hours, 9 releases; waiting 516 ms; commit 988 ms)
2026-11-07T04:31:30Z [load_day 2026-08-17] 2026-08-17 hour 7: 159391 events in 4 files, snapshot 4808837894652005634 (task 3362 ms: download 1534 ms overlapping gunzip 188 ms, parse 721 ms, sort 98 ms, write 1428 ms, index 185 ms: 0 candidates, 28583 repo-hours, 14 releases; waiting 527 ms; commit 816 ms)
2026-11-07T04:31:33Z [load_day 2026-08-17] 2026-08-17 hour 8: 148658 events in 3 files, snapshot 3260827820251890443 (task 3249 ms: download 1269 ms overlapping gunzip 183 ms, parse 700 ms, sort 105 ms, write 1278 ms, index 154 ms: 0 candidates, 25340 repo-hours, 8 releases; waiting 504 ms; commit 697 ms)
2026-11-07T04:31:34Z [load_day 2026-08-17] 2026-08-17 hour 9: 124180 events in 3 files, snapshot 8615593772632741252 (task 3073 ms: download 1077 ms overlapping gunzip 155 ms, parse 587 ms, sort 75 ms, write 1250 ms, index 188 ms: 3 candidates, 22916 repo-hours, 15 releases; waiting 525 ms; commit 781 ms)
2026-11-07T04:31:36Z [load_day 2026-08-17] 2026-08-17 hour 10: 95787 events in 2 files, snapshot 6851430082184905649 (task 2389 ms: download 938 ms overlapping gunzip 116 ms, parse 448 ms, sort 64 ms, write 858 ms, index 158 ms: 1 candidates, 20718 repo-hours, 14 releases; waiting 520 ms; commit 766 ms)
2026-11-07T04:31:37Z [load_day 2026-08-17] 2026-08-17 hour 11: 82630 events in 2 files, snapshot 157155199015066351 (task 2378 ms: download 924 ms overlapping gunzip 112 ms, parse 426 ms, sort 54 ms, write 820 ms, index 151 ms: 2 candidates, 21588 repo-hours, 18 releases; waiting 536 ms; commit 763 ms)
2026-11-07T04:31:39Z [load_day 2026-08-17] 2026-08-17 hour 12: 79925 events in 2 files, snapshot 717179477837672653 (task 2333 ms: download 906 ms overlapping gunzip 103 ms, parse 389 ms, sort 50 ms, write 806 ms, index 170 ms: 2 candidates, 25600 repo-hours, 20 releases; waiting 525 ms; commit 1019 ms)
2026-11-07T04:31:40Z [load_day 2026-08-17] 2026-08-17 hour 13: 61267 events in 2 files, snapshot 6902166270285543251 (task 2023 ms: download 520 ms overlapping gunzip 90 ms, parse 342 ms, sort 37 ms, write 606 ms, index 144 ms: 1 candidates, 20772 repo-hours, 24 releases; waiting 214 ms; commit 925 ms)
2026-11-07T04:31:42Z [load_day 2026-08-17] 2026-08-17 hour 14: 38119 events in 1 files, snapshot 6787026827411930294 (task 1656 ms: download 766 ms overlapping gunzip 65 ms, parse 234 ms, sort 23 ms, write 390 ms, index 148 ms: 1 candidates, 20825 repo-hours, 25 releases; waiting 516 ms; commit 787 ms)
2026-11-07T04:31:43Z [load_day 2026-08-17] 2026-08-17 hour 15: 69413 events in 2 files, snapshot 2515784183666562510 (task 2362 ms: download 877 ms overlapping gunzip 99 ms, parse 376 ms, sort 45 ms, write 736 ms, index 259 ms: 6 candidates, 38410 repo-hours, 14 releases; waiting 541 ms; commit 648 ms)
2026-11-07T04:31:45Z [load_day 2026-08-17] 2026-08-17 hour 16: 132406 events in 3 files, snapshot 8529432162996020772 (task 3370 ms: download 1664 ms overlapping gunzip 167 ms, parse 631 ms, sort 85 ms, write 1260 ms, index 376 ms: 7 candidates, 61333 repo-hours, 22 releases; waiting 533 ms; commit 888 ms)
2026-11-07T04:31:46Z [load_day 2026-08-17] 2026-08-17 hour 17: 123805 events in 3 files, snapshot 19316586091233410 (task 2300 ms: download 327 ms overlapping gunzip 141 ms, parse 530 ms, sort 78 ms, write 1172 ms, index 153 ms: 6 candidates, 22926 repo-hours, 2 releases; waiting 18 ms; commit 808 ms)
2026-11-07T04:31:49Z [load_day 2026-08-17] 2026-08-17 hour 18: 124136 events in 3 files, snapshot 5798395014139757005 (task 2939 ms: download 1211 ms overlapping gunzip 145 ms, parse 593 ms, sort 74 ms, write 1135 ms, index 176 ms: 4 candidates, 25647 repo-hours, 8 releases; waiting 530 ms; commit 777 ms)
2026-11-07T04:31:50Z [load_day 2026-08-17] 2026-08-17 hour 19: 133260 events in 3 files, snapshot 3318519738817212160 (task 3271 ms: download 1209 ms overlapping gunzip 175 ms, parse 712 ms, sort 83 ms, write 1246 ms, index 187 ms: 4 candidates, 28287 repo-hours, 11 releases; waiting 526 ms; commit 725 ms)
2026-11-07T04:31:52Z [load_day 2026-08-17] 2026-08-17 hour 20: 122978 events in 3 files, snapshot 7223434179724759472 (task 3040 ms: download 1291 ms overlapping gunzip 153 ms, parse 582 ms, sort 88 ms, write 1152 ms, index 209 ms: 1 candidates, 28953 repo-hours, 7 releases; waiting 550 ms; commit 785 ms)
2026-11-07T04:31:54Z [load_day 2026-08-17] 2026-08-17 hour 21: 130277 events in 3 files, snapshot 3216446888932061041 (task 3023 ms: download 1090 ms overlapping gunzip 154 ms, parse 582 ms, sort 79 ms, write 1201 ms, index 203 ms: 2 candidates, 30958 repo-hours, 9 releases; waiting 534 ms; commit 863 ms)
2026-11-07T04:31:56Z [load_day 2026-08-17] 2026-08-17 hour 22: 142399 events in 3 files, snapshot 5651401806655946553 (task 3223 ms: download 1123 ms overlapping gunzip 167 ms, parse 656 ms, sort 87 ms, write 1292 ms, index 223 ms: 3 candidates, 33757 repo-hours, 13 releases; waiting 521 ms; commit 737 ms)
2026-11-07T04:31:58Z [load_day 2026-08-17] 2026-08-17 hour 23: 152389 events in 4 files, snapshot 1167996522740978897 (task 3387 ms: download 1124 ms overlapping gunzip 184 ms, parse 710 ms, sort 100 ms, write 1374 ms, index 239 ms: 3 candidates, 35444 repo-hours, 12 releases; waiting 516 ms; commit 773 ms)
2026-11-07T04:32:01Z [load_day 2026-08-17] 2026-08-17: repo_hour merged from 24 files to 1 (739057 rows, 3549 ms)
2026-11-07T04:32:03Z [load_day 2026-08-17] 2026-08-17: index committed in 5339 ms (21 + 1 + 24 files)
2026-11-07T04:32:03Z [load_day 2026-08-17] 2026-08-17: 3095930 events in 24 hours
2026-11-07T04:32:03Z [load_day 2026-08-17] attempt 1 succeeded