orcaLog in

Runs · run 151

load_day 2026-09-29, attempt 1 succeeded

Host
4e84322b8c45:25539
Started
2026-11-07T03:47:05Z
Ended
2026-11-07T03:48:05Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/151/load_day/2026-09-29/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:47:05Z [load_day 2026-09-29] attempt 1 started
2026-11-07T03:47:13Z [load_day 2026-09-29] 2026-09-29 hour 0: 85627 events in 2 files, snapshot 5598691071368780696 (task 3379 ms: download 1130 ms overlapping gunzip 174 ms, parse 572 ms, sort 74 ms, write 1466 ms, index 287 ms: 9 candidates, 42926 repo-hours, 183 releases; waiting 541 ms; commit 572 ms)
2026-11-07T03:47:14Z [load_day 2026-09-29] 2026-09-29 hour 1: 88591 events in 2 files, snapshot 573418992067310161 (task 3607 ms: download 1350 ms overlapping gunzip 176 ms, parse 605 ms, sort 80 ms, write 1639 ms, index 286 ms: 4 candidates, 43222 repo-hours, 191 releases; waiting 465 ms; commit 637 ms)
2026-11-07T03:47:17Z [load_day 2026-09-29] 2026-09-29 hour 2: 94113 events in 2 files, snapshot 3761559127425400333 (task 3223 ms: download 969 ms overlapping gunzip 162 ms, parse 518 ms, sort 74 ms, write 1163 ms, index 329 ms: 12 candidates, 48625 repo-hours, 116 releases; waiting 257 ms; commit 691 ms)
2026-11-07T03:47:18Z [load_day 2026-09-29] 2026-09-29 hour 3: 93121 events in 2 files, snapshot 4382627947252010303 (task 3133 ms: download 1271 ms overlapping gunzip 199 ms, parse 625 ms, sort 76 ms, write 1058 ms, index 325 ms: 9 candidates, 54275 repo-hours, 164 releases; waiting 539 ms; commit 651 ms)
2026-11-07T03:47:21Z [load_day 2026-09-29] 2026-09-29 hour 4: 96121 events in 2 files, snapshot 8204542025041566978 (task 3243 ms: download 1370 ms overlapping gunzip 167 ms, parse 566 ms, sort 76 ms, write 1245 ms, index 324 ms: 7 candidates, 53587 repo-hours, 151 releases; waiting 553 ms; commit 639 ms)
2026-11-07T03:47:22Z [load_day 2026-09-29] 2026-09-29 hour 5: 93717 events in 2 files, snapshot 9194205913334020689 (task 3252 ms: download 1260 ms overlapping gunzip 166 ms, parse 561 ms, sort 62 ms, write 1315 ms, index 301 ms: 6 candidates, 50443 repo-hours, 183 releases; waiting 543 ms; commit 869 ms)
2026-11-07T03:47:25Z [load_day 2026-09-29] 2026-09-29 hour 6: 93542 events in 2 files, snapshot 4449776862826061053 (task 3176 ms: download 1502 ms overlapping gunzip 168 ms, parse 557 ms, sort 70 ms, write 1219 ms, index 297 ms: 5 candidates, 48697 repo-hours, 162 releases; waiting 534 ms; commit 726 ms)
2026-11-07T03:47:25Z [load_day 2026-09-29] 2026-09-29 hour 7: 96450 events in 2 files, snapshot 1483655443643456085 (task 3069 ms: download 1176 ms overlapping gunzip 161 ms, parse 532 ms, sort 64 ms, write 1150 ms, index 295 ms: 5 candidates, 47814 repo-hours, 148 releases; waiting 559 ms; commit 717 ms)
2026-11-07T03:47:28Z [load_day 2026-09-29] 2026-09-29 hour 8: 94033 events in 2 files, snapshot 993463809624077156 (task 2985 ms: download 1098 ms overlapping gunzip 144 ms, parse 497 ms, sort 62 ms, write 1157 ms, index 308 ms: 7 candidates, 48933 repo-hours, 101 releases; waiting 545 ms; commit 526 ms)
2026-11-07T03:47:29Z [load_day 2026-09-29] 2026-09-29 hour 9: 94284 events in 2 files, snapshot 8830158487427958410 (task 3025 ms: download 1174 ms overlapping gunzip 162 ms, parse 523 ms, sort 64 ms, write 1063 ms, index 316 ms: 6 candidates, 52380 repo-hours, 75 releases; waiting 556 ms; commit 691 ms)
2026-11-07T03:47:32Z [load_day 2026-09-29] 2026-09-29 hour 10: 92051 events in 2 files, snapshot 7043650398224761053 (task 3007 ms: download 1222 ms overlapping gunzip 154 ms, parse 516 ms, sort 67 ms, write 1132 ms, index 331 ms: 2 candidates, 50603 repo-hours, 113 releases; waiting 546 ms; commit 785 ms)
2026-11-07T03:47:33Z [load_day 2026-09-29] 2026-09-29 hour 11: 94152 events in 2 files, snapshot 7530906280285958185 (task 3159 ms: download 1252 ms overlapping gunzip 163 ms, parse 527 ms, sort 71 ms, write 1208 ms, index 347 ms: 5 candidates, 56318 repo-hours, 148 releases; waiting 548 ms; commit 683 ms)
2026-11-07T03:47:36Z [load_day 2026-09-29] 2026-09-29 hour 12: 100721 events in 3 files, snapshot 2910897356914950297 (task 3498 ms: download 1592 ms overlapping gunzip 200 ms, parse 618 ms, sort 83 ms, write 1385 ms, index 400 ms: 8 candidates, 61655 repo-hours, 238 releases; waiting 503 ms; commit 792 ms)
2026-11-07T03:47:37Z [load_day 2026-09-29] 2026-09-29 hour 13: 100290 events in 3 files, snapshot 4418844016469330715 (task 3496 ms: download 1337 ms overlapping gunzip 195 ms, parse 617 ms, sort 71 ms, write 1442 ms, index 376 ms: 11 candidates, 62504 repo-hours, 204 releases; waiting 530 ms; commit 721 ms)
2026-11-07T03:47:40Z [load_day 2026-09-29] 2026-09-29 hour 14: 97190 events in 2 files, snapshot 4001570382637681007 (task 3381 ms: download 1284 ms overlapping gunzip 190 ms, parse 642 ms, sort 74 ms, write 1356 ms, index 401 ms: 7 candidates, 59728 repo-hours, 222 releases; waiting 504 ms; commit 557 ms)
2026-11-07T03:47:41Z [load_day 2026-09-29] 2026-09-29 hour 15: 100304 events in 3 files, snapshot 2787238137426916301 (task 3406 ms: download 1506 ms overlapping gunzip 181 ms, parse 592 ms, sort 79 ms, write 1348 ms, index 391 ms: 11 candidates, 63925 repo-hours, 186 releases; waiting 453 ms; commit 663 ms)
2026-11-07T03:47:44Z [load_day 2026-09-29] 2026-09-29 hour 16: 100307 events in 3 files, snapshot 2173238665617549664 (task 3321 ms: download 1284 ms overlapping gunzip 190 ms, parse 623 ms, sort 81 ms, write 1165 ms, index 458 ms: 10 candidates, 62097 repo-hours, 146 releases; waiting 547 ms; commit 769 ms)
2026-11-07T03:47:45Z [load_day 2026-09-29] 2026-09-29 hour 17: 106524 events in 3 files, snapshot 584853336942017169 (task 3386 ms: download 1305 ms overlapping gunzip 200 ms, parse 666 ms, sort 71 ms, write 1273 ms, index 387 ms: 5 candidates, 64224 repo-hours, 168 releases; waiting 546 ms; commit 692 ms)
2026-11-07T03:47:48Z [load_day 2026-09-29] 2026-09-29 hour 18: 105068 events in 3 files, snapshot 4252177998742465042 (task 3777 ms: download 1509 ms overlapping gunzip 210 ms, parse 711 ms, sort 142 ms, write 1520 ms, index 371 ms: 3 candidates, 57445 repo-hours, 193 releases; waiting 534 ms; commit 646 ms)
2026-11-07T03:47:49Z [load_day 2026-09-29] 2026-09-29 hour 19: 79947 events in 2 files, snapshot 8612296936719978584 (task 3739 ms: download 1524 ms overlapping gunzip 274 ms, parse 762 ms, sort 61 ms, write 1562 ms, index 289 ms: 4 candidates, 46310 repo-hours, 316 releases; waiting 509 ms; commit 620 ms)
2026-11-07T03:47:53Z [load_day 2026-09-29] 2026-09-29 hour 20: 65493 events in 2 files, snapshot 1187704152098861183 (task 4037 ms: download 1907 ms overlapping gunzip 221 ms, parse 644 ms, sort 97 ms, write 1522 ms, index 250 ms: 11 candidates, 38330 repo-hours, 370 releases; waiting 962 ms; commit 588 ms)
2026-11-07T03:47:54Z [load_day 2026-09-29] 2026-09-29 hour 21: 54279 events in 2 files, snapshot 7303437199531588784 (task 3528 ms: download 1166 ms overlapping gunzip 197 ms, parse 623 ms, sort 115 ms, write 1554 ms, index 218 ms: 5 candidates, 33136 repo-hours, 386 releases; waiting 521 ms; commit 797 ms)
2026-11-07T03:47:57Z [load_day 2026-09-29] 2026-09-29 hour 22: 46905 events in 1 files, snapshot 7391857605909090248 (task 3645 ms: download 1230 ms overlapping gunzip 213 ms, parse 616 ms, sort 69 ms, write 1677 ms, index 188 ms: 2 candidates, 28613 repo-hours, 375 releases; waiting 564 ms; commit 592 ms)
2026-11-07T03:47:58Z [load_day 2026-09-29] 2026-09-29 hour 23: 43508 events in 1 files, snapshot 7057816795601737104 (task 3069 ms: download 795 ms overlapping gunzip 173 ms, parse 478 ms, sort 37 ms, write 1621 ms, index 243 ms: 6 candidates, 26462 repo-hours, 374 releases; waiting 246 ms; commit 722 ms)
2026-11-07T03:48:03Z [load_day 2026-09-29] 2026-09-29: repo_hour merged from 24 files to 1 (1202252 rows, 5256 ms)
2026-11-07T03:48:05Z [load_day 2026-09-29] 2026-09-29: index committed in 7240 ms (24 + 1 + 24 files)
2026-11-07T03:48:05Z [load_day 2026-09-29] 2026-09-29: 2116338 events in 24 hours
2026-11-07T03:48:05Z [load_day 2026-09-29] attempt 1 succeeded