orcaLog in

Runs · run 167

load_day 2026-09-23, attempt 1 succeeded

Host
4e84322b8c45:28697
Started
2026-11-07T03:52:54Z
Ended
2026-11-07T03:53:49Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/167/load_day/2026-09-23/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:52:54Z [load_day 2026-09-23] attempt 1 started
2026-11-07T03:52:59Z [load_day 2026-09-23] 2026-09-23 hour 0: 77727 events in 2 files, snapshot 7833852604062278364 (task 2862 ms: download 1102 ms overlapping gunzip 131 ms, parse 471 ms, sort 61 ms, write 980 ms, index 298 ms: 11 candidates, 40548 repo-hours, 127 releases; waiting 528 ms; commit 636 ms)
2026-11-07T03:53:00Z [load_day 2026-09-23] 2026-09-23 hour 1: 80353 events in 2 files, snapshot 4265540668800402152 (task 2810 ms: download 996 ms overlapping gunzip 132 ms, parse 464 ms, sort 58 ms, write 1034 ms, index 290 ms: 8 candidates, 42743 repo-hours, 86 releases; waiting 563 ms; commit 654 ms)
2026-11-07T03:53:02Z [load_day 2026-09-23] 2026-09-23 hour 2: 81224 events in 2 files, snapshot 795608199588030254 (task 2789 ms: download 1057 ms overlapping gunzip 133 ms, parse 451 ms, sort 58 ms, write 1034 ms, index 280 ms: 6 candidates, 44997 repo-hours, 87 releases; waiting 552 ms; commit 604 ms)
2026-11-07T03:53:03Z [load_day 2026-09-23] 2026-09-23 hour 3: 84428 events in 2 files, snapshot 5382246603279326229 (task 2995 ms: download 1244 ms overlapping gunzip 136 ms, parse 462 ms, sort 67 ms, write 1026 ms, index 319 ms: 4 candidates, 48478 repo-hours, 134 releases; waiting 686 ms; commit 648 ms)
2026-11-07T03:53:06Z [load_day 2026-09-23] 2026-09-23 hour 4: 95983 events in 2 files, snapshot 8927082509170162920 (task 2767 ms: download 1021 ms overlapping gunzip 148 ms, parse 508 ms, sort 61 ms, write 963 ms, index 327 ms: 3 candidates, 49484 repo-hours, 87 releases; waiting 546 ms; commit 642 ms)
2026-11-07T03:53:07Z [load_day 2026-09-23] 2026-09-23 hour 5: 101472 events in 3 files, snapshot 3016961041253350829 (task 2926 ms: download 1196 ms overlapping gunzip 151 ms, parse 531 ms, sort 67 ms, write 975 ms, index 326 ms: 5 candidates, 50912 repo-hours, 77 releases; waiting 541 ms; commit 604 ms)
2026-11-07T03:53:10Z [load_day 2026-09-23] 2026-09-23 hour 6: 107625 events in 3 files, snapshot 5693890902117989523 (task 3609 ms: download 1334 ms overlapping gunzip 205 ms, parse 670 ms, sort 84 ms, write 1511 ms, index 350 ms: 6 candidates, 55559 repo-hours, 515 releases; waiting 545 ms; commit 589 ms)
2026-11-07T03:53:11Z [load_day 2026-09-23] 2026-09-23 hour 7: 106683 events in 3 files, snapshot 2064415874084911958 (task 3624 ms: download 1276 ms overlapping gunzip 203 ms, parse 702 ms, sort 108 ms, write 1342 ms, index 385 ms: 10 candidates, 59832 repo-hours, 529 releases; waiting 549 ms; commit 653 ms)
2026-11-07T03:53:14Z [load_day 2026-09-23] 2026-09-23 hour 8: 102826 events in 3 files, snapshot 5761572866887743813 (task 3085 ms: download 1291 ms overlapping gunzip 179 ms, parse 592 ms, sort 84 ms, write 1035 ms, index 339 ms: 10 candidates, 55895 repo-hours, 276 releases; waiting 532 ms; commit 850 ms)
2026-11-07T03:53:14Z [load_day 2026-09-23] 2026-09-23 hour 9: 100473 events in 3 files, snapshot 5170876491671482249 (task 2910 ms: download 1049 ms overlapping gunzip 144 ms, parse 499 ms, sort 69 ms, write 994 ms, index 326 ms: 5 candidates, 53540 repo-hours, 109 releases; waiting 535 ms; commit 654 ms)
2026-11-07T03:53:17Z [load_day 2026-09-23] 2026-09-23 hour 10: 106974 events in 3 files, snapshot 7427310981584238809 (task 3257 ms: download 1242 ms overlapping gunzip 190 ms, parse 600 ms, sort 85 ms, write 1163 ms, index 356 ms: 4 candidates, 55896 repo-hours, 154 releases; waiting 566 ms; commit 611 ms)
2026-11-07T03:53:18Z [load_day 2026-09-23] 2026-09-23 hour 11: 105661 events in 3 files, snapshot 3021386954104892000 (task 3226 ms: download 1361 ms overlapping gunzip 167 ms, parse 563 ms, sort 72 ms, write 1233 ms, index 367 ms: 8 candidates, 58882 repo-hours, 213 releases; waiting 557 ms; commit 706 ms)
2026-11-07T03:53:21Z [load_day 2026-09-23] 2026-09-23 hour 12: 106407 events in 3 files, snapshot 6622607094849181510 (task 3275 ms: download 1165 ms overlapping gunzip 174 ms, parse 571 ms, sort 67 ms, write 1256 ms, index 391 ms: 6 candidates, 58119 repo-hours, 156 releases; waiting 555 ms; commit 688 ms)
2026-11-07T03:53:22Z [load_day 2026-09-23] 2026-09-23 hour 13: 106075 events in 3 files, snapshot 10337761243268427 (task 3500 ms: download 1311 ms overlapping gunzip 223 ms, parse 662 ms, sort 79 ms, write 1343 ms, index 425 ms: 5 candidates, 54606 repo-hours, 257 releases; waiting 551 ms; commit 820 ms)
2026-11-07T03:53:26Z [load_day 2026-09-23] 2026-09-23 hour 14: 92424 events in 2 files, snapshot 2296895024343048461 (task 3687 ms: download 1223 ms overlapping gunzip 253 ms, parse 742 ms, sort 80 ms, write 1472 ms, index 371 ms: 5 candidates, 55167 repo-hours, 429 releases; waiting 545 ms; commit 732 ms)
2026-11-07T03:53:27Z [load_day 2026-09-23] 2026-09-23 hour 15: 94035 events in 2 files, snapshot 6767734292506435982 (task 3629 ms: download 1493 ms overlapping gunzip 264 ms, parse 781 ms, sort 77 ms, write 1292 ms, index 332 ms: 8 candidates, 54341 repo-hours, 327 releases; waiting 539 ms; commit 767 ms)
2026-11-07T03:53:29Z [load_day 2026-09-23] 2026-09-23 hour 16: 95320 events in 2 files, snapshot 3586104669530168264 (task 3313 ms: download 1237 ms overlapping gunzip 199 ms, parse 604 ms, sort 61 ms, write 1197 ms, index 377 ms: 7 candidates, 53260 repo-hours, 257 releases; waiting 577 ms; commit 476 ms)
2026-11-07T03:53:30Z [load_day 2026-09-23] 2026-09-23 hour 17: 92982 events in 2 files, snapshot 931995235847144061 (task 2926 ms: download 1251 ms overlapping gunzip 184 ms, parse 582 ms, sort 65 ms, write 1015 ms, index 310 ms: 8 candidates, 48104 repo-hours, 200 releases; waiting 536 ms; commit 622 ms)
2026-11-07T03:53:33Z [load_day 2026-09-23] 2026-09-23 hour 18: 80330 events in 2 files, snapshot 8042254040561008232 (task 2985 ms: download 1051 ms overlapping gunzip 148 ms, parse 475 ms, sort 54 ms, write 1211 ms, index 292 ms: 8 candidates, 44658 repo-hours, 187 releases; waiting 557 ms; commit 657 ms)
2026-11-07T03:53:34Z [load_day 2026-09-23] 2026-09-23 hour 19: 66945 events in 2 files, snapshot 1036235733981246086 (task 2707 ms: download 1166 ms overlapping gunzip 144 ms, parse 445 ms, sort 80 ms, write 997 ms, index 239 ms: 4 candidates, 37474 repo-hours, 153 releases; waiting 541 ms; commit 706 ms)
2026-11-07T03:53:38Z [load_day 2026-09-23] 2026-09-23 hour 20: 61270 events in 2 files, snapshot 1370629136689322926 (task 3482 ms: download 1282 ms overlapping gunzip 206 ms, parse 646 ms, sort 76 ms, write 1464 ms, index 235 ms: 6 candidates, 37214 repo-hours, 410 releases; waiting 547 ms; commit 865 ms)
2026-11-07T03:53:39Z [load_day 2026-09-23] 2026-09-23 hour 21: 55119 events in 2 files, snapshot 7978528063437062204 (task 2940 ms: download 1111 ms overlapping gunzip 152 ms, parse 466 ms, sort 44 ms, write 1218 ms, index 225 ms: 4 candidates, 34291 repo-hours, 268 releases; waiting 585 ms; commit 793 ms)
2026-11-07T03:53:41Z [load_day 2026-09-23] 2026-09-23 hour 22: 54195 events in 2 files, snapshot 5532716776422705671 (task 2989 ms: download 1145 ms overlapping gunzip 155 ms, parse 479 ms, sort 41 ms, write 1249 ms, index 223 ms: 6 candidates, 32725 repo-hours, 290 releases; waiting 573 ms; commit 865 ms)
2026-11-07T03:53:42Z [load_day 2026-09-23] 2026-09-23 hour 23: 59779 events in 2 files, snapshot 776966337161528044 (task 2832 ms: download 1075 ms overlapping gunzip 153 ms, parse 450 ms, sort 55 ms, write 1096 ms, index 231 ms: 5 candidates, 33970 repo-hours, 344 releases; waiting 568 ms; commit 576 ms)
2026-11-07T03:53:47Z [load_day 2026-09-23] 2026-09-23: repo_hour merged from 24 files to 1 (1160695 rows, 5057 ms)
2026-11-07T03:53:48Z [load_day 2026-09-23] 2026-09-23: index committed in 6752 ms (24 + 1 + 24 files)
2026-11-07T03:53:48Z [load_day 2026-09-23] 2026-09-23: 2116310 events in 24 hours
2026-11-07T03:53:48Z [load_day 2026-09-23] attempt 1 succeeded