orcaLog in

Runs · run 155

load_day 2026-09-27, attempt 1 succeeded

Host
4e84322b8c45:26607
Started
2026-11-07T03:49:02Z
Ended
2026-11-07T03:50:04Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/155/load_day/2026-09-27/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:49:02Z [load_day 2026-09-27] attempt 1 started
2026-11-07T03:49:08Z [load_day 2026-09-27] 2026-09-27 hour 0: 115961 events in 3 files, snapshot 6159243437162136161 (task 3304 ms: download 1157 ms overlapping gunzip 169 ms, parse 614 ms, sort 100 ms, write 1270 ms, index 312 ms: 9 candidates, 50657 repo-hours, 54 releases; waiting 504 ms; commit 831 ms)
2026-11-07T03:49:09Z [load_day 2026-09-27] 2026-09-27 hour 1: 116545 events in 3 files, snapshot 8915353047585493616 (task 3288 ms: download 1284 ms overlapping gunzip 160 ms, parse 605 ms, sort 81 ms, write 1345 ms, index 322 ms: 12 candidates, 50238 repo-hours, 81 releases; waiting 520 ms; commit 665 ms)
2026-11-07T03:49:12Z [load_day 2026-09-27] 2026-09-27 hour 2: 126023 events in 3 files, snapshot 8944666088212661201 (task 3296 ms: download 1193 ms overlapping gunzip 180 ms, parse 687 ms, sort 100 ms, write 1227 ms, index 329 ms: 9 candidates, 56416 repo-hours, 88 releases; waiting 525 ms; commit 744 ms)
2026-11-07T03:49:13Z [load_day 2026-09-27] 2026-09-27 hour 3: 127620 events in 3 files, snapshot 4807386555041505926 (task 3179 ms: download 1241 ms overlapping gunzip 168 ms, parse 621 ms, sort 82 ms, write 1177 ms, index 373 ms: 17 candidates, 59854 repo-hours, 64 releases; waiting 517 ms; commit 527 ms)
2026-11-07T03:49:16Z [load_day 2026-09-27] 2026-09-27 hour 4: 128302 events in 3 files, snapshot 276907607214152049 (task 3277 ms: download 1240 ms overlapping gunzip 167 ms, parse 625 ms, sort 83 ms, write 1187 ms, index 381 ms: 21 candidates, 63210 repo-hours, 45 releases; waiting 533 ms; commit 605 ms)
2026-11-07T03:49:17Z [load_day 2026-09-27] 2026-09-27 hour 5: 125460 events in 3 files, snapshot 5241172401966152243 (task 3345 ms: download 1147 ms overlapping gunzip 166 ms, parse 617 ms, sort 90 ms, write 1251 ms, index 370 ms: 9 candidates, 61118 repo-hours, 45 releases; waiting 545 ms; commit 571 ms)
2026-11-07T03:49:20Z [load_day 2026-09-27] 2026-09-27 hour 6: 127766 events in 3 files, snapshot 9183162383173147792 (task 3209 ms: download 1509 ms overlapping gunzip 163 ms, parse 606 ms, sort 76 ms, write 1213 ms, index 401 ms: 6 candidates, 60795 repo-hours, 34 releases; waiting 530 ms; commit 616 ms)
2026-11-07T03:49:21Z [load_day 2026-09-27] 2026-09-27 hour 7: 128797 events in 3 files, snapshot 8558924962271676023 (task 3304 ms: download 1756 ms overlapping gunzip 167 ms, parse 608 ms, sort 79 ms, write 1182 ms, index 357 ms: 8 candidates, 59950 repo-hours, 43 releases; waiting 539 ms; commit 772 ms)
2026-11-07T03:49:24Z [load_day 2026-09-27] 2026-09-27 hour 8: 125663 events in 3 files, snapshot 1914258266930265537 (task 3340 ms: download 1399 ms overlapping gunzip 168 ms, parse 604 ms, sort 79 ms, write 1259 ms, index 367 ms: 7 candidates, 60699 repo-hours, 72 releases; waiting 540 ms; commit 937 ms)
2026-11-07T03:49:25Z [load_day 2026-09-27] 2026-09-27 hour 9: 122934 events in 3 files, snapshot 6790063937731215145 (task 3405 ms: download 1256 ms overlapping gunzip 169 ms, parse 595 ms, sort 78 ms, write 1291 ms, index 365 ms: 3 candidates, 59449 repo-hours, 64 releases; waiting 530 ms; commit 689 ms)
2026-11-07T03:49:30Z [load_day 2026-09-27] 2026-09-27 hour 10: 119407 events in 3 files, snapshot 4585486435853423918 (task 3241 ms: download 1629 ms overlapping gunzip 173 ms, parse 613 ms, sort 73 ms, write 1190 ms, index 336 ms: 5 candidates, 55477 repo-hours, 97 releases; waiting 538 ms; commit 3079 ms)
2026-11-07T03:49:31Z [load_day 2026-09-27] 2026-09-27 hour 11: 121620 events in 3 files, snapshot 7596711691505683905 (task 4672 ms: download 1219 ms overlapping gunzip 198 ms, parse 646 ms, sort 81 ms, write 1207 ms, index 1579 ms: 7 candidates, 57568 repo-hours, 129 releases; waiting 665 ms; commit 862 ms)
2026-11-07T03:49:36Z [load_day 2026-09-27] 2026-09-27 hour 12: 122625 events in 3 files, snapshot 7724466310866475746 (task 5401 ms: download 1467 ms overlapping gunzip 171 ms, parse 615 ms, sort 83 ms, write 3279 ms, index 374 ms: 11 candidates, 61592 repo-hours, 78 releases; waiting 536 ms; commit 686 ms)
2026-11-07T03:49:37Z [load_day 2026-09-27] 2026-09-27 hour 13: 121913 events in 3 files, snapshot 8486102681042632695 (task 4518 ms: download 1317 ms overlapping gunzip 217 ms, parse 761 ms, sort 87 ms, write 2230 ms, index 408 ms: 5 candidates, 60714 repo-hours, 67 releases; waiting 490 ms; commit 717 ms)
2026-11-07T03:49:40Z [load_day 2026-09-27] 2026-09-27 hour 14: 126042 events in 3 files, snapshot 7468833430158544303 (task 3374 ms: download 1292 ms overlapping gunzip 182 ms, parse 659 ms, sort 81 ms, write 1239 ms, index 392 ms: 23 candidates, 60787 repo-hours, 55 releases; waiting 542 ms; commit 668 ms)
2026-11-07T03:49:41Z [load_day 2026-09-27] 2026-09-27 hour 15: 125787 events in 3 files, snapshot 1750394004187438936 (task 3408 ms: download 1211 ms overlapping gunzip 168 ms, parse 613 ms, sort 79 ms, write 1303 ms, index 399 ms: 12 candidates, 62572 repo-hours, 60 releases; waiting 540 ms; commit 699 ms)
2026-11-07T03:49:44Z [load_day 2026-09-27] 2026-09-27 hour 16: 123297 events in 3 files, snapshot 5821466585880435681 (task 3593 ms: download 1294 ms overlapping gunzip 171 ms, parse 603 ms, sort 81 ms, write 1471 ms, index 444 ms: 9 candidates, 66284 repo-hours, 69 releases; waiting 524 ms; commit 601 ms)
2026-11-07T03:49:45Z [load_day 2026-09-27] 2026-09-27 hour 17: 125852 events in 3 files, snapshot 4290837176883320 (task 3058 ms: download 331 ms overlapping gunzip 191 ms, parse 664 ms, sort 85 ms, write 1513 ms, index 396 ms: 10 candidates, 61464 repo-hours, 108 releases; waiting 16 ms; commit 732 ms)
2026-11-07T03:49:48Z [load_day 2026-09-27] 2026-09-27 hour 18: 120853 events in 3 files, snapshot 4348925676520541166 (task 3590 ms: download 1558 ms overlapping gunzip 196 ms, parse 657 ms, sort 79 ms, write 1388 ms, index 435 ms: 7 candidates, 58667 repo-hours, 112 releases; waiting 533 ms; commit 598 ms)
2026-11-07T03:49:49Z [load_day 2026-09-27] 2026-09-27 hour 19: 120415 events in 3 files, snapshot 4092054550416474154 (task 3438 ms: download 1100 ms overlapping gunzip 210 ms, parse 705 ms, sort 82 ms, write 1301 ms, index 387 ms: 12 candidates, 56593 repo-hours, 80 releases; waiting 524 ms; commit 678 ms)
2026-11-07T03:49:52Z [load_day 2026-09-27] 2026-09-27 hour 20: 120512 events in 3 files, snapshot 524775865833554797 (task 3250 ms: download 1176 ms overlapping gunzip 169 ms, parse 613 ms, sort 78 ms, write 1202 ms, index 353 ms: 8 candidates, 54543 repo-hours, 69 releases; waiting 528 ms; commit 659 ms)
2026-11-07T03:49:53Z [load_day 2026-09-27] 2026-09-27 hour 21: 123512 events in 3 files, snapshot 6858446701322509515 (task 3272 ms: download 900 ms overlapping gunzip 221 ms, parse 732 ms, sort 81 ms, write 1292 ms, index 344 ms: 12 candidates, 55749 repo-hours, 57 releases; waiting 351 ms; commit 592 ms)
2026-11-07T03:49:56Z [load_day 2026-09-27] 2026-09-27 hour 22: 120024 events in 3 files, snapshot 6271589790023526966 (task 3446 ms: download 1252 ms overlapping gunzip 195 ms, parse 680 ms, sort 78 ms, write 1293 ms, index 323 ms: 12 candidates, 50772 repo-hours, 98 releases; waiting 655 ms; commit 456 ms)
2026-11-07T03:49:56Z [load_day 2026-09-27] 2026-09-27 hour 23: 118962 events in 3 files, snapshot 6070616964535183566 (task 3267 ms: download 1403 ms overlapping gunzip 174 ms, parse 624 ms, sort 74 ms, write 1258 ms, index 295 ms: 7 candidates, 48161 repo-hours, 74 releases; waiting 551 ms; commit 558 ms)
2026-11-07T03:50:03Z [load_day 2026-09-27] 2026-09-27: repo_hour merged from 24 files to 1 (1393329 rows, 6165 ms)
2026-11-07T03:50:04Z [load_day 2026-09-27] 2026-09-27: index committed in 7867 ms (24 + 1 + 24 files)
2026-11-07T03:50:04Z [load_day 2026-09-27] 2026-09-27: 2955892 events in 24 hours
2026-11-07T03:50:04Z [load_day 2026-09-27] attempt 1 succeeded