orcaLog in

Runs · run 593

load_day 2026-05-04, attempt 1 succeeded

Host
4e84322b8c45:133197
Started
2026-11-07T06:42:46Z
Ended
2026-11-07T06:44:10Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/593/load_day/2026-05-04/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:42:46Z [load_day 2026-05-04] attempt 1 started
2026-11-07T06:42:55Z [load_day 2026-05-04] 2026-05-04 hour 0: 146878 events in 3 files, snapshot 6201937075185086830 (task 5906 ms: download 2234 ms overlapping gunzip 369 ms, parse 1246 ms, sort 189 ms, write 2598 ms, index 441 ms: 9 candidates, 66955 repo-hours, 714 releases; waiting 731 ms; commit 1176 ms)
2026-11-07T06:42:59Z [load_day 2026-05-04] 2026-05-04 hour 1: 150277 events in 4 files, snapshot 9137462239848335305 (task 5776 ms: download 2125 ms overlapping gunzip 345 ms, parse 1204 ms, sort 136 ms, write 2761 ms, index 477 ms: 10 candidates, 74446 repo-hours, 694 releases; waiting 537 ms; commit 3946 ms)
2026-11-07T06:43:02Z [load_day 2026-05-04] 2026-05-04 hour 2: 153267 events in 4 files, snapshot 5282678890789205014 (task 5878 ms: download 2032 ms overlapping gunzip 373 ms, parse 1321 ms, sort 143 ms, write 2638 ms, index 518 ms: 5 candidates, 81730 repo-hours, 586 releases; waiting 538 ms; commit 1285 ms)
2026-11-07T06:43:04Z [load_day 2026-05-04] 2026-05-04 hour 3: 154378 events in 4 files, snapshot 5440600159160764380 (task 5849 ms: download 2172 ms overlapping gunzip 354 ms, parse 1179 ms, sort 136 ms, write 2741 ms, index 525 ms: 3 candidates, 80397 repo-hours, 610 releases; waiting 549 ms; commit 1334 ms)
2026-11-07T06:43:09Z [load_day 2026-05-04] 2026-05-04 hour 4: 149989 events in 3 files, snapshot 7707460923718176438 (task 5694 ms: download 1881 ms overlapping gunzip 374 ms, parse 1264 ms, sort 120 ms, write 2621 ms, index 492 ms: 5 candidates, 71011 repo-hours, 662 releases; waiting 535 ms; commit 1385 ms)
2026-11-07T06:43:10Z [load_day 2026-05-04] 2026-05-04 hour 5: 148495 events in 3 files, snapshot 1128485552604156332 (task 5678 ms: download 2254 ms overlapping gunzip 383 ms, parse 1233 ms, sort 184 ms, write 2474 ms, index 461 ms: 8 candidates, 71508 repo-hours, 614 releases; waiting 621 ms; commit 1087 ms)
2026-11-07T06:43:15Z [load_day 2026-05-04] 2026-05-04 hour 6: 147839 events in 3 files, snapshot 5811432644133096445 (task 5420 ms: download 1956 ms overlapping gunzip 358 ms, parse 1183 ms, sort 171 ms, write 2291 ms, index 495 ms: 3 candidates, 75086 repo-hours, 573 releases; waiting 583 ms; commit 1083 ms)
2026-11-07T06:43:16Z [load_day 2026-05-04] 2026-05-04 hour 7: 147685 events in 3 files, snapshot 4427507684904142637 (task 5157 ms: download 1775 ms overlapping gunzip 326 ms, parse 1045 ms, sort 112 ms, write 2324 ms, index 528 ms: 3 candidates, 76681 repo-hours, 500 releases; waiting 526 ms; commit 1153 ms)
2026-11-07T06:43:21Z [load_day 2026-05-04] 2026-05-04 hour 8: 151211 events in 4 files, snapshot 7283602088661645572 (task 5101 ms: download 1740 ms overlapping gunzip 313 ms, parse 1037 ms, sort 109 ms, write 2438 ms, index 524 ms: 6 candidates, 82192 repo-hours, 402 releases; waiting 409 ms; commit 1195 ms)
2026-11-07T06:43:22Z [load_day 2026-05-04] 2026-05-04 hour 9: 148271 events in 3 files, snapshot 6881047428900943558 (task 5054 ms: download 1832 ms overlapping gunzip 298 ms, parse 980 ms, sort 110 ms, write 2297 ms, index 509 ms: 11 candidates, 80087 repo-hours, 386 releases; waiting 548 ms; commit 1018 ms)
2026-11-07T06:43:27Z [load_day 2026-05-04] 2026-05-04 hour 10: 147650 events in 3 files, snapshot 420821937698640364 (task 5280 ms: download 1602 ms overlapping gunzip 319 ms, parse 1063 ms, sort 149 ms, write 2435 ms, index 529 ms: 13 candidates, 79436 repo-hours, 384 releases; waiting 536 ms; commit 1262 ms)
2026-11-07T06:43:30Z [load_day 2026-05-04] 2026-05-04 hour 11: 148980 events in 3 files, snapshot 1422946051157431143 (task 5170 ms: download 1745 ms overlapping gunzip 287 ms, parse 944 ms, sort 118 ms, write 2388 ms, index 537 ms: 9 candidates, 81345 repo-hours, 369 releases; waiting 557 ms; commit 3168 ms)
2026-11-07T06:43:31Z [load_day 2026-05-04] 2026-05-04 hour 12: 153868 events in 4 files, snapshot 201513048228761457 (task 4017 ms: download 2008 ms overlapping gunzip 230 ms, parse 802 ms, sort 102 ms, write 1557 ms, index 551 ms: 4 candidates, 83483 repo-hours, 167 releases; waiting 530 ms; commit 1127 ms)
2026-11-07T06:43:35Z [load_day 2026-05-04] 2026-05-04 hour 13: 155829 events in 4 files, snapshot 3463213120504578633 (task 4348 ms: download 1941 ms overlapping gunzip 208 ms, parse 778 ms, sort 118 ms, write 1475 ms, index 616 ms: 6 candidates, 91879 repo-hours, 59 releases; waiting 815 ms; commit 1104 ms)
2026-11-07T06:43:36Z [load_day 2026-05-04] 2026-05-04 hour 14: 155231 events in 4 files, snapshot 4005698123943496422 (task 4104 ms: download 1524 ms overlapping gunzip 209 ms, parse 792 ms, sort 111 ms, write 1543 ms, index 575 ms: 5 candidates, 85418 repo-hours, 61 releases; waiting 536 ms; commit 1196 ms)
2026-11-07T06:43:40Z [load_day 2026-05-04] 2026-05-04 hour 15: 153527 events in 4 files, snapshot 4337046139006646565 (task 4467 ms: download 1629 ms overlapping gunzip 268 ms, parse 942 ms, sort 134 ms, write 1672 ms, index 563 ms: 8 candidates, 81441 repo-hours, 154 releases; waiting 547 ms; commit 1306 ms)
2026-11-07T06:43:41Z [load_day 2026-05-04] 2026-05-04 hour 16: 155980 events in 4 files, snapshot 4771788400544297614 (task 4154 ms: download 1586 ms overlapping gunzip 213 ms, parse 797 ms, sort 114 ms, write 1601 ms, index 554 ms: 6 candidates, 83246 repo-hours, 93 releases; waiting 539 ms; commit 1123 ms)
2026-11-07T06:43:45Z [load_day 2026-05-04] 2026-05-04 hour 17: 156530 events in 4 files, snapshot 7258414105492736563 (task 4078 ms: download 1520 ms overlapping gunzip 217 ms, parse 781 ms, sort 102 ms, write 1590 ms, index 562 ms: 10 candidates, 85327 repo-hours, 106 releases; waiting 533 ms; commit 1196 ms)
2026-11-07T06:43:46Z [load_day 2026-05-04] 2026-05-04 hour 18: 154553 events in 4 files, snapshot 6891789919984224680 (task 4333 ms: download 1659 ms overlapping gunzip 239 ms, parse 864 ms, sort 110 ms, write 1732 ms, index 548 ms: 7 candidates, 83089 repo-hours, 162 releases; waiting 522 ms; commit 1129 ms)
2026-11-07T06:43:50Z [load_day 2026-05-04] 2026-05-04 hour 19: 154416 events in 4 files, snapshot 2428688748615392766 (task 4017 ms: download 1678 ms overlapping gunzip 221 ms, parse 810 ms, sort 102 ms, write 1550 ms, index 552 ms: 10 candidates, 81882 repo-hours, 94 releases; waiting 495 ms; commit 1166 ms)
2026-11-07T06:43:51Z [load_day 2026-05-04] 2026-05-04 hour 20: 148946 events in 3 files, snapshot 8617670994981234759 (task 4338 ms: download 1354 ms overlapping gunzip 250 ms, parse 922 ms, sort 127 ms, write 1769 ms, index 496 ms: 5 candidates, 74726 repo-hours, 214 releases; waiting 506 ms; commit 1441 ms)
2026-11-07T06:43:55Z [load_day 2026-05-04] 2026-05-04 hour 21: 150509 events in 4 files, snapshot 6722731679889100676 (task 4555 ms: download 1243 ms overlapping gunzip 303 ms, parse 1035 ms, sort 138 ms, write 1969 ms, index 509 ms: 11 candidates, 76415 repo-hours, 393 releases; waiting 262 ms; commit 1012 ms)
2026-11-07T06:43:57Z [load_day 2026-05-04] 2026-05-04 hour 22: 146220 events in 3 files, snapshot 7578909883812404896 (task 4952 ms: download 1989 ms overlapping gunzip 311 ms, parse 1051 ms, sort 122 ms, write 2158 ms, index 465 ms: 6 candidates, 71912 repo-hours, 479 releases; waiting 573 ms; commit 1175 ms)
2026-11-07T06:44:01Z [load_day 2026-05-04] 2026-05-04 hour 23: 147438 events in 3 files, snapshot 875002606474847337 (task 5602 ms: download 2375 ms overlapping gunzip 357 ms, parse 1211 ms, sort 146 ms, write 2331 ms, index 430 ms: 5 candidates, 69470 repo-hours, 670 releases; waiting 682 ms; commit 1207 ms)
2026-11-07T06:44:09Z [load_day 2026-05-04] 2026-05-04: repo_hour merged from 24 files to 1 (1889162 rows, 7692 ms)
2026-11-07T06:44:10Z [load_day 2026-05-04] 2026-05-04: index committed in 9461 ms (24 + 1 + 24 files)
2026-11-07T06:44:10Z [load_day 2026-05-04] 2026-05-04: 3627967 events in 24 hours
2026-11-07T06:44:10Z [load_day 2026-05-04] attempt 1 succeeded