orcaLog in

Runs · run 720

load_day 2026-03-23, attempt 1 succeeded

Host
4e84322b8c45:178965
Started
2026-11-07T13:30:59Z
Ended
2026-11-07T13:32:33Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/720/load_day/2026-03-23/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T13:30:59Z [load_day 2026-03-23] attempt 1 started
2026-11-07T13:31:10Z [load_day 2026-03-23] 2026-03-23 hour 0: 156676 events in 4 files, snapshot 2239889117698167007 (task 7461 ms: download 2351 ms overlapping gunzip 550 ms, parse 1787 ms, sort 223 ms, write 3581 ms, index 471 ms: 8 candidates, 71472 repo-hours, 1140 releases; waiting 475 ms; commit 1106 ms)
2026-11-07T13:31:12Z [load_day 2026-03-23] 2026-03-23 hour 1: 162777 events in 4 files, snapshot 4746082454387791312 (task 5860 ms: download 2367 ms overlapping gunzip 460 ms, parse 1514 ms, sort 169 ms, write 2477 ms, index 618 ms: 15 candidates, 92265 repo-hours, 491 releases; waiting 309 ms; commit 1413 ms)
2026-11-07T13:31:17Z [load_day 2026-03-23] 2026-03-23 hour 2: 161378 events in 4 files, snapshot 398016123397349865 (task 6220 ms: download 2267 ms overlapping gunzip 375 ms, parse 1214 ms, sort 165 ms, write 2958 ms, index 642 ms: 11 candidates, 93220 repo-hours, 503 releases; waiting 554 ms; commit 1277 ms)
2026-11-07T13:31:22Z [load_day 2026-03-23] 2026-03-23 hour 3: 157943 events in 4 files, snapshot 1248282206255981410 (task 10125 ms: download 3097 ms overlapping gunzip 643 ms, parse 2153 ms, sort 255 ms, write 5672 ms, index 539 ms: 8 candidates, 69089 repo-hours, 748 releases; waiting 592 ms; commit 1398 ms)
2026-11-07T13:31:25Z [load_day 2026-03-23] 2026-03-23 hour 4: 154568 events in 4 files, snapshot 1330832353775334040 (task 6927 ms: download 2565 ms overlapping gunzip 519 ms, parse 1694 ms, sort 178 ms, write 3046 ms, index 573 ms: 9 candidates, 71999 repo-hours, 850 releases; waiting 639 ms; commit 1258 ms)
2026-11-07T13:31:30Z [load_day 2026-03-23] 2026-03-23 hour 5: 155440 events in 4 files, snapshot 2945886392706495150 (task 6671 ms: download 2291 ms overlapping gunzip 475 ms, parse 1352 ms, sort 172 ms, write 3181 ms, index 515 ms: 8 candidates, 76739 repo-hours, 656 releases; waiting 624 ms; commit 1458 ms)
2026-11-07T13:31:32Z [load_day 2026-03-23] 2026-03-23 hour 6: 159366 events in 4 files, snapshot 8408422565393289559 (task 6190 ms: download 2661 ms overlapping gunzip 486 ms, parse 1547 ms, sort 166 ms, write 2681 ms, index 620 ms: 9 candidates, 79748 repo-hours, 543 releases; waiting 387 ms; commit 1301 ms)
2026-11-07T13:31:37Z [load_day 2026-03-23] 2026-03-23 hour 7: 160890 events in 4 files, snapshot 4159933646032306350 (task 5922 ms: download 1562 ms overlapping gunzip 443 ms, parse 1400 ms, sort 245 ms, write 2733 ms, index 561 ms: 9 candidates, 83730 repo-hours, 341 releases; waiting 238 ms; commit 1603 ms)
2026-11-07T13:31:38Z [load_day 2026-03-23] 2026-03-23 hour 8: 161270 events in 4 files, snapshot 2600413732957381501 (task 5219 ms: download 2257 ms overlapping gunzip 332 ms, parse 1060 ms, sort 130 ms, write 2256 ms, index 532 ms: 7 candidates, 80613 repo-hours, 239 releases; waiting 614 ms; commit 1300 ms)
2026-11-07T13:31:42Z [load_day 2026-03-23] 2026-03-23 hour 9: 158842 events in 4 files, snapshot 1432952884843178720 (task 5001 ms: download 2017 ms overlapping gunzip 307 ms, parse 1007 ms, sort 140 ms, write 2128 ms, index 631 ms: 9 candidates, 84903 repo-hours, 214 releases; waiting 541 ms; commit 1138 ms)
2026-11-07T13:31:43Z [load_day 2026-03-23] 2026-03-23 hour 10: 163725 events in 4 files, snapshot 8901396123889389466 (task 4823 ms: download 1584 ms overlapping gunzip 289 ms, parse 991 ms, sort 118 ms, write 2040 ms, index 600 ms: 12 candidates, 89704 repo-hours, 262 releases; waiting 558 ms; commit 1179 ms)
2026-11-07T13:31:48Z [load_day 2026-03-23] 2026-03-23 hour 11: 160591 events in 4 files, snapshot 2464382998880543165 (task 4637 ms: download 1678 ms overlapping gunzip 298 ms, parse 954 ms, sort 138 ms, write 2165 ms, index 556 ms: 17 candidates, 87561 repo-hours, 233 releases; waiting 228 ms; commit 1324 ms)
2026-11-07T13:31:49Z [load_day 2026-03-23] 2026-03-23 hour 12: 162967 events in 4 files, snapshot 7907221885251998498 (task 4119 ms: download 1128 ms overlapping gunzip 268 ms, parse 861 ms, sort 132 ms, write 1816 ms, index 633 ms: 11 candidates, 96334 repo-hours, 152 releases; waiting 187 ms; commit 1289 ms)
2026-11-07T13:31:53Z [load_day 2026-03-23] 2026-03-23 hour 13: 161302 events in 4 files, snapshot 6609497883775730435 (task 4547 ms: download 1428 ms overlapping gunzip 254 ms, parse 841 ms, sort 121 ms, write 1852 ms, index 672 ms: 8 candidates, 98622 repo-hours, 68 releases; waiting 526 ms; commit 1271 ms)
2026-11-07T13:31:54Z [load_day 2026-03-23] 2026-03-23 hour 14: 159633 events in 4 files, snapshot 4505461056337082765 (task 4570 ms: download 1552 ms overlapping gunzip 237 ms, parse 815 ms, sort 109 ms, write 1866 ms, index 613 ms: 12 candidates, 91507 repo-hours, 89 releases; waiting 540 ms; commit 1630 ms)
2026-11-07T13:31:58Z [load_day 2026-03-23] 2026-03-23 hour 15: 160117 events in 4 files, snapshot 2979846809746399413 (task 4609 ms: download 1268 ms overlapping gunzip 279 ms, parse 873 ms, sort 116 ms, write 2106 ms, index 670 ms: 13 candidates, 89601 repo-hours, 115 releases; waiting 232 ms; commit 1277 ms)
2026-11-07T13:31:59Z [load_day 2026-03-23] 2026-03-23 hour 16: 161025 events in 4 files, snapshot 9023529125767039487 (task 4193 ms: download 1064 ms overlapping gunzip 297 ms, parse 908 ms, sort 130 ms, write 1830 ms, index 612 ms: 8 candidates, 91436 repo-hours, 84 releases; waiting 194 ms; commit 1385 ms)
2026-11-07T13:32:04Z [load_day 2026-03-23] 2026-03-23 hour 17: 159590 events in 4 files, snapshot 4602413736596961413 (task 5040 ms: download 1759 ms overlapping gunzip 264 ms, parse 911 ms, sort 148 ms, write 2258 ms, index 639 ms: 5 candidates, 90809 repo-hours, 103 releases; waiting 515 ms; commit 1408 ms)
2026-11-07T13:32:06Z [load_day 2026-03-23] 2026-03-23 hour 18: 163534 events in 4 files, snapshot 8887514902473341156 (task 5593 ms: download 2181 ms overlapping gunzip 329 ms, parse 1082 ms, sort 154 ms, write 2614 ms, index 629 ms: 13 candidates, 91259 repo-hours, 118 releases; waiting 556 ms; commit 1891 ms)
2026-11-07T13:32:10Z [load_day 2026-03-23] 2026-03-23 hour 19: 161636 events in 4 files, snapshot 3952600505912596500 (task 5255 ms: download 1716 ms overlapping gunzip 329 ms, parse 1106 ms, sort 145 ms, write 2263 ms, index 597 ms: 15 candidates, 87587 repo-hours, 189 releases; waiting 540 ms; commit 1275 ms)
2026-11-07T13:32:11Z [load_day 2026-03-23] 2026-03-23 hour 20: 163119 events in 4 files, snapshot 775651812233049950 (task 5231 ms: download 1773 ms overlapping gunzip 377 ms, parse 1150 ms, sort 156 ms, write 2158 ms, index 662 ms: 17 candidates, 86454 repo-hours, 233 releases; waiting 355 ms; commit 1300 ms)
2026-11-07T13:32:16Z [load_day 2026-03-23] 2026-03-23 hour 21: 162195 events in 4 files, snapshot 5926608252318907454 (task 5642 ms: download 1540 ms overlapping gunzip 348 ms, parse 1174 ms, sort 155 ms, write 2520 ms, index 639 ms: 12 candidates, 82239 repo-hours, 412 releases; waiting 272 ms; commit 1162 ms)
2026-11-07T13:32:18Z [load_day 2026-03-23] 2026-03-23 hour 22: 157579 events in 4 files, snapshot 2227307547923935300 (task 5644 ms: download 1877 ms overlapping gunzip 362 ms, parse 1186 ms, sort 165 ms, write 2663 ms, index 558 ms: 15 candidates, 79776 repo-hours, 555 releases; waiting 407 ms; commit 1495 ms)
2026-11-07T13:32:23Z [load_day 2026-03-23] 2026-03-23 hour 23: 155056 events in 4 files, snapshot 8957345258151729425 (task 5906 ms: download 2426 ms overlapping gunzip 390 ms, parse 1319 ms, sort 152 ms, write 2527 ms, index 528 ms: 8 candidates, 76253 repo-hours, 767 releases; waiting 661 ms; commit 1351 ms)
2026-11-07T13:32:31Z [load_day 2026-03-23] 2026-03-23: repo_hour merged from 24 files to 1 (2042920 rows, 8266 ms)
2026-11-07T13:32:33Z [load_day 2026-03-23] 2026-03-23: index committed in 10107 ms (24 + 1 + 24 files)
2026-11-07T13:32:33Z [load_day 2026-03-23] 2026-03-23: 3841219 events in 24 hours
2026-11-07T13:32:33Z [load_day 2026-03-23] attempt 1 succeeded