orcaLog in

Runs · run 218

load_day 2026-09-06, attempt 1 succeeded

Host
4e84322b8c45:37257
Started
2026-11-07T04:12:40Z
Ended
2026-11-07T04:15:00Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/218/load_day/2026-09-06/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:12:40Z [load_day 2026-09-06] attempt 1 started
2026-11-07T04:12:53Z [load_day 2026-09-06] 2026-09-06 hour 0: 73818 events in 2 files, snapshot 3723693222943499930 (task 9489 ms: download 2707 ms overlapping gunzip 609 ms, parse 1909 ms, sort 199 ms, write 5460 ms, index 215 ms: 4 candidates, 32468 repo-hours, 1916 releases; waiting 713 ms; commit 677 ms)
2026-11-07T04:12:54Z [load_day 2026-09-06] 2026-09-06 hour 1: 76836 events in 2 files, snapshot 3082459860104877653 (task 9367 ms: download 2616 ms overlapping gunzip 623 ms, parse 1930 ms, sort 203 ms, write 5434 ms, index 219 ms: 6 candidates, 33512 repo-hours, 1842 releases; waiting 575 ms; commit 868 ms)
2026-11-07T04:13:03Z [load_day 2026-09-06] 2026-09-06 hour 2: 83653 events in 2 files, snapshot 7841994014450368613 (task 9374 ms: download 3378 ms overlapping gunzip 685 ms, parse 2022 ms, sort 175 ms, write 4895 ms, index 246 ms: 8 candidates, 38309 repo-hours, 2054 releases; waiting 1141 ms; commit 785 ms)
2026-11-07T04:13:03Z [load_day 2026-09-06] 2026-09-06 hour 3: 89025 events in 2 files, snapshot 1620122334914804755 (task 9455 ms: download 3523 ms overlapping gunzip 721 ms, parse 2227 ms, sort 296 ms, write 4537 ms, index 255 ms: 9 candidates, 40208 repo-hours, 2156 releases; waiting 1116 ms; commit 648 ms)
2026-11-07T04:13:12Z [load_day 2026-09-06] 2026-09-06 hour 4: 95159 events in 2 files, snapshot 7088993305964035768 (task 9286 ms: download 3134 ms overlapping gunzip 669 ms, parse 1931 ms, sort 234 ms, write 5153 ms, index 260 ms: 5 candidates, 41415 repo-hours, 2005 releases; waiting 747 ms; commit 900 ms)
2026-11-07T04:13:13Z [load_day 2026-09-06] 2026-09-06 hour 5: 106669 events in 3 files, snapshot 830013420249647037 (task 9406 ms: download 3355 ms overlapping gunzip 829 ms, parse 2452 ms, sort 260 ms, write 4701 ms, index 283 ms: 5 candidates, 45201 repo-hours, 2037 releases; waiting 583 ms; commit 552 ms)
2026-11-07T04:13:24Z [load_day 2026-09-06] 2026-09-06 hour 6: 113827 events in 3 files, snapshot 8771412282563148872 (task 10751 ms: download 4023 ms overlapping gunzip 779 ms, parse 2237 ms, sort 202 ms, write 6137 ms, index 309 ms: 6 candidates, 47627 repo-hours, 2397 releases; waiting 861 ms; commit 736 ms)
2026-11-07T04:13:24Z [load_day 2026-09-06] 2026-09-06 hour 7: 112997 events in 3 files, snapshot 5579587427013014505 (task 10253 ms: download 3278 ms overlapping gunzip 830 ms, parse 2473 ms, sort 343 ms, write 5362 ms, index 290 ms: 3 candidates, 48935 repo-hours, 2411 releases; waiting 612 ms; commit 680 ms)
2026-11-07T04:13:34Z [load_day 2026-09-06] 2026-09-06 hour 8: 112683 events in 3 files, snapshot 3109758547916118332 (task 9587 ms: download 2821 ms overlapping gunzip 724 ms, parse 2037 ms, sort 204 ms, write 5367 ms, index 374 ms: 5 candidates, 51408 repo-hours, 2258 releases; waiting 578 ms; commit 865 ms)
2026-11-07T04:13:35Z [load_day 2026-09-06] 2026-09-06 hour 9: 110320 events in 3 files, snapshot 6246921666270281543 (task 10208 ms: download 3521 ms overlapping gunzip 794 ms, parse 2440 ms, sort 207 ms, write 5358 ms, index 308 ms: 4 candidates, 50609 repo-hours, 2547 releases; waiting 651 ms; commit 698 ms)
2026-11-07T04:13:45Z [load_day 2026-09-06] 2026-09-06 hour 10: 109445 events in 3 files, snapshot 4228559913782303053 (task 10972 ms: download 3550 ms overlapping gunzip 768 ms, parse 2236 ms, sort 265 ms, write 6391 ms, index 352 ms: 6 candidates, 49755 repo-hours, 2808 releases; waiting 652 ms; commit 876 ms)
2026-11-07T04:13:46Z [load_day 2026-09-06] 2026-09-06 hour 11: 110779 events in 3 files, snapshot 2762295332390435296 (task 9966 ms: download 3102 ms overlapping gunzip 821 ms, parse 2382 ms, sort 363 ms, write 5526 ms, index 312 ms: 8 candidates, 50599 repo-hours, 2615 releases; waiting 282 ms; commit 811 ms)
2026-11-07T04:13:56Z [load_day 2026-09-06] 2026-09-06 hour 12: 114010 events in 3 files, snapshot 1963196106279628523 (task 10676 ms: download 3519 ms overlapping gunzip 726 ms, parse 2154 ms, sort 208 ms, write 6156 ms, index 389 ms: 9 candidates, 53800 repo-hours, 2642 releases; waiting 686 ms; commit 617 ms)
2026-11-07T04:13:57Z [load_day 2026-09-06] 2026-09-06 hour 13: 115312 events in 3 files, snapshot 3256029363872719513 (task 10493 ms: download 3332 ms overlapping gunzip 846 ms, parse 2422 ms, sort 392 ms, write 5656 ms, index 338 ms: 6 candidates, 55317 repo-hours, 2498 releases; waiting 556 ms; commit 1010 ms)
2026-11-07T04:14:09Z [load_day 2026-09-06] 2026-09-06 hour 14: 116690 events in 3 files, snapshot 1046409393245181974 (task 11738 ms: download 3576 ms overlapping gunzip 761 ms, parse 2225 ms, sort 233 ms, write 7171 ms, index 357 ms: 5 candidates, 57453 repo-hours, 2553 releases; waiting 673 ms; commit 917 ms)
2026-11-07T04:14:10Z [load_day 2026-09-06] 2026-09-06 hour 15: 114447 events in 3 files, snapshot 1810822401070306625 (task 11220 ms: download 3675 ms overlapping gunzip 743 ms, parse 2146 ms, sort 293 ms, write 6795 ms, index 367 ms: 9 candidates, 56457 repo-hours, 2565 releases; waiting 569 ms; commit 802 ms)
2026-11-07T04:14:21Z [load_day 2026-09-06] 2026-09-06 hour 16: 115850 events in 3 files, snapshot 9210787739165811181 (task 11554 ms: download 4794 ms overlapping gunzip 733 ms, parse 2146 ms, sort 143 ms, write 6472 ms, index 339 ms: 5 candidates, 54571 repo-hours, 2297 releases; waiting 1405 ms; commit 756 ms)
2026-11-07T04:14:22Z [load_day 2026-09-06] 2026-09-06 hour 17: 111910 events in 3 files, snapshot 2913387809217609886 (task 11020 ms: download 4057 ms overlapping gunzip 745 ms, parse 2236 ms, sort 247 ms, write 6265 ms, index 321 ms: 9 candidates, 52803 repo-hours, 2326 releases; waiting 906 ms; commit 730 ms)
2026-11-07T04:14:32Z [load_day 2026-09-06] 2026-09-06 hour 18: 109835 events in 3 files, snapshot 2645257156094609376 (task 9967 ms: download 3415 ms overlapping gunzip 691 ms, parse 2056 ms, sort 195 ms, write 5891 ms, index 311 ms: 6 candidates, 50698 repo-hours, 2240 releases; waiting 553 ms; commit 767 ms)
2026-11-07T04:14:33Z [load_day 2026-09-06] 2026-09-06 hour 19: 106391 events in 3 files, snapshot 4650229019887329286 (task 10180 ms: download 3168 ms overlapping gunzip 839 ms, parse 2549 ms, sort 386 ms, write 5078 ms, index 307 ms: 10 candidates, 48215 repo-hours, 2421 releases; waiting 661 ms; commit 918 ms)
2026-11-07T04:14:42Z [load_day 2026-09-06] 2026-09-06 hour 20: 108872 events in 3 files, snapshot 7857355078723143315 (task 9935 ms: download 3031 ms overlapping gunzip 756 ms, parse 2324 ms, sort 207 ms, write 5548 ms, index 313 ms: 4 candidates, 47719 repo-hours, 2209 releases; waiting 565 ms; commit 757 ms)
2026-11-07T04:14:43Z [load_day 2026-09-06] 2026-09-06 hour 21: 99838 events in 2 files, snapshot 6377506773916935813 (task 9277 ms: download 2751 ms overlapping gunzip 761 ms, parse 2346 ms, sort 614 ms, write 4380 ms, index 317 ms: 5 candidates, 43876 repo-hours, 1843 releases; waiting 559 ms; commit 1007 ms)
2026-11-07T04:14:52Z [load_day 2026-09-06] 2026-09-06 hour 22: 101557 events in 3 files, snapshot 4576665133677323438 (task 9488 ms: download 2642 ms overlapping gunzip 714 ms, parse 2145 ms, sort 255 ms, write 5206 ms, index 292 ms: 3 candidates, 43555 repo-hours, 1860 releases; waiting 574 ms; commit 917 ms)
2026-11-07T04:14:53Z [load_day 2026-09-06] 2026-09-06 hour 23: 94289 events in 2 files, snapshot 3880953395056490436 (task 8815 ms: download 2698 ms overlapping gunzip 697 ms, parse 2105 ms, sort 277 ms, write 4651 ms, index 266 ms: 6 candidates, 40674 repo-hours, 1670 releases; waiting 519 ms; commit 802 ms)
2026-11-07T04:14:58Z [load_day 2026-09-06] 2026-09-06: repo_hour merged from 24 files to 1 (1135184 rows, 4906 ms)
2026-11-07T04:15:00Z [load_day 2026-09-06] 2026-09-06: index committed in 6499 ms (24 + 1 + 24 files)
2026-11-07T04:15:00Z [load_day 2026-09-06] 2026-09-06: 2504212 events in 24 hours
2026-11-07T04:15:00Z [load_day 2026-09-06] attempt 1 succeeded