orcaLog in

Runs · run 86

load_day 2026-10-20, attempt 1 succeeded

Host
4e84322b8c45:17789
Started
2026-11-07T03:31:06Z
Ended
2026-11-07T03:31:47Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/86/load_day/2026-10-20/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:31:07Z [load_day 2026-10-20] attempt 1 started
2026-11-07T03:31:11Z [load_day 2026-10-20] 2026-10-20 hour 0: 43613 events in 1 files, snapshot 1425756623836690164 (task 2330 ms: download 884 ms overlapping gunzip 95 ms, parse 318 ms, sort 38 ms, write 881 ms, index 200 ms: 6 candidates, 29317 repo-hours, 106 releases; waiting 537 ms; commit 586 ms)
2026-11-07T03:31:12Z [load_day 2026-10-20] 2026-10-20 hour 1: 46084 events in 1 files, snapshot 8852316583086189403 (task 2520 ms: download 910 ms overlapping gunzip 106 ms, parse 363 ms, sort 44 ms, write 924 ms, index 230 ms: 6 candidates, 30768 repo-hours, 150 releases; waiting 524 ms; commit 588 ms)
2026-11-07T03:31:14Z [load_day 2026-10-20] 2026-10-20 hour 2: 46557 events in 1 files, snapshot 2423681389015273149 (task 2277 ms: download 887 ms overlapping gunzip 99 ms, parse 321 ms, sort 40 ms, write 674 ms, index 301 ms: 4 candidates, 32212 repo-hours, 130 releases; waiting 548 ms; commit 627 ms)
2026-11-07T03:31:15Z [load_day 2026-10-20] 2026-10-20 hour 3: 48310 events in 1 files, snapshot 1143135139437220695 (task 2331 ms: download 1021 ms overlapping gunzip 120 ms, parse 366 ms, sort 43 ms, write 681 ms, index 231 ms: 5 candidates, 34009 repo-hours, 163 releases; waiting 587 ms; commit 634 ms)
2026-11-07T03:31:17Z [load_day 2026-10-20] 2026-10-20 hour 4: 48866 events in 1 files, snapshot 4209611691318451670 (task 1748 ms: download 468 ms overlapping gunzip 81 ms, parse 271 ms, sort 30 ms, write 626 ms, index 223 ms: 6 candidates, 32969 repo-hours, 153 releases; waiting 192 ms; commit 647 ms)
2026-11-07T03:31:18Z [load_day 2026-10-20] 2026-10-20 hour 5: 49559 events in 1 files, snapshot 8166599870125506413 (task 2187 ms: download 891 ms overlapping gunzip 100 ms, parse 322 ms, sort 35 ms, write 673 ms, index 225 ms: 5 candidates, 32141 repo-hours, 259 releases; waiting 548 ms; commit 643 ms)
2026-11-07T03:31:20Z [load_day 2026-10-20] 2026-10-20 hour 6: 48449 events in 1 files, snapshot 7624422950949388289 (task 2466 ms: download 916 ms overlapping gunzip 109 ms, parse 341 ms, sort 34 ms, write 704 ms, index 319 ms: 5 candidates, 32472 repo-hours, 148 releases; waiting 567 ms; commit 585 ms)
2026-11-07T03:31:20Z [load_day 2026-10-20] 2026-10-20 hour 7: 50528 events in 2 files, snapshot 2269391099822164237 (task 2229 ms: download 889 ms overlapping gunzip 99 ms, parse 320 ms, sort 34 ms, write 684 ms, index 259 ms: 7 candidates, 34787 repo-hours, 175 releases; waiting 573 ms; commit 726 ms)
2026-11-07T03:31:22Z [load_day 2026-10-20] 2026-10-20 hour 8: 51445 events in 2 files, snapshot 3704074077214370423 (task 1554 ms: download 193 ms overlapping gunzip 92 ms, parse 293 ms, sort 44 ms, write 679 ms, index 249 ms: 4 candidates, 35117 repo-hours, 168 releases; waiting 15 ms; commit 582 ms)
2026-11-07T03:31:22Z [load_day 2026-10-20] 2026-10-20 hour 9: 53456 events in 2 files, snapshot 7536745304334311893 (task 1662 ms: download 187 ms overlapping gunzip 107 ms, parse 329 ms, sort 35 ms, write 731 ms, index 237 ms: 4 candidates, 37315 repo-hours, 156 releases; waiting 20 ms; commit 332 ms)
2026-11-07T03:31:25Z [load_day 2026-10-20] 2026-10-20 hour 10: 53518 events in 2 files, snapshot 2620181684610436982 (task 2554 ms: download 905 ms overlapping gunzip 126 ms, parse 389 ms, sort 38 ms, write 892 ms, index 270 ms: 7 candidates, 37409 repo-hours, 127 releases; waiting 540 ms; commit 776 ms)
2026-11-07T03:31:26Z [load_day 2026-10-20] 2026-10-20 hour 11: 54084 events in 2 files, snapshot 5026942901615513535 (task 2415 ms: download 932 ms overlapping gunzip 111 ms, parse 347 ms, sort 37 ms, write 841 ms, index 251 ms: 6 candidates, 37544 repo-hours, 134 releases; waiting 548 ms; commit 595 ms)
2026-11-07T03:31:28Z [load_day 2026-10-20] 2026-10-20 hour 12: 58084 events in 2 files, snapshot 3200854411024353132 (task 2240 ms: download 667 ms overlapping gunzip 118 ms, parse 355 ms, sort 44 ms, write 895 ms, index 305 ms: 6 candidates, 40198 repo-hours, 127 releases; waiting 248 ms; commit 746 ms)
2026-11-07T03:31:29Z [load_day 2026-10-20] 2026-10-20 hour 13: 55196 events in 2 files, snapshot 3282057937749641807 (task 2466 ms: download 925 ms overlapping gunzip 114 ms, parse 358 ms, sort 35 ms, write 878 ms, index 270 ms: 2 candidates, 38993 repo-hours, 125 releases; waiting 526 ms; commit 735 ms)
2026-11-07T03:31:30Z [load_day 2026-10-20] 2026-10-20 hour 14: 51169 events in 2 files, snapshot 168369882985798783 (task 1632 ms: download 176 ms overlapping gunzip 101 ms, parse 314 ms, sort 35 ms, write 724 ms, index 252 ms: 4 candidates, 37417 repo-hours, 105 releases; waiting 16 ms; commit 698 ms)
2026-11-07T03:31:31Z [load_day 2026-10-20] 2026-10-20 hour 15: 55085 events in 2 files, snapshot 8305176203943790265 (task 1727 ms: download 208 ms overlapping gunzip 96 ms, parse 303 ms, sort 47 ms, write 806 ms, index 288 ms: 5 candidates, 39999 repo-hours, 126 releases; waiting 17 ms; commit 688 ms)
2026-11-07T03:31:33Z [load_day 2026-10-20] 2026-10-20 hour 16: 58924 events in 2 files, snapshot 6247418517942810073 (task 1831 ms: download 202 ms overlapping gunzip 101 ms, parse 324 ms, sort 36 ms, write 844 ms, index 281 ms: 5 candidates, 42662 repo-hours, 123 releases; waiting 19 ms; commit 787 ms)
2026-11-07T03:31:34Z [load_day 2026-10-20] 2026-10-20 hour 17: 51834 events in 2 files, snapshot 5426290522599326927 (task 1559 ms: download 188 ms overlapping gunzip 88 ms, parse 275 ms, sort 34 ms, write 713 ms, index 241 ms: 5 candidates, 36991 repo-hours, 96 releases; waiting 15 ms; commit 679 ms)
2026-11-07T03:31:35Z [load_day 2026-10-20] 2026-10-20 hour 18: 52138 events in 2 files, snapshot 4994185521144792958 (task 1586 ms: download 202 ms overlapping gunzip 92 ms, parse 300 ms, sort 35 ms, write 702 ms, index 257 ms: 7 candidates, 37387 repo-hours, 111 releases; waiting 16 ms; commit 664 ms)
2026-11-07T03:31:36Z [load_day 2026-10-20] 2026-10-20 hour 19: 50353 events in 2 files, snapshot 1903443753394431127 (task 1582 ms: download 187 ms overlapping gunzip 100 ms, parse 316 ms, sort 35 ms, write 680 ms, index 239 ms: 9 candidates, 35471 repo-hours, 105 releases; waiting 18 ms; commit 657 ms)
2026-11-07T03:31:37Z [load_day 2026-10-20] 2026-10-20 hour 20: 50140 events in 2 files, snapshot 3255589258207062205 (task 1651 ms: download 193 ms overlapping gunzip 103 ms, parse 323 ms, sort 36 ms, write 724 ms, index 249 ms: 6 candidates, 34280 repo-hours, 123 releases; waiting 19 ms; commit 663 ms)
2026-11-07T03:31:38Z [load_day 2026-10-20] 2026-10-20 hour 21: 50629 events in 2 files, snapshot 5629116413216595029 (task 1729 ms: download 193 ms overlapping gunzip 108 ms, parse 340 ms, sort 36 ms, write 790 ms, index 231 ms: 7 candidates, 34958 repo-hours, 108 releases; waiting 22 ms; commit 528 ms)
2026-11-07T03:31:40Z [load_day 2026-10-20] 2026-10-20 hour 22: 50098 events in 2 files, snapshot 4991535112031731357 (task 2441 ms: download 871 ms overlapping gunzip 128 ms, parse 404 ms, sort 37 ms, write 792 ms, index 230 ms: 9 candidates, 34074 repo-hours, 119 releases; waiting 475 ms; commit 641 ms)
2026-11-07T03:31:41Z [load_day 2026-10-20] 2026-10-20 hour 23: 47583 events in 1 files, snapshot 1708354013326308215 (task 2241 ms: download 909 ms overlapping gunzip 104 ms, parse 346 ms, sort 33 ms, write 678 ms, index 216 ms: 12 candidates, 31235 repo-hours, 104 releases; waiting 533 ms; commit 525 ms)
2026-11-07T03:31:45Z [load_day 2026-10-20] 2026-10-20: repo_hour merged from 24 files to 1 (849725 rows, 4122 ms)
2026-11-07T03:31:47Z [load_day 2026-10-20] 2026-10-20: index committed in 5708 ms (24 + 1 + 24 files)
2026-11-07T03:31:47Z [load_day 2026-10-20] 2026-10-20: 1225702 events in 24 hours
2026-11-07T03:31:47Z [load_day 2026-10-20] attempt 1 succeeded