orcaLog in

Runs · run 89

load_day 2026-10-19, attempt 1 succeeded

Host
4e84322b8c45:18195
Started
2026-11-07T03:31:48Z
Ended
2026-11-07T03:32:26Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/89/load_day/2026-10-19/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:31:48Z [load_day 2026-10-19] attempt 1 started
2026-11-07T03:31:52Z [load_day 2026-10-19] 2026-10-19 hour 0: 29872 events in 1 files, snapshot 1593814028824089007 (task 2028 ms: download 862 ms overlapping gunzip 81 ms, parse 270 ms, sort 29 ms, write 630 ms, index 155 ms: 3 candidates, 21441 repo-hours, 99 releases; waiting 545 ms; commit 494 ms)
2026-11-07T03:31:53Z [load_day 2026-10-19] 2026-10-19 hour 1: 31247 events in 1 files, snapshot 1341103665392829586 (task 2080 ms: download 836 ms overlapping gunzip 81 ms, parse 272 ms, sort 29 ms, write 713 ms, index 158 ms: 4 candidates, 22380 repo-hours, 125 releases; waiting 519 ms; commit 561 ms)
2026-11-07T03:31:55Z [load_day 2026-10-19] 2026-10-19 hour 2: 38640 events in 1 files, snapshot 8053774997406263052 (task 2399 ms: download 949 ms overlapping gunzip 116 ms, parse 350 ms, sort 30 ms, write 731 ms, index 244 ms: 3 candidates, 28017 repo-hours, 159 releases; waiting 598 ms; commit 663 ms)
2026-11-07T03:31:56Z [load_day 2026-10-19] 2026-10-19 hour 3: 38689 events in 1 files, snapshot 3610264959531373283 (task 2321 ms: download 910 ms overlapping gunzip 116 ms, parse 348 ms, sort 28 ms, write 736 ms, index 186 ms: 4 candidates, 28082 repo-hours, 150 releases; waiting 542 ms; commit 705 ms)
2026-11-07T03:31:58Z [load_day 2026-10-19] 2026-10-19 hour 4: 37864 events in 1 files, snapshot 7565607009935142971 (task 2325 ms: download 906 ms overlapping gunzip 123 ms, parse 372 ms, sort 29 ms, write 757 ms, index 180 ms: 3 candidates, 26375 repo-hours, 177 releases; waiting 548 ms; commit 747 ms)
2026-11-07T03:31:59Z [load_day 2026-10-19] 2026-10-19 hour 5: 39836 events in 1 files, snapshot 6492121051982643489 (task 2425 ms: download 976 ms overlapping gunzip 114 ms, parse 353 ms, sort 30 ms, write 790 ms, index 185 ms: 6 candidates, 27987 repo-hours, 218 releases; waiting 560 ms; commit 638 ms)
2026-11-07T03:32:01Z [load_day 2026-10-19] 2026-10-19 hour 6: 37774 events in 1 files, snapshot 1943940442923364539 (task 2192 ms: download 890 ms overlapping gunzip 111 ms, parse 333 ms, sort 28 ms, write 687 ms, index 182 ms: 4 candidates, 27178 repo-hours, 252 releases; waiting 550 ms; commit 561 ms)
2026-11-07T03:32:02Z [load_day 2026-10-19] 2026-10-19 hour 7: 39549 events in 1 files, snapshot 5053563442085715061 (task 2319 ms: download 885 ms overlapping gunzip 110 ms, parse 338 ms, sort 42 ms, write 721 ms, index 200 ms: 3 candidates, 28386 repo-hours, 120 releases; waiting 548 ms; commit 662 ms)
2026-11-07T03:32:04Z [load_day 2026-10-19] 2026-10-19 hour 8: 43530 events in 1 files, snapshot 2716267512129023320 (task 2272 ms: download 908 ms overlapping gunzip 109 ms, parse 347 ms, sort 44 ms, write 707 ms, index 221 ms: 6 candidates, 31236 repo-hours, 176 releases; waiting 541 ms; commit 690 ms)
2026-11-07T03:32:05Z [load_day 2026-10-19] 2026-10-19 hour 9: 44067 events in 1 files, snapshot 4915389314070195046 (task 2068 ms: download 877 ms overlapping gunzip 97 ms, parse 316 ms, sort 30 ms, write 596 ms, index 195 ms: 3 candidates, 31420 repo-hours, 173 releases; waiting 543 ms; commit 613 ms)
2026-11-07T03:32:06Z [load_day 2026-10-19] 2026-10-19 hour 10: 43778 events in 1 files, snapshot 7281906721655247156 (task 1961 ms: download 820 ms overlapping gunzip 85 ms, parse 299 ms, sort 30 ms, write 522 ms, index 204 ms: 6 candidates, 31428 repo-hours, 163 releases; waiting 533 ms; commit 716 ms)
2026-11-07T03:32:07Z [load_day 2026-10-19] 2026-10-19 hour 11: 43509 events in 1 files, snapshot 4006846061916527482 (task 2121 ms: download 843 ms overlapping gunzip 93 ms, parse 316 ms, sort 31 ms, write 569 ms, index 249 ms: 4 candidates, 31948 repo-hours, 181 releases; waiting 545 ms; commit 604 ms)
2026-11-07T03:32:08Z [load_day 2026-10-19] 2026-10-19 hour 12: 46849 events in 1 files, snapshot 309590957261341474 (task 1465 ms: download 156 ms overlapping gunzip 78 ms, parse 262 ms, sort 31 ms, write 601 ms, index 276 ms: 3 candidates, 33053 repo-hours, 173 releases; waiting 17 ms; commit 771 ms)
2026-11-07T03:32:09Z [load_day 2026-10-19] 2026-10-19 hour 13: 46905 events in 1 files, snapshot 8163920470739260416 (task 1403 ms: download 147 ms overlapping gunzip 78 ms, parse 263 ms, sort 31 ms, write 577 ms, index 242 ms: 4 candidates, 33786 repo-hours, 158 releases; waiting 14 ms; commit 712 ms)
2026-11-07T03:32:10Z [load_day 2026-10-19] 2026-10-19 hour 14: 47874 events in 1 files, snapshot 5995907083537160718 (task 1488 ms: download 170 ms overlapping gunzip 83 ms, parse 271 ms, sort 42 ms, write 659 ms, index 231 ms: 7 candidates, 35281 repo-hours, 228 releases; waiting 16 ms; commit 644 ms)
2026-11-07T03:32:11Z [load_day 2026-10-19] 2026-10-19 hour 15: 45153 events in 1 files, snapshot 8911696107085328436 (task 1379 ms: download 147 ms overlapping gunzip 81 ms, parse 262 ms, sort 29 ms, write 543 ms, index 253 ms: 8 candidates, 33610 repo-hours, 161 releases; waiting 17 ms; commit 592 ms)
2026-11-07T03:32:12Z [load_day 2026-10-19] 2026-10-19 hour 16: 47380 events in 1 files, snapshot 86068815451875632 (task 1345 ms: download 147 ms overlapping gunzip 78 ms, parse 254 ms, sort 30 ms, write 545 ms, index 219 ms: 6 candidates, 33947 repo-hours, 135 releases; waiting 16 ms; commit 475 ms)
2026-11-07T03:32:14Z [load_day 2026-10-19] 2026-10-19 hour 17: 51184 events in 2 files, snapshot 2481357081744805165 (task 1406 ms: download 174 ms overlapping gunzip 78 ms, parse 262 ms, sort 38 ms, write 589 ms, index 245 ms: 7 candidates, 36656 repo-hours, 135 releases; waiting 13 ms; commit 783 ms)
2026-11-07T03:32:15Z [load_day 2026-10-19] 2026-10-19 hour 18: 51059 events in 2 files, snapshot 848251294053840809 (task 1575 ms: download 156 ms overlapping gunzip 90 ms, parse 286 ms, sort 34 ms, write 644 ms, index 315 ms: 6 candidates, 37279 repo-hours, 140 releases; waiting 15 ms; commit 721 ms)
2026-11-07T03:32:16Z [load_day 2026-10-19] 2026-10-19 hour 19: 49683 events in 1 files, snapshot 6054672247579648612 (task 1434 ms: download 223 ms overlapping gunzip 84 ms, parse 277 ms, sort 41 ms, write 595 ms, index 227 ms: 6 candidates, 34658 repo-hours, 167 releases; waiting 20 ms; commit 606 ms)
2026-11-07T03:32:17Z [load_day 2026-10-19] 2026-10-19 hour 20: 50205 events in 2 files, snapshot 1034986493273861276 (task 1463 ms: download 163 ms overlapping gunzip 89 ms, parse 288 ms, sort 33 ms, write 627 ms, index 224 ms: 5 candidates, 34821 repo-hours, 225 releases; waiting 15 ms; commit 698 ms)
2026-11-07T03:32:18Z [load_day 2026-10-19] 2026-10-19 hour 21: 47284 events in 1 files, snapshot 8200201353862889990 (task 2183 ms: download 893 ms overlapping gunzip 101 ms, parse 328 ms, sort 35 ms, write 652 ms, index 226 ms: 10 candidates, 32116 repo-hours, 164 releases; waiting 550 ms; commit 656 ms)
2026-11-07T03:32:19Z [load_day 2026-10-19] 2026-10-19 hour 22: 46856 events in 1 files, snapshot 4715073712737578003 (task 2122 ms: download 855 ms overlapping gunzip 101 ms, parse 331 ms, sort 34 ms, write 638 ms, index 200 ms: 5 candidates, 31781 repo-hours, 126 releases; waiting 521 ms; commit 481 ms)
2026-11-07T03:32:21Z [load_day 2026-10-19] 2026-10-19 hour 23: 43906 events in 1 files, snapshot 5024787038479106052 (task 2143 ms: download 848 ms overlapping gunzip 93 ms, parse 301 ms, sort 29 ms, write 632 ms, index 195 ms: 9 candidates, 28893 repo-hours, 115 releases; waiting 541 ms; commit 592 ms)
2026-11-07T03:32:25Z [load_day 2026-10-19] 2026-10-19: repo_hour merged from 24 files to 1 (741759 rows, 3827 ms)
2026-11-07T03:32:26Z [load_day 2026-10-19] 2026-10-19: index committed in 5397 ms (24 + 1 + 24 files)
2026-11-07T03:32:26Z [load_day 2026-10-19] 2026-10-19: 1042693 events in 24 hours
2026-11-07T03:32:26Z [load_day 2026-10-19] attempt 1 succeeded