orcaLog in

Runs · run 248

load_day 2026-08-27, attempt 1 succeeded

Host
4e84322b8c45:41051
Started
2026-11-07T04:23:33Z
Ended
2026-11-07T04:24:17Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/248/load_day/2026-08-27/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:23:33Z [load_day 2026-08-27] attempt 1 started
2026-11-07T04:23:39Z [load_day 2026-08-27] 2026-08-27 hour 0: 83197 events in 2 files, snapshot 8981986664250449690 (task 2616 ms: download 1233 ms overlapping gunzip 110 ms, parse 426 ms, sort 58 ms, write 1038 ms, index 133 ms: 1 candidates, 17809 repo-hours, 32 releases; waiting 509 ms; commit 805 ms)
2026-11-07T04:23:40Z [load_day 2026-08-27] 2026-08-27 hour 1: 83639 events in 2 files, snapshot 4245251054839635060 (task 2662 ms: download 971 ms overlapping gunzip 134 ms, parse 517 ms, sort 61 ms, write 1005 ms, index 144 ms: 2 candidates, 18358 repo-hours, 67 releases; waiting 523 ms; commit 655 ms)
2026-11-07T04:23:42Z [load_day 2026-08-27] 2026-08-27 hour 2: 89182 events in 2 files, snapshot 1043014886154498833 (task 2642 ms: download 981 ms overlapping gunzip 130 ms, parse 481 ms, sort 77 ms, write 964 ms, index 135 ms: 3 candidates, 18523 repo-hours, 49 releases; waiting 526 ms; commit 666 ms)
2026-11-07T04:23:43Z [load_day 2026-08-27] 2026-08-27 hour 3: 111889 events in 3 files, snapshot 7799307979376634859 (task 2787 ms: download 1000 ms overlapping gunzip 142 ms, parse 538 ms, sort 74 ms, write 1184 ms, index 122 ms: 1 candidates, 17910 repo-hours, 47 releases; waiting 404 ms; commit 724 ms)
2026-11-07T04:23:46Z [load_day 2026-08-27] 2026-08-27 hour 4: 108780 events in 3 files, snapshot 6455984322927740011 (task 2764 ms: download 1248 ms overlapping gunzip 136 ms, parse 531 ms, sort 73 ms, write 1065 ms, index 133 ms: 2 candidates, 18858 repo-hours, 39 releases; waiting 531 ms; commit 976 ms)
2026-11-07T04:23:47Z [load_day 2026-08-27] 2026-08-27 hour 5: 114430 events in 3 files, snapshot 7946593324609297238 (task 2842 ms: download 1088 ms overlapping gunzip 139 ms, parse 533 ms, sort 72 ms, write 1194 ms, index 131 ms: 1 candidates, 19128 repo-hours, 30 releases; waiting 514 ms; commit 808 ms)
2026-11-07T04:23:49Z [load_day 2026-08-27] 2026-08-27 hour 6: 110999 events in 3 files, snapshot 2748044255978223673 (task 2804 ms: download 981 ms overlapping gunzip 146 ms, parse 559 ms, sort 82 ms, write 1102 ms, index 132 ms: 1 candidates, 19385 repo-hours, 22 releases; waiting 531 ms; commit 685 ms)
2026-11-07T04:23:50Z [load_day 2026-08-27] 2026-08-27 hour 7: 112766 events in 3 files, snapshot 5773432484788330339 (task 2855 ms: download 1056 ms overlapping gunzip 143 ms, parse 532 ms, sort 90 ms, write 1131 ms, index 132 ms: 0 candidates, 20768 repo-hours, 21 releases; waiting 528 ms; commit 604 ms)
2026-11-07T04:23:53Z [load_day 2026-08-27] 2026-08-27 hour 8: 106541 events in 3 files, snapshot 1438623389015725471 (task 2777 ms: download 1016 ms overlapping gunzip 143 ms, parse 530 ms, sort 84 ms, write 1022 ms, index 147 ms: 1 candidates, 21267 repo-hours, 37 releases; waiting 547 ms; commit 713 ms)
2026-11-07T04:23:53Z [load_day 2026-08-27] 2026-08-27 hour 9: 96366 events in 2 files, snapshot 5379231876833730037 (task 2453 ms: download 987 ms overlapping gunzip 148 ms, parse 534 ms, sort 69 ms, write 843 ms, index 121 ms: 2 candidates, 17193 repo-hours, 22 releases; waiting 524 ms; commit 804 ms)
2026-11-07T04:23:56Z [load_day 2026-08-27] 2026-08-27 hour 10: 88682 events in 2 files, snapshot 5323242610821295584 (task 2313 ms: download 846 ms overlapping gunzip 115 ms, parse 430 ms, sort 53 ms, write 831 ms, index 129 ms: 1 candidates, 17101 repo-hours, 27 releases; waiting 384 ms; commit 743 ms)
2026-11-07T04:23:56Z [load_day 2026-08-27] 2026-08-27 hour 11: 84741 events in 2 files, snapshot 5799863668854734820 (task 2258 ms: download 1269 ms overlapping gunzip 108 ms, parse 413 ms, sort 52 ms, write 808 ms, index 119 ms: 1 candidates, 17310 repo-hours, 28 releases; waiting 532 ms; commit 644 ms)
2026-11-07T04:23:59Z [load_day 2026-08-27] 2026-08-27 hour 12: 88542 events in 2 files, snapshot 1838496565042793030 (task 2445 ms: download 960 ms overlapping gunzip 122 ms, parse 461 ms, sort 61 ms, write 820 ms, index 126 ms: 1 candidates, 17839 repo-hours, 26 releases; waiting 532 ms; commit 871 ms)
2026-11-07T04:23:59Z [load_day 2026-08-27] 2026-08-27 hour 13: 81808 events in 2 files, snapshot 8540877932265387147 (task 2354 ms: download 891 ms overlapping gunzip 106 ms, parse 409 ms, sort 49 ms, write 845 ms, index 133 ms: 2 candidates, 18572 repo-hours, 49 releases; waiting 518 ms; commit 578 ms)
2026-11-07T04:24:02Z [load_day 2026-08-27] 2026-08-27 hour 14: 73080 events in 2 files, snapshot 2846982426158409243 (task 2291 ms: download 924 ms overlapping gunzip 100 ms, parse 374 ms, sort 47 ms, write 766 ms, index 163 ms: 1 candidates, 18749 repo-hours, 47 releases; waiting 530 ms; commit 814 ms)
2026-11-07T04:24:02Z [load_day 2026-08-27] 2026-08-27 hour 15: 69429 events in 2 files, snapshot 2548952767442097750 (task 2211 ms: download 873 ms overlapping gunzip 99 ms, parse 371 ms, sort 49 ms, write 780 ms, index 128 ms: 2 candidates, 16676 repo-hours, 44 releases; waiting 535 ms; commit 859 ms)
2026-11-07T04:24:04Z [load_day 2026-08-27] 2026-08-27 hour 16: 54908 events in 2 files, snapshot 2372793216096584170 (task 1992 ms: download 849 ms overlapping gunzip 85 ms, parse 308 ms, sort 37 ms, write 572 ms, index 108 ms: 3 candidates, 14436 repo-hours, 42 releases; waiting 538 ms; commit 935 ms)
2026-11-07T04:24:05Z [load_day 2026-08-27] 2026-08-27 hour 17: 34905 events in 1 files, snapshot 9070982167327516140 (task 1644 ms: download 783 ms overlapping gunzip 57 ms, parse 202 ms, sort 21 ms, write 410 ms, index 120 ms: 1 candidates, 11930 repo-hours, 48 releases; waiting 561 ms; commit 822 ms)
2026-11-07T04:24:07Z [load_day 2026-08-27] 2026-08-27 hour 18: 25233 events in 1 files, snapshot 2003915303658387994 (task 1839 ms: download 873 ms overlapping gunzip 56 ms, parse 181 ms, sort 15 ms, write 390 ms, index 202 ms: 0 candidates, 10581 repo-hours, 52 releases; waiting 719 ms; commit 952 ms)
2026-11-07T04:24:08Z [load_day 2026-08-27] 2026-08-27 hour 19: 24967 events in 1 files, snapshot 2350914517171813296 (task 1590 ms: download 444 ms overlapping gunzip 49 ms, parse 171 ms, sort 14 ms, write 392 ms, index 113 ms: 1 candidates, 9580 repo-hours, 55 releases; waiting 263 ms; commit 799 ms)
2026-11-07T04:24:09Z [load_day 2026-08-27] 2026-08-27 hour 20: 30587 events in 1 files, snapshot 6209749628465435700 (task 1159 ms: download 306 ms overlapping gunzip 45 ms, parse 161 ms, sort 18 ms, write 357 ms, index 92 ms: 1 candidates, 10387 repo-hours, 44 releases; waiting 219 ms; commit 790 ms)
2026-11-07T04:24:10Z [load_day 2026-08-27] 2026-08-27 hour 21: 26134 events in 1 files, snapshot 1002662599833304510 (task 1528 ms: download 750 ms overlapping gunzip 55 ms, parse 203 ms, sort 15 ms, write 352 ms, index 90 ms: 1 candidates, 10244 repo-hours, 37 releases; waiting 533 ms; commit 837 ms)
2026-11-07T04:24:11Z [load_day 2026-08-27] 2026-08-27 hour 22: 20123 events in 1 files, snapshot 3732508647051678901 (task 1538 ms: download 737 ms overlapping gunzip 47 ms, parse 157 ms, sort 12 ms, write 321 ms, index 69 ms: 0 candidates, 8598 repo-hours, 36 releases; waiting 552 ms; commit 773 ms)
2026-11-07T04:24:12Z [load_day 2026-08-27] 2026-08-27 hour 23: 18605 events in 1 files, snapshot 3772941957415328992 (task 1408 ms: download 717 ms overlapping gunzip 42 ms, parse 141 ms, sort 10 ms, write 300 ms, index 62 ms: 0 candidates, 7821 repo-hours, 35 releases; waiting 546 ms; commit 790 ms)
2026-11-07T04:24:14Z [load_day 2026-08-27] 2026-08-27: repo_hour merged from 24 files to 1 (379023 rows, 2413 ms)
2026-11-07T04:24:17Z [load_day 2026-08-27] 2026-08-27: index committed in 4640 ms (20 + 1 + 24 files)
2026-11-07T04:24:17Z [load_day 2026-08-27] 2026-08-27: 1739533 events in 24 hours
2026-11-07T04:24:17Z [load_day 2026-08-27] attempt 1 succeeded