orcaLog in

Runs · run 311

load_day 2026-08-06, attempt 1 succeeded

Host
4e84322b8c45:54977
Started
2026-11-07T04:42:56Z
Ended
2026-11-07T04:43:49Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/311/load_day/2026-08-06/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:42:56Z [load_day 2026-08-06] attempt 1 started
2026-11-07T04:43:03Z [load_day 2026-08-06] 2026-08-06 hour 0: 163674 events in 4 files, snapshot 4251851562977670134 (task 3923 ms: download 1599 ms overlapping gunzip 197 ms, parse 761 ms, sort 116 ms, write 1744 ms, index 302 ms: 4 candidates, 42502 repo-hours, 13 releases; waiting 506 ms; commit 787 ms)
2026-11-07T04:43:04Z [load_day 2026-08-06] 2026-08-06 hour 1: 167757 events in 4 files, snapshot 7859645674802732135 (task 3945 ms: download 1426 ms overlapping gunzip 199 ms, parse 781 ms, sort 119 ms, write 1686 ms, index 337 ms: 4 candidates, 53564 repo-hours, 10 releases; waiting 521 ms; commit 743 ms)
2026-11-07T04:43:07Z [load_day 2026-08-06] 2026-08-06 hour 2: 165690 events in 4 files, snapshot 4635174692862578615 (task 3566 ms: download 1299 ms overlapping gunzip 192 ms, parse 760 ms, sort 102 ms, write 1424 ms, index 275 ms: 1 candidates, 34280 repo-hours, 9 releases; waiting 518 ms; commit 717 ms)
2026-11-07T04:43:08Z [load_day 2026-08-06] 2026-08-06 hour 3: 168883 events in 4 files, snapshot 5450122423092119963 (task 3723 ms: download 1657 ms overlapping gunzip 187 ms, parse 763 ms, sort 106 ms, write 1441 ms, index 181 ms: 1 candidates, 27614 repo-hours, 9 releases; waiting 512 ms; commit 756 ms)
2026-11-07T04:43:12Z [load_day 2026-08-06] 2026-08-06 hour 4: 170688 events in 4 files, snapshot 839778944498650151 (task 3610 ms: download 1284 ms overlapping gunzip 197 ms, parse 783 ms, sort 105 ms, write 1546 ms, index 151 ms: 0 candidates, 22434 repo-hours, 8 releases; waiting 524 ms; commit 895 ms)
2026-11-07T04:43:12Z [load_day 2026-08-06] 2026-08-06 hour 5: 169584 events in 4 files, snapshot 7978423894243799021 (task 3476 ms: download 1714 ms overlapping gunzip 189 ms, parse 761 ms, sort 104 ms, write 1463 ms, index 122 ms: 0 candidates, 19301 repo-hours, 2 releases; waiting 516 ms; commit 784 ms)
2026-11-07T04:43:15Z [load_day 2026-08-06] 2026-08-06 hour 6: 154771 events in 4 files, snapshot 5841558806219776693 (task 3486 ms: download 1215 ms overlapping gunzip 185 ms, parse 734 ms, sort 105 ms, write 1483 ms, index 143 ms: 1 candidates, 20933 repo-hours, 4 releases; waiting 529 ms; commit 649 ms)
2026-11-07T04:43:16Z [load_day 2026-08-06] 2026-08-06 hour 7: 124816 events in 3 files, snapshot 1130435229684620067 (task 3015 ms: download 1150 ms overlapping gunzip 143 ms, parse 551 ms, sort 80 ms, write 1238 ms, index 136 ms: 0 candidates, 22778 repo-hours, 14 releases; waiting 551 ms; commit 696 ms)
2026-11-07T04:43:19Z [load_day 2026-08-06] 2026-08-06 hour 8: 120820 events in 3 files, snapshot 6628666084667840961 (task 3074 ms: download 1255 ms overlapping gunzip 147 ms, parse 572 ms, sort 83 ms, write 1265 ms, index 154 ms: 1 candidates, 21953 repo-hours, 15 releases; waiting 546 ms; commit 878 ms)
2026-11-07T04:43:20Z [load_day 2026-08-06] 2026-08-06 hour 9: 107021 events in 3 files, snapshot 3427688508303247606 (task 2904 ms: download 1077 ms overlapping gunzip 132 ms, parse 515 ms, sort 67 ms, write 1011 ms, index 127 ms: 0 candidates, 19220 repo-hours, 10 releases; waiting 738 ms; commit 917 ms)
2026-11-07T04:43:23Z [load_day 2026-08-06] 2026-08-06 hour 10: 88090 events in 2 files, snapshot 8159272505775094867 (task 2454 ms: download 921 ms overlapping gunzip 106 ms, parse 422 ms, sort 53 ms, write 857 ms, index 130 ms: 1 candidates, 19016 repo-hours, 17 releases; waiting 522 ms; commit 893 ms)
2026-11-07T04:43:23Z [load_day 2026-08-06] 2026-08-06 hour 11: 88022 events in 2 files, snapshot 3770380199812397657 (task 2387 ms: download 1233 ms overlapping gunzip 107 ms, parse 418 ms, sort 55 ms, write 855 ms, index 150 ms: 2 candidates, 20161 repo-hours, 10 releases; waiting 491 ms; commit 748 ms)
2026-11-07T04:43:26Z [load_day 2026-08-06] 2026-08-06 hour 12: 88517 events in 2 files, snapshot 8528677960900827431 (task 2466 ms: download 921 ms overlapping gunzip 107 ms, parse 419 ms, sort 54 ms, write 853 ms, index 189 ms: 2 candidates, 20674 repo-hours, 13 releases; waiting 546 ms; commit 896 ms)
2026-11-07T04:43:27Z [load_day 2026-08-06] 2026-08-06 hour 13: 92281 events in 2 files, snapshot 8343710467698667245 (task 2543 ms: download 913 ms overlapping gunzip 123 ms, parse 502 ms, sort 60 ms, write 871 ms, index 128 ms: 0 candidates, 19852 repo-hours, 13 releases; waiting 526 ms; commit 874 ms)
2026-11-07T04:43:28Z [load_day 2026-08-06] 2026-08-06 hour 14: 64906 events in 2 files, snapshot 6330443430356922368 (task 1845 ms: download 578 ms overlapping gunzip 95 ms, parse 357 ms, sort 41 ms, write 641 ms, index 155 ms: 2 candidates, 19519 repo-hours, 12 releases; waiting 279 ms; commit 806 ms)
2026-11-07T04:43:29Z [load_day 2026-08-06] 2026-08-06 hour 15: 75211 events in 2 files, snapshot 3832553186095439694 (task 2218 ms: download 866 ms overlapping gunzip 105 ms, parse 396 ms, sort 49 ms, write 722 ms, index 152 ms: 1 candidates, 19605 repo-hours, 18 releases; waiting 520 ms; commit 762 ms)
2026-11-07T04:43:31Z [load_day 2026-08-06] 2026-08-06 hour 16: 72681 events in 2 files, snapshot 3776911088181791385 (task 2067 ms: download 679 ms overlapping gunzip 100 ms, parse 394 ms, sort 43 ms, write 710 ms, index 139 ms: 1 candidates, 16703 repo-hours, 8 releases; waiting 349 ms; commit 1200 ms)
2026-11-07T04:43:33Z [load_day 2026-08-06] 2026-08-06 hour 17: 78928 events in 2 files, snapshot 162563859013570275 (task 2357 ms: download 899 ms overlapping gunzip 110 ms, parse 423 ms, sort 47 ms, write 736 ms, index 155 ms: 1 candidates, 21140 repo-hours, 13 releases; waiting 537 ms; commit 1079 ms)
2026-11-07T04:43:34Z [load_day 2026-08-06] 2026-08-06 hour 18: 95703 events in 2 files, snapshot 8534429584032037218 (task 2444 ms: download 1056 ms overlapping gunzip 114 ms, parse 453 ms, sort 57 ms, write 842 ms, index 139 ms: 0 candidates, 21068 repo-hours, 12 releases; waiting 530 ms; commit 986 ms)
2026-11-07T04:43:36Z [load_day 2026-08-06] 2026-08-06 hour 19: 115675 events in 3 files, snapshot 3368442656584663671 (task 2741 ms: download 1084 ms overlapping gunzip 138 ms, parse 541 ms, sort 71 ms, write 1018 ms, index 157 ms: 1 candidates, 25674 repo-hours, 11 releases; waiting 530 ms; commit 892 ms)
2026-11-07T04:43:38Z [load_day 2026-08-06] 2026-08-06 hour 20: 137996 events in 3 files, snapshot 7517593059295993356 (task 3128 ms: download 1613 ms overlapping gunzip 160 ms, parse 629 ms, sort 86 ms, write 1161 ms, index 182 ms: 2 candidates, 29283 repo-hours, 9 releases; waiting 572 ms; commit 908 ms)
2026-11-07T04:43:40Z [load_day 2026-08-06] 2026-08-06 hour 21: 146478 events in 3 files, snapshot 1290579712607532272 (task 3270 ms: download 1101 ms overlapping gunzip 177 ms, parse 714 ms, sort 106 ms, write 1231 ms, index 214 ms: 4 candidates, 25262 repo-hours, 8 releases; waiting 537 ms; commit 817 ms)
2026-11-07T04:43:42Z [load_day 2026-08-06] 2026-08-06 hour 22: 149150 events in 3 files, snapshot 2531633408330950150 (task 3112 ms: download 1174 ms overlapping gunzip 170 ms, parse 670 ms, sort 92 ms, write 1194 ms, index 192 ms: 3 candidates, 28261 repo-hours, 16 releases; waiting 534 ms; commit 872 ms)
2026-11-07T04:43:44Z [load_day 2026-08-06] 2026-08-06 hour 23: 162536 events in 4 files, snapshot 4698284373074376908 (task 3408 ms: download 1382 ms overlapping gunzip 201 ms, parse 766 ms, sort 99 ms, write 1317 ms, index 201 ms: 1 candidates, 31951 repo-hours, 12 releases; waiting 472 ms; commit 826 ms)
2026-11-07T04:43:47Z [load_day 2026-08-06] 2026-08-06: repo_hour merged from 24 files to 1 (602748 rows, 3132 ms)
2026-11-07T04:43:49Z [load_day 2026-08-06] 2026-08-06: index committed in 4802 ms (18 + 1 + 24 files)
2026-11-07T04:43:49Z [load_day 2026-08-06] 2026-08-06: 2969878 events in 24 hours
2026-11-07T04:43:49Z [load_day 2026-08-06] attempt 1 succeeded