orcaLog in

Runs · run 314

load_day 2026-08-05, attempt 1 succeeded

Host
4e84322b8c45:55629
Started
2026-11-07T04:43:50Z
Ended
2026-11-07T04:45:44Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/314/load_day/2026-08-05/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:43:50Z [load_day 2026-08-05] attempt 1 started
2026-11-07T04:43:56Z [load_day 2026-08-05] 2026-08-05 hour 0: 169581 events in 4 files, snapshot 5960230768853021571 (task 3667 ms: download 1479 ms overlapping gunzip 191 ms, parse 795 ms, sort 111 ms, write 1505 ms, index 254 ms: 2 candidates, 36859 repo-hours, 7 releases; waiting 534 ms; commit 910 ms)
2026-11-07T04:43:57Z [load_day 2026-08-05] 2026-08-05 hour 1: 167085 events in 4 files, snapshot 3919797786960080146 (task 3467 ms: download 974 ms overlapping gunzip 213 ms, parse 775 ms, sort 121 ms, write 1532 ms, index 298 ms: 4 candidates, 45963 repo-hours, 12 releases; waiting 208 ms; commit 992 ms)
2026-11-07T04:44:01Z [load_day 2026-08-05] 2026-08-05 hour 2: 171981 events in 4 files, snapshot 4269048805696702025 (task 3815 ms: download 1348 ms overlapping gunzip 221 ms, parse 808 ms, sort 107 ms, write 1607 ms, index 281 ms: 6 candidates, 45297 repo-hours, 13 releases; waiting 470 ms; commit 1002 ms)
2026-11-07T04:44:03Z [load_day 2026-08-05] 2026-08-05 hour 3: 170285 events in 4 files, snapshot 6151839970397433843 (task 3622 ms: download 1232 ms overlapping gunzip 192 ms, parse 778 ms, sort 108 ms, write 1509 ms, index 188 ms: 0 candidates, 30346 repo-hours, 4 releases; waiting 524 ms; commit 1972 ms)
2026-11-07T04:44:05Z [load_day 2026-08-05] 2026-08-05 hour 4: 168790 events in 4 files, snapshot 148607600130369870 (task 3578 ms: download 1547 ms overlapping gunzip 190 ms, parse 764 ms, sort 103 ms, write 1470 ms, index 189 ms: 2 candidates, 23568 repo-hours, 3 releases; waiting 550 ms; commit 935 ms)
2026-11-07T04:44:07Z [load_day 2026-08-05] 2026-08-05 hour 5: 166840 events in 4 files, snapshot 8030529190104763852 (task 3555 ms: download 1652 ms overlapping gunzip 181 ms, parse 744 ms, sort 104 ms, write 1559 ms, index 158 ms: 1 candidates, 22207 repo-hours, 7 releases; waiting 531 ms; commit 749 ms)
2026-11-07T04:44:09Z [load_day 2026-08-05] 2026-08-05 hour 6: 171763 events in 4 files, snapshot 4775335345269270733 (task 3590 ms: download 1475 ms overlapping gunzip 188 ms, parse 752 ms, sort 101 ms, write 1567 ms, index 152 ms: 1 candidates, 22709 repo-hours, 6 releases; waiting 531 ms; commit 816 ms)
2026-11-07T04:44:11Z [load_day 2026-08-05] 2026-08-05 hour 7: 156329 events in 4 files, snapshot 2464470795907911764 (task 3268 ms: download 1894 ms overlapping gunzip 174 ms, parse 693 ms, sort 94 ms, write 1287 ms, index 159 ms: 2 candidates, 21808 repo-hours, 13 releases; waiting 540 ms; commit 825 ms)
2026-11-07T04:44:13Z [load_day 2026-08-05] 2026-08-05 hour 8: 129062 events in 3 files, snapshot 1135736844078874539 (task 2973 ms: download 1142 ms overlapping gunzip 151 ms, parse 588 ms, sort 76 ms, write 1164 ms, index 155 ms: 3 candidates, 22163 repo-hours, 6 releases; waiting 531 ms; commit 929 ms)
2026-11-07T04:44:14Z [load_day 2026-08-05] 2026-08-05 hour 9: 103996 events in 3 files, snapshot 448788598019407532 (task 2620 ms: download 1041 ms overlapping gunzip 122 ms, parse 480 ms, sort 66 ms, write 939 ms, index 130 ms: 2 candidates, 18900 repo-hours, 13 releases; waiting 676 ms; commit 790 ms)
2026-11-07T04:44:15Z [load_day 2026-08-05] 2026-08-05 hour 10: 91590 events in 2 files, snapshot 1656341393792722643 (task 2357 ms: download 1085 ms overlapping gunzip 116 ms, parse 466 ms, sort 58 ms, write 785 ms, index 117 ms: 0 candidates, 18654 repo-hours, 12 releases; waiting 525 ms; commit 905 ms)
2026-11-07T04:45:17Z [load_day 2026-08-05] 2026-08-05 hour 11: 87259 events in 2 files, snapshot 118946506971767919 (task 61725 ms: download 60239 ms overlapping gunzip 169 ms, parse 624 ms, sort 63 ms, write 844 ms, index 151 ms: 0 candidates, 21267 repo-hours, 9 releases; waiting 59062 ms; commit 928 ms)
2026-11-07T04:45:17Z [load_day 2026-08-05] 2026-08-05 hour 12: 105145 events in 3 files, snapshot 2515181403762897118 (task 2659 ms: download 985 ms overlapping gunzip 128 ms, parse 490 ms, sort 65 ms, write 956 ms, index 154 ms: 1 candidates, 22049 repo-hours, 10 releases; waiting 534 ms; commit 692 ms)
2026-11-07T04:45:20Z [load_day 2026-08-05] 2026-08-05 hour 13: 106177 events in 3 files, snapshot 8189905165365731647 (task 2680 ms: download 959 ms overlapping gunzip 125 ms, parse 491 ms, sort 68 ms, write 1064 ms, index 170 ms: 3 candidates, 25509 repo-hours, 15 releases; waiting 536 ms; commit 980 ms)
2026-11-07T04:45:21Z [load_day 2026-08-05] 2026-08-05 hour 14: 113855 events in 3 files, snapshot 3608047745219729208 (task 2765 ms: download 1101 ms overlapping gunzip 135 ms, parse 522 ms, sort 70 ms, write 1078 ms, index 155 ms: 2 candidates, 22888 repo-hours, 18 releases; waiting 526 ms; commit 904 ms)
2026-11-07T04:45:23Z [load_day 2026-08-05] 2026-08-05 hour 15: 92633 events in 2 files, snapshot 7639546644835871573 (task 2388 ms: download 844 ms overlapping gunzip 114 ms, parse 446 ms, sort 62 ms, write 863 ms, index 151 ms: 0 candidates, 23746 repo-hours, 15 releases; waiting 436 ms; commit 911 ms)
2026-11-07T04:45:25Z [load_day 2026-08-05] 2026-08-05 hour 16: 102745 events in 3 files, snapshot 5335504531455248614 (task 2722 ms: download 1002 ms overlapping gunzip 132 ms, parse 510 ms, sort 68 ms, write 913 ms, index 160 ms: 0 candidates, 25523 repo-hours, 21 releases; waiting 639 ms; commit 1038 ms)
2026-11-07T04:45:26Z [load_day 2026-08-05] 2026-08-05 hour 17: 112588 events in 3 files, snapshot 3988768075518554052 (task 2824 ms: download 1011 ms overlapping gunzip 139 ms, parse 542 ms, sort 73 ms, write 1060 ms, index 209 ms: 2 candidates, 27562 repo-hours, 17 releases; waiting 525 ms; commit 956 ms)
2026-11-07T04:45:28Z [load_day 2026-08-05] 2026-08-05 hour 18: 127287 events in 3 files, snapshot 1901928230416572640 (task 3133 ms: download 1218 ms overlapping gunzip 157 ms, parse 607 ms, sort 87 ms, write 1269 ms, index 187 ms: 1 candidates, 27084 repo-hours, 13 releases; waiting 530 ms; commit 926 ms)
2026-11-07T04:45:30Z [load_day 2026-08-05] 2026-08-05 hour 19: 131561 events in 3 files, snapshot 2760549675728617882 (task 3014 ms: download 1196 ms overlapping gunzip 157 ms, parse 600 ms, sort 88 ms, write 1176 ms, index 213 ms: 2 candidates, 31454 repo-hours, 19 releases; waiting 517 ms; commit 935 ms)
2026-11-07T04:45:32Z [load_day 2026-08-05] 2026-08-05 hour 20: 142497 events in 3 files, snapshot 3389290014540713374 (task 3168 ms: download 1507 ms overlapping gunzip 171 ms, parse 663 ms, sort 96 ms, write 1209 ms, index 208 ms: 6 candidates, 31938 repo-hours, 11 releases; waiting 524 ms; commit 970 ms)
2026-11-07T04:45:34Z [load_day 2026-08-05] 2026-08-05 hour 21: 144391 events in 3 files, snapshot 9101731638905690372 (task 3329 ms: download 1304 ms overlapping gunzip 174 ms, parse 684 ms, sort 93 ms, write 1236 ms, index 269 ms: 4 candidates, 37125 repo-hours, 17 releases; waiting 526 ms; commit 946 ms)
2026-11-07T04:45:36Z [load_day 2026-08-05] 2026-08-05 hour 22: 157337 events in 4 files, snapshot 8322130742164664110 (task 3559 ms: download 1526 ms overlapping gunzip 187 ms, parse 714 ms, sort 106 ms, write 1369 ms, index 309 ms: 2 candidates, 40187 repo-hours, 30 releases; waiting 531 ms; commit 776 ms)
2026-11-07T04:45:38Z [load_day 2026-08-05] 2026-08-05 hour 23: 159288 events in 4 files, snapshot 5803786776291837628 (task 3649 ms: download 1381 ms overlapping gunzip 198 ms, parse 766 ms, sort 103 ms, write 1472 ms, index 267 ms: 4 candidates, 41895 repo-hours, 15 releases; waiting 521 ms; commit 920 ms)
2026-11-07T04:45:42Z [load_day 2026-08-05] 2026-08-05: repo_hour merged from 24 files to 1 (686701 rows, 3717 ms)
2026-11-07T04:45:44Z [load_day 2026-08-05] 2026-08-05: index committed in 5260 ms (19 + 1 + 24 files)
2026-11-07T04:45:44Z [load_day 2026-08-05] 2026-08-05: 3250065 events in 24 hours
2026-11-07T04:45:44Z [load_day 2026-08-05] attempt 1 succeeded