orcaLog in

Runs · run 551

load_day 2026-05-18, attempt 1 succeeded

Host
4e84322b8c45:122401
Started
2026-11-07T06:24:29Z
Ended
2026-11-07T06:25:35Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/551/load_day/2026-05-18/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:24:29Z [load_day 2026-05-18] attempt 1 started
2026-11-07T06:24:38Z [load_day 2026-05-18] 2026-05-18 hour 0: 144917 events in 3 files, snapshot 3421227390771804895 (task 5902 ms: download 2004 ms overlapping gunzip 355 ms, parse 1196 ms, sort 141 ms, write 2942 ms, index 469 ms: 8 candidates, 68143 repo-hours, 682 releases; waiting 511 ms; commit 1101 ms)
2026-11-07T06:24:39Z [load_day 2026-05-18] 2026-05-18 hour 1: 152299 events in 4 files, snapshot 2069677850802370396 (task 5777 ms: download 1989 ms overlapping gunzip 345 ms, parse 1165 ms, sort 165 ms, write 2837 ms, index 485 ms: 3 candidates, 75294 repo-hours, 510 releases; waiting 518 ms; commit 911 ms)
2026-11-07T06:24:43Z [load_day 2026-05-18] 2026-05-18 hour 2: 155826 events in 4 files, snapshot 1644326459277658257 (task 4685 ms: download 1699 ms overlapping gunzip 260 ms, parse 948 ms, sort 111 ms, write 1983 ms, index 545 ms: 3 candidates, 86388 repo-hours, 235 releases; waiting 529 ms; commit 1200 ms)
2026-11-07T06:24:45Z [load_day 2026-05-18] 2026-05-18 hour 3: 150232 events in 4 files, snapshot 4747297254288385467 (task 5040 ms: download 1739 ms overlapping gunzip 317 ms, parse 1041 ms, sort 161 ms, write 2187 ms, index 491 ms: 6 candidates, 77589 repo-hours, 399 releases; waiting 538 ms; commit 1263 ms)
2026-11-07T06:24:48Z [load_day 2026-05-18] 2026-05-18 hour 4: 153830 events in 4 files, snapshot 8189885145451207875 (task 4691 ms: download 1561 ms overlapping gunzip 291 ms, parse 993 ms, sort 121 ms, write 1910 ms, index 574 ms: 7 candidates, 80164 repo-hours, 357 releases; waiting 515 ms; commit 1016 ms)
2026-11-07T06:24:50Z [load_day 2026-05-18] 2026-05-18 hour 5: 145949 events in 3 files, snapshot 324454246591065639 (task 4589 ms: download 1447 ms overlapping gunzip 305 ms, parse 1021 ms, sort 101 ms, write 1952 ms, index 473 ms: 12 candidates, 73775 repo-hours, 353 releases; waiting 525 ms; commit 1213 ms)
2026-11-07T06:24:53Z [load_day 2026-05-18] 2026-05-18 hour 6: 152078 events in 4 files, snapshot 448870578463404131 (task 3988 ms: download 1109 ms overlapping gunzip 243 ms, parse 802 ms, sort 106 ms, write 1780 ms, index 523 ms: 10 candidates, 78938 repo-hours, 204 releases; waiting 220 ms; commit 1159 ms)
2026-11-07T06:24:54Z [load_day 2026-05-18] 2026-05-18 hour 7: 149484 events in 3 files, snapshot 6867384269917840858 (task 3361 ms: download 1180 ms overlapping gunzip 221 ms, parse 731 ms, sort 96 ms, write 1319 ms, index 504 ms: 11 candidates, 79209 repo-hours, 127 releases; waiting 194 ms; commit 1145 ms)
2026-11-07T06:24:57Z [load_day 2026-05-18] 2026-05-18 hour 8: 131073 events in 3 files, snapshot 981715144707838862 (task 3508 ms: download 1243 ms overlapping gunzip 181 ms, parse 641 ms, sort 84 ms, write 1308 ms, index 475 ms: 3 candidates, 70982 repo-hours, 54 releases; waiting 525 ms; commit 1208 ms)
2026-11-07T06:24:58Z [load_day 2026-05-18] 2026-05-18 hour 9: 83481 events in 2 files, snapshot 8910945123626696052 (task 2434 ms: download 551 ms overlapping gunzip 110 ms, parse 387 ms, sort 52 ms, write 966 ms, index 408 ms: 6 candidates, 51018 repo-hours, 38 releases; waiting 182 ms; commit 1096 ms)
2026-11-07T06:25:01Z [load_day 2026-05-18] 2026-05-18 hour 10: 82898 events in 2 files, snapshot 3754698285624979966 (task 2753 ms: download 1053 ms overlapping gunzip 128 ms, parse 448 ms, sort 49 ms, write 801 ms, index 402 ms: 2 candidates, 50702 repo-hours, 51 releases; waiting 648 ms; commit 1174 ms)
2026-11-07T06:25:02Z [load_day 2026-05-18] 2026-05-18 hour 11: 92125 events in 2 files, snapshot 4047289702805275407 (task 2808 ms: download 1059 ms overlapping gunzip 130 ms, parse 465 ms, sort 62 ms, write 916 ms, index 379 ms: 3 candidates, 56236 repo-hours, 39 releases; waiting 538 ms; commit 1163 ms)
2026-11-07T06:25:04Z [load_day 2026-05-18] 2026-05-18 hour 12: 85927 events in 2 files, snapshot 9083846837923367680 (task 2452 ms: download 572 ms overlapping gunzip 107 ms, parse 420 ms, sort 54 ms, write 832 ms, index 386 ms: 2 candidates, 53747 repo-hours, 99 releases; waiting 184 ms; commit 1170 ms)
2026-11-07T06:25:05Z [load_day 2026-05-18] 2026-05-18 hour 13: 86347 events in 2 files, snapshot 5573005081598763581 (task 2724 ms: download 914 ms overlapping gunzip 121 ms, parse 436 ms, sort 55 ms, write 851 ms, index 361 ms: 1 candidates, 55276 repo-hours, 35 releases; waiting 525 ms; commit 1063 ms)
2026-11-07T06:25:07Z [load_day 2026-05-18] 2026-05-18 hour 14: 83868 events in 2 files, snapshot 1256258217488508927 (task 2617 ms: download 1036 ms overlapping gunzip 117 ms, parse 418 ms, sort 52 ms, write 842 ms, index 358 ms: 7 candidates, 56077 repo-hours, 33 releases; waiting 532 ms; commit 1057 ms)
2026-11-07T06:25:08Z [load_day 2026-05-18] 2026-05-18 hour 15: 89539 events in 2 files, snapshot 6110361614909685494 (task 2658 ms: download 927 ms overlapping gunzip 118 ms, parse 435 ms, sort 54 ms, write 885 ms, index 377 ms: 3 candidates, 59268 repo-hours, 27 releases; waiting 538 ms; commit 1152 ms)
2026-11-07T06:25:11Z [load_day 2026-05-18] 2026-05-18 hour 16: 84954 events in 2 files, snapshot 2918961352388957391 (task 2626 ms: download 1075 ms overlapping gunzip 126 ms, parse 446 ms, sort 66 ms, write 849 ms, index 356 ms: 2 candidates, 53612 repo-hours, 40 releases; waiting 534 ms; commit 1183 ms)
2026-11-07T06:25:12Z [load_day 2026-05-18] 2026-05-18 hour 17: 91934 events in 2 files, snapshot 13416970816819845 (task 2804 ms: download 980 ms overlapping gunzip 132 ms, parse 482 ms, sort 67 ms, write 880 ms, index 374 ms: 10 candidates, 57083 repo-hours, 48 releases; waiting 544 ms; commit 1104 ms)
2026-11-07T06:25:14Z [load_day 2026-05-18] 2026-05-18 hour 18: 88906 events in 2 files, snapshot 8961159515711507738 (task 2755 ms: download 927 ms overlapping gunzip 120 ms, parse 429 ms, sort 55 ms, write 872 ms, index 471 ms: 6 candidates, 55256 repo-hours, 31 releases; waiting 535 ms; commit 1223 ms)
2026-11-07T06:25:16Z [load_day 2026-05-18] 2026-05-18 hour 19: 140636 events in 3 files, snapshot 6944763837376979082 (task 3771 ms: download 1179 ms overlapping gunzip 188 ms, parse 690 ms, sort 92 ms, write 1417 ms, index 561 ms: 7 candidates, 79845 repo-hours, 45 releases; waiting 542 ms; commit 1305 ms)
2026-11-07T06:25:19Z [load_day 2026-05-18] 2026-05-18 hour 20: 156467 events in 4 files, snapshot 329095150971719200 (task 4295 ms: download 1409 ms overlapping gunzip 224 ms, parse 804 ms, sort 118 ms, write 1810 ms, index 531 ms: 5 candidates, 81974 repo-hours, 116 releases; waiting 534 ms; commit 1182 ms)
2026-11-07T06:25:21Z [load_day 2026-05-18] 2026-05-18 hour 21: 151856 events in 4 files, snapshot 3039721984702578499 (task 4310 ms: download 1608 ms overlapping gunzip 245 ms, parse 852 ms, sort 117 ms, write 1682 ms, index 618 ms: 8 candidates, 79262 repo-hours, 187 releases; waiting 503 ms; commit 1032 ms)
2026-11-07T06:25:24Z [load_day 2026-05-18] 2026-05-18 hour 22: 149777 events in 3 files, snapshot 8531798176185162988 (task 4613 ms: download 1431 ms overlapping gunzip 279 ms, parse 964 ms, sort 126 ms, write 2177 ms, index 485 ms: 4 candidates, 74862 repo-hours, 303 releases; waiting 283 ms; commit 1034 ms)
2026-11-07T06:25:27Z [load_day 2026-05-18] 2026-05-18 hour 23: 145094 events in 3 files, snapshot 8198485010856645101 (task 4934 ms: download 1568 ms overlapping gunzip 322 ms, parse 1078 ms, sort 126 ms, write 2368 ms, index 431 ms: 3 candidates, 68440 repo-hours, 497 releases; waiting 314 ms; commit 1077 ms)
2026-11-07T06:25:34Z [load_day 2026-05-18] 2026-05-18: repo_hour merged from 24 files to 1 (1623140 rows, 7024 ms)
2026-11-07T06:25:35Z [load_day 2026-05-18] 2026-05-18: index committed in 8612 ms (24 + 1 + 24 files)
2026-11-07T06:25:35Z [load_day 2026-05-18] 2026-05-18: 2949497 events in 24 hours
2026-11-07T06:25:35Z [load_day 2026-05-18] attempt 1 succeeded