orcaLog in

Runs · run 702

load_day 2026-03-29, attempt 1 succeeded

Host
4e84322b8c45:173701
Started
2026-11-07T13:20:42Z
Ended
2026-11-07T13:22:33Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/702/load_day/2026-03-29/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T13:20:42Z [load_day 2026-03-29] attempt 1 started
2026-11-07T13:20:52Z [load_day 2026-03-29] 2026-03-29 hour 0: 154527 events in 4 files, snapshot 3728431592196964313 (task 7025 ms: download 2294 ms overlapping gunzip 471 ms, parse 1489 ms, sort 170 ms, write 3752 ms, index 421 ms: 5 candidates, 66837 repo-hours, 1084 releases; waiting 405 ms; commit 1190 ms)
2026-11-07T13:20:53Z [load_day 2026-03-29] 2026-03-29 hour 1: 152468 events in 4 files, snapshot 5059685382405515374 (task 6685 ms: download 1994 ms overlapping gunzip 403 ms, parse 1398 ms, sort 163 ms, write 3485 ms, index 531 ms: 7 candidates, 82315 repo-hours, 693 releases; waiting 315 ms; commit 1310 ms)
2026-11-07T13:20:59Z [load_day 2026-03-29] 2026-03-29 hour 2: 159100 events in 4 files, snapshot 2516651319550659922 (task 6075 ms: download 1822 ms overlapping gunzip 424 ms, parse 1362 ms, sort 143 ms, write 2784 ms, index 587 ms: 9 candidates, 87266 repo-hours, 670 releases; waiting 540 ms; commit 1153 ms)
2026-11-07T13:21:02Z [load_day 2026-03-29] 2026-03-29 hour 3: 154398 events in 4 files, snapshot 3025789950522033859 (task 7629 ms: download 2564 ms overlapping gunzip 578 ms, parse 1876 ms, sort 242 ms, write 3384 ms, index 545 ms: 10 candidates, 69506 repo-hours, 810 releases; waiting 660 ms; commit 1550 ms)
2026-11-07T13:21:14Z [load_day 2026-03-29] 2026-03-29 hour 4: 157751 events in 4 files, snapshot 5140665165257136454 (task 14232 ms: download 3651 ms overlapping gunzip 967 ms, parse 2729 ms, sort 423 ms, write 8848 ms, index 419 ms: 4 candidates, 62902 repo-hours, 653 releases; waiting 475 ms; commit 1401 ms)
2026-11-07T13:21:18Z [load_day 2026-03-29] 2026-03-29 hour 5: 161865 events in 4 files, snapshot 2169825660726584938 (task 15201 ms: download 4091 ms overlapping gunzip 1080 ms, parse 3145 ms, sort 396 ms, write 8942 ms, index 907 ms: 5 candidates, 65944 repo-hours, 541 releases; waiting 336 ms; commit 1259 ms)
2026-11-07T13:21:26Z [load_day 2026-03-29] 2026-03-29 hour 6: 158767 events in 4 files, snapshot 1997180114573154904 (task 11113 ms: download 3296 ms overlapping gunzip 982 ms, parse 2792 ms, sort 238 ms, write 6091 ms, index 443 ms: 7 candidates, 66569 repo-hours, 498 releases; waiting 259 ms; commit 1340 ms)
2026-11-07T13:21:27Z [load_day 2026-03-29] 2026-03-29 hour 7: 159909 events in 4 files, snapshot 7089092215610976325 (task 7244 ms: download 3300 ms overlapping gunzip 627 ms, parse 1918 ms, sort 158 ms, write 3071 ms, index 500 ms: 7 candidates, 74282 repo-hours, 509 releases; waiting 642 ms; commit 1282 ms)
2026-11-07T13:21:35Z [load_day 2026-03-29] 2026-03-29 hour 8: 159581 events in 4 files, snapshot 5233408784742991415 (task 7771 ms: download 3206 ms overlapping gunzip 676 ms, parse 1990 ms, sort 164 ms, write 3374 ms, index 496 ms: 7 candidates, 73897 repo-hours, 492 releases; waiting 688 ms; commit 1375 ms)
2026-11-07T13:21:36Z [load_day 2026-03-29] 2026-03-29 hour 9: 155157 events in 4 files, snapshot 5235345365258265712 (task 6693 ms: download 2727 ms overlapping gunzip 551 ms, parse 1648 ms, sort 216 ms, write 2706 ms, index 490 ms: 8 candidates, 73359 repo-hours, 523 releases; waiting 777 ms; commit 1281 ms)
2026-11-07T13:21:42Z [load_day 2026-03-29] 2026-03-29 hour 10: 164040 events in 4 files, snapshot 2923618053332060020 (task 7079 ms: download 2927 ms overlapping gunzip 556 ms, parse 1633 ms, sort 191 ms, write 3155 ms, index 550 ms: 11 candidates, 78470 repo-hours, 462 releases; waiting 646 ms; commit 1198 ms)
2026-11-07T13:21:44Z [load_day 2026-03-29] 2026-03-29 hour 11: 160036 events in 4 files, snapshot 6738350917631000275 (task 7097 ms: download 2532 ms overlapping gunzip 553 ms, parse 1699 ms, sort 197 ms, write 3154 ms, index 508 ms: 13 candidates, 76977 repo-hours, 548 releases; waiting 636 ms; commit 1151 ms)
2026-11-07T13:21:49Z [load_day 2026-03-29] 2026-03-29 hour 12: 166233 events in 4 files, snapshot 8219517394078098223 (task 5983 ms: download 2372 ms overlapping gunzip 397 ms, parse 1286 ms, sort 143 ms, write 2221 ms, index 690 ms: 12 candidates, 93466 repo-hours, 272 releases; waiting 963 ms; commit 1556 ms)
2026-11-07T13:21:50Z [load_day 2026-03-29] 2026-03-29 hour 13: 172647 events in 4 files, snapshot 2871216991967941064 (task 5432 ms: download 1894 ms overlapping gunzip 388 ms, parse 1188 ms, sort 128 ms, write 2158 ms, index 672 ms: 10 candidates, 98757 repo-hours, 143 releases; waiting 538 ms; commit 1154 ms)
2026-11-07T13:21:55Z [load_day 2026-03-29] 2026-03-29 hour 14: 169703 events in 4 files, snapshot 7274725920165283567 (task 5586 ms: download 1982 ms overlapping gunzip 390 ms, parse 1220 ms, sort 165 ms, write 2395 ms, index 602 ms: 7 candidates, 88515 repo-hours, 226 releases; waiting 557 ms; commit 1196 ms)
2026-11-07T13:21:56Z [load_day 2026-03-29] 2026-03-29 hour 15: 166218 events in 4 files, snapshot 1659410352831334168 (task 5106 ms: download 2466 ms overlapping gunzip 384 ms, parse 1242 ms, sort 129 ms, write 1965 ms, index 582 ms: 8 candidates, 88060 repo-hours, 226 releases; waiting 529 ms; commit 1257 ms)
2026-11-07T13:22:02Z [load_day 2026-03-29] 2026-03-29 hour 16: 169048 events in 4 files, snapshot 2142021378450620994 (task 5570 ms: download 2157 ms overlapping gunzip 356 ms, parse 1134 ms, sort 145 ms, write 2261 ms, index 594 ms: 10 candidates, 87460 repo-hours, 241 releases; waiting 765 ms; commit 1476 ms)
2026-11-07T13:22:03Z [load_day 2026-03-29] 2026-03-29 hour 17: 169171 events in 4 files, snapshot 3278319718329158946 (task 5371 ms: download 2345 ms overlapping gunzip 381 ms, parse 1219 ms, sort 132 ms, write 2047 ms, index 635 ms: 13 candidates, 87087 repo-hours, 202 releases; waiting 685 ms; commit 1193 ms)
2026-11-07T13:22:07Z [load_day 2026-03-29] 2026-03-29 hour 18: 170648 events in 4 files, snapshot 2406177419376185635 (task 5342 ms: download 1735 ms overlapping gunzip 320 ms, parse 1092 ms, sort 161 ms, write 2268 ms, index 638 ms: 8 candidates, 91728 repo-hours, 250 releases; waiting 544 ms; commit 1214 ms)
2026-11-07T13:22:09Z [load_day 2026-03-29] 2026-03-29 hour 19: 170332 events in 4 files, snapshot 6776278148155591798 (task 5670 ms: download 2032 ms overlapping gunzip 364 ms, parse 1219 ms, sort 145 ms, write 2387 ms, index 560 ms: 9 candidates, 86300 repo-hours, 364 releases; waiting 598 ms; commit 1260 ms)
2026-11-07T13:22:14Z [load_day 2026-03-29] 2026-03-29 hour 20: 160613 events in 4 files, snapshot 5702844324594598239 (task 6171 ms: download 1931 ms overlapping gunzip 393 ms, parse 1306 ms, sort 187 ms, write 2893 ms, index 524 ms: 15 candidates, 79413 repo-hours, 557 releases; waiting 545 ms; commit 1276 ms)
2026-11-07T13:22:16Z [load_day 2026-03-29] 2026-03-29 hour 21: 161796 events in 4 files, snapshot 188124178680141439 (task 6159 ms: download 1711 ms overlapping gunzip 425 ms, parse 1478 ms, sort 201 ms, write 2665 ms, index 519 ms: 7 candidates, 77997 repo-hours, 832 releases; waiting 261 ms; commit 1165 ms)
2026-11-07T13:22:22Z [load_day 2026-03-29] 2026-03-29 hour 22: 158301 events in 4 files, snapshot 8803941213934676636 (task 7047 ms: download 2095 ms overlapping gunzip 450 ms, parse 1488 ms, sort 166 ms, write 3642 ms, index 499 ms: 5 candidates, 72936 repo-hours, 902 releases; waiting 539 ms; commit 1281 ms)
2026-11-07T13:22:23Z [load_day 2026-03-29] 2026-03-29 hour 23: 153646 events in 4 files, snapshot 5036720710518873130 (task 6904 ms: download 2597 ms overlapping gunzip 444 ms, parse 1448 ms, sort 163 ms, write 3368 ms, index 471 ms: 7 candidates, 67641 repo-hours, 947 releases; waiting 745 ms; commit 1161 ms)
2026-11-07T13:22:31Z [load_day 2026-03-29] 2026-03-29: repo_hour merged from 24 files to 1 (1897684 rows, 7631 ms)
2026-11-07T13:22:33Z [load_day 2026-03-29] 2026-03-29: index committed in 9716 ms (24 + 1 + 24 files)
2026-11-07T13:22:33Z [load_day 2026-03-29] 2026-03-29: 3885955 events in 24 hours
2026-11-07T13:22:33Z [load_day 2026-03-29] attempt 1 succeeded