orcaLog in

Runs · run 639

load_day 2026-04-19, attempt 1 succeeded

Host
4e84322b8c45:155938
Started
2026-11-07T12:46:13Z
Ended
2026-11-07T12:47:48Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/639/load_day/2026-04-19/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T12:46:13Z [load_day 2026-04-19] attempt 1 started
2026-11-07T12:46:22Z [load_day 2026-04-19] 2026-04-19 hour 0: 142043 events in 3 files, snapshot 6362102174705974716 (task 6207 ms: download 2314 ms overlapping gunzip 358 ms, parse 1213 ms, sort 154 ms, write 3165 ms, index 419 ms: 9 candidates, 64778 repo-hours, 866 releases; waiting 532 ms; commit 1131 ms)
2026-11-07T12:46:23Z [load_day 2026-04-19] 2026-04-19 hour 1: 146409 events in 3 files, snapshot 2197552290557215867 (task 6165 ms: download 2078 ms overlapping gunzip 337 ms, parse 1218 ms, sort 167 ms, write 3000 ms, index 496 ms: 12 candidates, 74617 repo-hours, 777 releases; waiting 534 ms; commit 941 ms)
2026-11-07T12:46:29Z [load_day 2026-04-19] 2026-04-19 hour 2: 152284 events in 4 files, snapshot 4237320689760449882 (task 5821 ms: download 2070 ms overlapping gunzip 331 ms, parse 1103 ms, sort 117 ms, write 2771 ms, index 552 ms: 7 candidates, 83207 repo-hours, 663 releases; waiting 571 ms; commit 1194 ms)
2026-11-07T12:46:30Z [load_day 2026-04-19] 2026-04-19 hour 3: 149064 events in 3 files, snapshot 4794619611318295207 (task 6018 ms: download 2503 ms overlapping gunzip 367 ms, parse 1199 ms, sort 120 ms, write 2679 ms, index 579 ms: 5 candidates, 73485 repo-hours, 691 releases; waiting 654 ms; commit 1129 ms)
2026-11-07T12:46:35Z [load_day 2026-04-19] 2026-04-19 hour 4: 147624 events in 3 files, snapshot 2885833110579827342 (task 5699 ms: download 1541 ms overlapping gunzip 381 ms, parse 1199 ms, sort 155 ms, write 3064 ms, index 417 ms: 7 candidates, 63016 repo-hours, 825 releases; waiting 209 ms; commit 1367 ms)
2026-11-07T12:46:37Z [load_day 2026-04-19] 2026-04-19 hour 5: 149365 events in 3 files, snapshot 7894680240650235814 (task 5825 ms: download 1968 ms overlapping gunzip 353 ms, parse 1179 ms, sort 170 ms, write 2615 ms, index 474 ms: 3 candidates, 70361 repo-hours, 741 releases; waiting 680 ms; commit 1384 ms)
2026-11-07T12:46:42Z [load_day 2026-04-19] 2026-04-19 hour 6: 145862 events in 3 files, snapshot 1241302276609055196 (task 5916 ms: download 2534 ms overlapping gunzip 357 ms, parse 1142 ms, sort 188 ms, write 2650 ms, index 488 ms: 5 candidates, 71103 repo-hours, 731 releases; waiting 741 ms; commit 1364 ms)
2026-11-07T12:46:43Z [load_day 2026-04-19] 2026-04-19 hour 7: 150491 events in 4 files, snapshot 7209408478150818514 (task 5413 ms: download 2002 ms overlapping gunzip 320 ms, parse 1083 ms, sort 126 ms, write 2464 ms, index 512 ms: 11 candidates, 77070 repo-hours, 707 releases; waiting 547 ms; commit 1371 ms)
2026-11-07T12:46:49Z [load_day 2026-04-19] 2026-04-19 hour 8: 148390 events in 3 files, snapshot 2704235469721207388 (task 5928 ms: download 2269 ms overlapping gunzip 356 ms, parse 1162 ms, sort 118 ms, write 2894 ms, index 518 ms: 10 candidates, 75082 repo-hours, 744 releases; waiting 550 ms; commit 1307 ms)
2026-11-07T12:46:50Z [load_day 2026-04-19] 2026-04-19 hour 9: 152957 events in 4 files, snapshot 546691884872015444 (task 6206 ms: download 1868 ms overlapping gunzip 357 ms, parse 1190 ms, sort 131 ms, write 2974 ms, index 507 ms: 9 candidates, 75184 repo-hours, 730 releases; waiting 551 ms; commit 1262 ms)
2026-11-07T12:46:55Z [load_day 2026-04-19] 2026-04-19 hour 10: 154150 events in 4 files, snapshot 83468571311184970 (task 5727 ms: download 1845 ms overlapping gunzip 335 ms, parse 1100 ms, sort 126 ms, write 2691 ms, index 545 ms: 3 candidates, 76744 repo-hours, 612 releases; waiting 627 ms; commit 1084 ms)
2026-11-07T12:47:02Z [load_day 2026-04-19] 2026-04-19 hour 11: 149306 events in 3 files, snapshot 665851490866149927 (task 5467 ms: download 1458 ms overlapping gunzip 332 ms, parse 1105 ms, sort 128 ms, write 2775 ms, index 526 ms: 5 candidates, 76292 repo-hours, 616 releases; waiting 262 ms; commit 6719 ms)
2026-11-07T12:47:06Z [load_day 2026-04-19] 2026-04-19 hour 12: 156528 events in 4 files, snapshot 46012437473653530 (task 10016 ms: download 1662 ms overlapping gunzip 329 ms, parse 1117 ms, sort 127 ms, write 4290 ms, index 3236 ms: 5 candidates, 87297 repo-hours, 624 releases; waiting 639 ms; commit 1096 ms)
2026-11-07T12:47:07Z [load_day 2026-04-19] 2026-04-19 hour 13: 156232 events in 4 files, snapshot 9181869883511047854 (task 4764 ms: download 1147 ms overlapping gunzip 310 ms, parse 1021 ms, sort 133 ms, write 2156 ms, index 617 ms: 4 candidates, 90528 repo-hours, 550 releases; waiting 208 ms; commit 1023 ms)
2026-11-07T12:47:13Z [load_day 2026-04-19] 2026-04-19 hour 14: 155562 events in 4 files, snapshot 8589830134876000572 (task 5740 ms: download 1799 ms overlapping gunzip 335 ms, parse 1100 ms, sort 119 ms, write 2792 ms, index 550 ms: 8 candidates, 82913 repo-hours, 571 releases; waiting 517 ms; commit 1398 ms)
2026-11-07T12:47:14Z [load_day 2026-04-19] 2026-04-19 hour 15: 156809 events in 4 files, snapshot 977980119066400088 (task 5978 ms: download 2242 ms overlapping gunzip 343 ms, parse 1146 ms, sort 143 ms, write 2876 ms, index 558 ms: 11 candidates, 81816 repo-hours, 593 releases; waiting 613 ms; commit 1098 ms)
2026-11-07T12:47:19Z [load_day 2026-04-19] 2026-04-19 hour 16: 152256 events in 4 files, snapshot 2829527355937821320 (task 5856 ms: download 1989 ms overlapping gunzip 333 ms, parse 1081 ms, sort 138 ms, write 2691 ms, index 609 ms: 11 candidates, 80663 repo-hours, 626 releases; waiting 662 ms; commit 1067 ms)
2026-11-07T12:47:20Z [load_day 2026-04-19] 2026-04-19 hour 17: 154834 events in 4 files, snapshot 7846239993925271319 (task 5236 ms: download 1285 ms overlapping gunzip 301 ms, parse 988 ms, sort 141 ms, write 2725 ms, index 649 ms: 10 candidates, 81763 repo-hours, 601 releases; waiting 186 ms; commit 1345 ms)
2026-11-07T12:47:25Z [load_day 2026-04-19] 2026-04-19 hour 18: 152714 events in 4 files, snapshot 2438580117301685012 (task 5650 ms: download 1817 ms overlapping gunzip 328 ms, parse 1079 ms, sort 143 ms, write 2685 ms, index 559 ms: 5 candidates, 81395 repo-hours, 588 releases; waiting 536 ms; commit 1095 ms)
2026-11-07T12:47:26Z [load_day 2026-04-19] 2026-04-19 hour 19: 154132 events in 4 files, snapshot 2144603244654046901 (task 5664 ms: download 2072 ms overlapping gunzip 315 ms, parse 1081 ms, sort 126 ms, write 2584 ms, index 638 ms: 7 candidates, 78904 repo-hours, 649 releases; waiting 595 ms; commit 1023 ms)
2026-11-07T12:47:31Z [load_day 2026-04-19] 2026-04-19 hour 20: 150145 events in 4 files, snapshot 5242161987469251890 (task 5848 ms: download 1810 ms overlapping gunzip 341 ms, parse 1165 ms, sort 181 ms, write 2602 ms, index 585 ms: 8 candidates, 74996 repo-hours, 670 releases; waiting 620 ms; commit 1032 ms)
2026-11-07T12:47:32Z [load_day 2026-04-19] 2026-04-19 hour 21: 146802 events in 3 files, snapshot 8117790707562979686 (task 5552 ms: download 1663 ms overlapping gunzip 340 ms, parse 1157 ms, sort 129 ms, write 2567 ms, index 501 ms: 5 candidates, 70997 repo-hours, 785 releases; waiting 558 ms; commit 988 ms)
2026-11-07T12:47:38Z [load_day 2026-04-19] 2026-04-19 hour 22: 142629 events in 3 files, snapshot 3221415521475389624 (task 5815 ms: download 1884 ms overlapping gunzip 427 ms, parse 1320 ms, sort 133 ms, write 2515 ms, index 528 ms: 6 candidates, 65690 repo-hours, 776 releases; waiting 566 ms; commit 1214 ms)
2026-11-07T12:47:39Z [load_day 2026-04-19] 2026-04-19 hour 23: 150193 events in 4 files, snapshot 6277981356204532516 (task 5401 ms: download 1633 ms overlapping gunzip 420 ms, parse 1345 ms, sort 198 ms, write 2396 ms, index 480 ms: 7 candidates, 71729 repo-hours, 740 releases; waiting 350 ms; commit 1015 ms)
2026-11-07T12:47:46Z [load_day 2026-04-19] 2026-04-19: repo_hour merged from 24 files to 1 (1829630 rows, 7552 ms)
2026-11-07T12:47:48Z [load_day 2026-04-19] 2026-04-19: index committed in 9406 ms (24 + 1 + 24 files)
2026-11-07T12:47:48Z [load_day 2026-04-19] 2026-04-19: 3616781 events in 24 hours
2026-11-07T12:47:48Z [load_day 2026-04-19] attempt 1 succeeded