orcaLog in

Runs · run 434

load_day 2026-06-26, attempt 1 succeeded

Host
4e84322b8c45:89717
Started
2026-11-07T05:33:27Z
Ended
2026-11-07T05:34:37Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/434/load_day/2026-06-26/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:33:27Z [load_day 2026-06-26] attempt 1 started
2026-11-07T05:33:35Z [load_day 2026-06-26] 2026-06-26 hour 0: 151808 events in 4 files, snapshot 4031710468053100324 (task 4184 ms: download 1433 ms overlapping gunzip 217 ms, parse 824 ms, sort 108 ms, write 1557 ms, index 408 ms: 4 candidates, 64014 repo-hours, 161 releases; waiting 718 ms; commit 1024 ms)
2026-11-07T05:33:36Z [load_day 2026-06-26] 2026-06-26 hour 1: 149120 events in 3 files, snapshot 2648186595388894055 (task 3420 ms: download 865 ms overlapping gunzip 208 ms, parse 758 ms, sort 119 ms, write 1430 ms, index 461 ms: 3 candidates, 63806 repo-hours, 99 releases; waiting 229 ms; commit 924 ms)
2026-11-07T05:33:39Z [load_day 2026-06-26] 2026-06-26 hour 2: 158936 events in 4 files, snapshot 3218905715728727802 (task 4107 ms: download 1168 ms overlapping gunzip 207 ms, parse 772 ms, sort 104 ms, write 1705 ms, index 516 ms: 5 candidates, 82340 repo-hours, 87 releases; waiting 535 ms; commit 941 ms)
2026-11-07T05:33:40Z [load_day 2026-06-26] 2026-06-26 hour 3: 160079 events in 4 files, snapshot 1186052394819131887 (task 3921 ms: download 1316 ms overlapping gunzip 206 ms, parse 803 ms, sort 114 ms, write 1490 ms, index 503 ms: 7 candidates, 76827 repo-hours, 128 releases; waiting 438 ms; commit 855 ms)
2026-11-07T05:33:44Z [load_day 2026-06-26] 2026-06-26 hour 4: 154854 events in 4 files, snapshot 7871372100409290733 (task 4027 ms: download 1523 ms overlapping gunzip 229 ms, parse 828 ms, sort 122 ms, write 1529 ms, index 514 ms: 3 candidates, 76260 repo-hours, 153 releases; waiting 515 ms; commit 1085 ms)
2026-11-07T05:33:45Z [load_day 2026-06-26] 2026-06-26 hour 5: 152542 events in 4 files, snapshot 5390899230591966663 (task 4076 ms: download 1892 ms overlapping gunzip 230 ms, parse 863 ms, sort 114 ms, write 1447 ms, index 550 ms: 8 candidates, 70137 repo-hours, 188 releases; waiting 538 ms; commit 1017 ms)
2026-11-07T05:33:49Z [load_day 2026-06-26] 2026-06-26 hour 6: 159358 events in 4 files, snapshot 5630755421790977871 (task 4269 ms: download 1370 ms overlapping gunzip 210 ms, parse 765 ms, sort 98 ms, write 1734 ms, index 558 ms: 8 candidates, 74356 repo-hours, 74 releases; waiting 523 ms; commit 905 ms)
2026-11-07T05:33:50Z [load_day 2026-06-26] 2026-06-26 hour 7: 161776 events in 4 files, snapshot 4088247925170976268 (task 4045 ms: download 1262 ms overlapping gunzip 204 ms, parse 748 ms, sort 103 ms, write 1650 ms, index 509 ms: 4 candidates, 77141 repo-hours, 42 releases; waiting 516 ms; commit 988 ms)
2026-11-07T05:33:53Z [load_day 2026-06-26] 2026-06-26 hour 8: 156826 events in 4 files, snapshot 2961236295329465412 (task 3890 ms: download 1377 ms overlapping gunzip 197 ms, parse 750 ms, sort 108 ms, write 1394 ms, index 544 ms: 5 candidates, 78433 repo-hours, 19 releases; waiting 520 ms; commit 1034 ms)
2026-11-07T05:33:54Z [load_day 2026-06-26] 2026-06-26 hour 9: 159591 events in 4 files, snapshot 7689138202050124765 (task 3921 ms: download 1289 ms overlapping gunzip 209 ms, parse 784 ms, sort 116 ms, write 1426 ms, index 553 ms: 5 candidates, 75568 repo-hours, 18 releases; waiting 530 ms; commit 861 ms)
2026-11-07T05:33:58Z [load_day 2026-06-26] 2026-06-26 hour 10: 158218 events in 4 files, snapshot 4446943106221202071 (task 3826 ms: download 1332 ms overlapping gunzip 196 ms, parse 741 ms, sort 101 ms, write 1417 ms, index 559 ms: 7 candidates, 80452 repo-hours, 40 releases; waiting 525 ms; commit 943 ms)
2026-11-07T05:33:59Z [load_day 2026-06-26] 2026-06-26 hour 11: 157149 events in 4 files, snapshot 4104422492129322772 (task 3752 ms: download 1106 ms overlapping gunzip 191 ms, parse 751 ms, sort 101 ms, write 1430 ms, index 534 ms: 6 candidates, 76063 repo-hours, 27 releases; waiting 532 ms; commit 838 ms)
2026-11-07T05:34:02Z [load_day 2026-06-26] 2026-06-26 hour 12: 162413 events in 4 files, snapshot 1707655104389002840 (task 3975 ms: download 1504 ms overlapping gunzip 202 ms, parse 755 ms, sort 110 ms, write 1488 ms, index 565 ms: 9 candidates, 79510 repo-hours, 23 releases; waiting 541 ms; commit 1097 ms)
2026-11-07T05:34:04Z [load_day 2026-06-26] 2026-06-26 hour 13: 160643 events in 4 files, snapshot 4328735461598195370 (task 4265 ms: download 1346 ms overlapping gunzip 209 ms, parse 779 ms, sort 106 ms, write 1520 ms, index 604 ms: 7 candidates, 81315 repo-hours, 26 releases; waiting 537 ms; commit 1186 ms)
2026-11-07T05:34:07Z [load_day 2026-06-26] 2026-06-26 hour 14: 161868 events in 4 files, snapshot 4112067499768476821 (task 3933 ms: download 1110 ms overlapping gunzip 199 ms, parse 777 ms, sort 109 ms, write 1527 ms, index 588 ms: 9 candidates, 86242 repo-hours, 32 releases; waiting 515 ms; commit 1056 ms)
2026-11-07T05:34:08Z [load_day 2026-06-26] 2026-06-26 hour 15: 158266 events in 4 files, snapshot 2807256682822496671 (task 3882 ms: download 1385 ms overlapping gunzip 190 ms, parse 715 ms, sort 113 ms, write 1505 ms, index 556 ms: 6 candidates, 76312 repo-hours, 19 releases; waiting 539 ms; commit 923 ms)
2026-11-07T05:34:12Z [load_day 2026-06-26] 2026-06-26 hour 16: 160877 events in 4 files, snapshot 6112552170211843809 (task 4164 ms: download 1215 ms overlapping gunzip 225 ms, parse 824 ms, sort 115 ms, write 1451 ms, index 527 ms: 7 candidates, 77461 repo-hours, 17 releases; waiting 524 ms; commit 919 ms)
2026-11-07T05:34:13Z [load_day 2026-06-26] 2026-06-26 hour 17: 163481 events in 4 files, snapshot 4672437406884386166 (task 4026 ms: download 1403 ms overlapping gunzip 208 ms, parse 795 ms, sort 114 ms, write 1531 ms, index 504 ms: 6 candidates, 76766 repo-hours, 23 releases; waiting 509 ms; commit 989 ms)
2026-11-07T05:34:17Z [load_day 2026-06-26] 2026-06-26 hour 18: 160891 events in 4 files, snapshot 993043855727497168 (task 4398 ms: download 1635 ms overlapping gunzip 212 ms, parse 794 ms, sort 111 ms, write 1646 ms, index 530 ms: 11 candidates, 73795 repo-hours, 28 releases; waiting 519 ms; commit 960 ms)
2026-11-07T05:34:18Z [load_day 2026-06-26] 2026-06-26 hour 19: 158011 events in 4 files, snapshot 4051966003840268017 (task 3921 ms: download 1368 ms overlapping gunzip 198 ms, parse 760 ms, sort 116 ms, write 1601 ms, index 505 ms: 8 candidates, 73416 repo-hours, 47 releases; waiting 524 ms; commit 958 ms)
2026-11-07T05:34:22Z [load_day 2026-06-26] 2026-06-26 hour 20: 161665 events in 4 files, snapshot 3036662427167217781 (task 4234 ms: download 1310 ms overlapping gunzip 213 ms, parse 796 ms, sort 103 ms, write 1817 ms, index 500 ms: 7 candidates, 72955 repo-hours, 60 releases; waiting 520 ms; commit 1058 ms)
2026-11-07T05:34:22Z [load_day 2026-06-26] 2026-06-26 hour 21: 162081 events in 4 files, snapshot 7588447697452214811 (task 4125 ms: download 1274 ms overlapping gunzip 224 ms, parse 829 ms, sort 109 ms, write 1668 ms, index 486 ms: 6 candidates, 69304 repo-hours, 123 releases; waiting 522 ms; commit 833 ms)
2026-11-07T05:34:27Z [load_day 2026-06-26] 2026-06-26 hour 22: 153384 events in 4 files, snapshot 7826198534835579976 (task 4003 ms: download 1219 ms overlapping gunzip 268 ms, parse 864 ms, sort 123 ms, write 1816 ms, index 456 ms: 6 candidates, 66967 repo-hours, 264 releases; waiting 187 ms; commit 1480 ms)
2026-11-07T05:34:28Z [load_day 2026-06-26] 2026-06-26 hour 23: 151163 events in 4 files, snapshot 2884853596559300059 (task 5125 ms: download 1236 ms overlapping gunzip 277 ms, parse 961 ms, sort 108 ms, write 2467 ms, index 791 ms: 4 candidates, 64890 repo-hours, 440 releases; waiting 186 ms; commit 836 ms)
2026-11-07T05:34:35Z [load_day 2026-06-26] 2026-06-26: repo_hour merged from 24 files to 1 (1794330 rows, 7175 ms)
2026-11-07T05:34:37Z [load_day 2026-06-26] 2026-06-26: index committed in 8938 ms (24 + 1 + 24 files)
2026-11-07T05:34:37Z [load_day 2026-06-26] 2026-06-26: 3795000 events in 24 hours
2026-11-07T05:34:37Z [load_day 2026-06-26] attempt 1 succeeded