orcaLog in

Runs · run 476

load_day 2026-06-12, attempt 1 succeeded

Host
4e84322b8c45:101757
Started
2026-11-07T05:51:39Z
Ended
2026-11-07T05:53:49Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/476/load_day/2026-06-12/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:51:39Z [load_day 2026-06-12] attempt 1 started
2026-11-07T05:51:47Z [load_day 2026-06-12] 2026-06-12 hour 0: 155974 events in 4 files, snapshot 5604182442418760117 (task 4803 ms: download 1458 ms overlapping gunzip 261 ms, parse 906 ms, sort 155 ms, write 2218 ms, index 483 ms: 7 candidates, 72090 repo-hours, 294 releases; waiting 513 ms; commit 909 ms)
2026-11-07T05:51:48Z [load_day 2026-06-12] 2026-06-12 hour 1: 156266 events in 4 files, snapshot 7429318588727217250 (task 4907 ms: download 1613 ms overlapping gunzip 263 ms, parse 932 ms, sort 116 ms, write 2289 ms, index 453 ms: 9 candidates, 70115 repo-hours, 328 releases; waiting 509 ms; commit 1016 ms)
2026-11-07T05:51:52Z [load_day 2026-06-12] 2026-06-12 hour 2: 158175 events in 4 files, snapshot 3317114554915139302 (task 4307 ms: download 1272 ms overlapping gunzip 229 ms, parse 815 ms, sort 105 ms, write 1820 ms, index 522 ms: 10 candidates, 84537 repo-hours, 117 releases; waiting 541 ms; commit 954 ms)
2026-11-07T05:51:53Z [load_day 2026-06-12] 2026-06-12 hour 3: 157043 events in 4 files, snapshot 749526295264056654 (task 4330 ms: download 2058 ms overlapping gunzip 236 ms, parse 830 ms, sort 110 ms, write 1790 ms, index 522 ms: 6 candidates, 79935 repo-hours, 196 releases; waiting 548 ms; commit 1018 ms)
2026-11-07T05:51:57Z [load_day 2026-06-12] 2026-06-12 hour 4: 161555 events in 4 files, snapshot 3231641390511595431 (task 4183 ms: download 1267 ms overlapping gunzip 245 ms, parse 833 ms, sort 114 ms, write 1810 ms, index 545 ms: 8 candidates, 82881 repo-hours, 165 releases; waiting 341 ms; commit 1038 ms)
2026-11-07T05:51:58Z [load_day 2026-06-12] 2026-06-12 hour 5: 157568 events in 4 files, snapshot 123365624640524935 (task 4103 ms: download 1695 ms overlapping gunzip 249 ms, parse 862 ms, sort 105 ms, write 1607 ms, index 463 ms: 8 candidates, 71461 repo-hours, 170 releases; waiting 537 ms; commit 1270 ms)
2026-11-07T05:52:02Z [load_day 2026-06-12] 2026-06-12 hour 6: 159374 events in 4 files, snapshot 3617384419827879572 (task 4005 ms: download 1635 ms overlapping gunzip 219 ms, parse 764 ms, sort 102 ms, write 1567 ms, index 536 ms: 11 candidates, 76164 repo-hours, 82 releases; waiting 525 ms; commit 1338 ms)
2026-11-07T05:52:03Z [load_day 2026-06-12] 2026-06-12 hour 7: 157911 events in 4 files, snapshot 6901942495686587343 (task 3503 ms: download 687 ms overlapping gunzip 200 ms, parse 713 ms, sort 101 ms, write 1586 ms, index 519 ms: 8 candidates, 78785 repo-hours, 76 releases; waiting 177 ms; commit 1076 ms)
2026-11-07T05:52:06Z [load_day 2026-06-12] 2026-06-12 hour 8: 161001 events in 4 files, snapshot 6577120274061986991 (task 3878 ms: download 1315 ms overlapping gunzip 214 ms, parse 770 ms, sort 103 ms, write 1577 ms, index 530 ms: 7 candidates, 79209 repo-hours, 62 releases; waiting 372 ms; commit 1143 ms)
2026-11-07T05:52:08Z [load_day 2026-06-12] 2026-06-12 hour 9: 163128 events in 4 files, snapshot 8722199766698693488 (task 4179 ms: download 1368 ms overlapping gunzip 228 ms, parse 790 ms, sort 110 ms, write 1599 ms, index 583 ms: 5 candidates, 81821 repo-hours, 32 releases; waiting 538 ms; commit 1062 ms)
2026-11-07T05:53:10Z [load_day 2026-06-12] 2026-06-12 hour 10: 159977 events in 4 files, snapshot 1045701616872771158 (task 63348 ms: download 60497 ms overlapping gunzip 378 ms, parse 1342 ms, sort 106 ms, write 1487 ms, index 561 ms: 7 candidates, 80358 repo-hours, 49 releases; waiting 57345 ms; commit 1115 ms)
2026-11-07T05:53:11Z [load_day 2026-06-12] 2026-06-12 hour 11: 159961 events in 4 files, snapshot 3835422065999129822 (task 3790 ms: download 1270 ms overlapping gunzip 216 ms, parse 788 ms, sort 101 ms, write 1410 ms, index 512 ms: 5 candidates, 79416 repo-hours, 75 releases; waiting 539 ms; commit 1052 ms)
2026-11-07T05:53:14Z [load_day 2026-06-12] 2026-06-12 hour 12: 157998 events in 4 files, snapshot 6867790885041746405 (task 3972 ms: download 1334 ms overlapping gunzip 200 ms, parse 748 ms, sort 108 ms, write 1550 ms, index 549 ms: 11 candidates, 79351 repo-hours, 41 releases; waiting 524 ms; commit 933 ms)
2026-11-07T05:53:16Z [load_day 2026-06-12] 2026-06-12 hour 13: 154458 events in 4 files, snapshot 6675549302797225708 (task 4003 ms: download 1363 ms overlapping gunzip 191 ms, parse 728 ms, sort 107 ms, write 1548 ms, index 565 ms: 6 candidates, 80269 repo-hours, 29 releases; waiting 516 ms; commit 1000 ms)
2026-11-07T05:53:19Z [load_day 2026-06-12] 2026-06-12 hour 14: 161895 events in 4 files, snapshot 5046742787523563628 (task 4058 ms: download 1149 ms overlapping gunzip 204 ms, parse 769 ms, sort 104 ms, write 1646 ms, index 584 ms: 7 candidates, 90750 repo-hours, 31 releases; waiting 475 ms; commit 1032 ms)
2026-11-07T05:53:20Z [load_day 2026-06-12] 2026-06-12 hour 15: 158259 events in 4 files, snapshot 4799556934525942887 (task 3631 ms: download 965 ms overlapping gunzip 197 ms, parse 719 ms, sort 100 ms, write 1483 ms, index 612 ms: 11 candidates, 89517 repo-hours, 60 releases; waiting 181 ms; commit 973 ms)
2026-11-07T05:53:24Z [load_day 2026-06-12] 2026-06-12 hour 16: 165130 events in 4 files, snapshot 6143746179359093291 (task 4082 ms: download 1510 ms overlapping gunzip 214 ms, parse 794 ms, sort 107 ms, write 1579 ms, index 555 ms: 7 candidates, 85957 repo-hours, 57 releases; waiting 541 ms; commit 1030 ms)
2026-11-07T05:53:25Z [load_day 2026-06-12] 2026-06-12 hour 17: 158849 events in 4 files, snapshot 7167031767268543201 (task 3790 ms: download 1375 ms overlapping gunzip 210 ms, parse 768 ms, sort 102 ms, write 1396 ms, index 527 ms: 8 candidates, 80879 repo-hours, 37 releases; waiting 535 ms; commit 1086 ms)
2026-11-07T05:53:28Z [load_day 2026-06-12] 2026-06-12 hour 18: 161393 events in 4 files, snapshot 803556444706933041 (task 3730 ms: download 1332 ms overlapping gunzip 188 ms, parse 753 ms, sort 101 ms, write 1326 ms, index 509 ms: 6 candidates, 72429 repo-hours, 37 releases; waiting 533 ms; commit 937 ms)
2026-11-07T05:53:29Z [load_day 2026-06-12] 2026-06-12 hour 19: 158737 events in 4 files, snapshot 8476406770560304794 (task 3890 ms: download 1295 ms overlapping gunzip 194 ms, parse 748 ms, sort 95 ms, write 1444 ms, index 522 ms: 10 candidates, 77337 repo-hours, 58 releases; waiting 520 ms; commit 944 ms)
2026-11-07T05:53:33Z [load_day 2026-06-12] 2026-06-12 hour 20: 161285 events in 4 files, snapshot 8571730514115143885 (task 4269 ms: download 1232 ms overlapping gunzip 225 ms, parse 826 ms, sort 101 ms, write 1671 ms, index 535 ms: 12 candidates, 82074 repo-hours, 89 releases; waiting 212 ms; commit 1085 ms)
2026-11-07T05:53:34Z [load_day 2026-06-12] 2026-06-12 hour 21: 156963 events in 4 files, snapshot 7648118285460752830 (task 3991 ms: download 1452 ms overlapping gunzip 224 ms, parse 805 ms, sort 108 ms, write 1547 ms, index 523 ms: 7 candidates, 77957 repo-hours, 149 releases; waiting 523 ms; commit 1000 ms)
2026-11-07T05:53:38Z [load_day 2026-06-12] 2026-06-12 hour 22: 157526 events in 4 files, snapshot 5948555506549810365 (task 4451 ms: download 1400 ms overlapping gunzip 256 ms, parse 899 ms, sort 111 ms, write 1841 ms, index 522 ms: 9 candidates, 75967 repo-hours, 213 releases; waiting 520 ms; commit 995 ms)
2026-11-07T05:53:39Z [load_day 2026-06-12] 2026-06-12 hour 23: 152831 events in 4 files, snapshot 3580445930675753844 (task 4794 ms: download 1928 ms overlapping gunzip 263 ms, parse 931 ms, sort 173 ms, write 1878 ms, index 486 ms: 7 candidates, 73856 repo-hours, 308 releases; waiting 783 ms; commit 987 ms)
2026-11-07T05:53:47Z [load_day 2026-06-12] 2026-06-12: repo_hour merged from 24 files to 1 (1903115 rows, 8042 ms)
2026-11-07T05:53:49Z [load_day 2026-06-12] 2026-06-12: index committed in 9828 ms (24 + 1 + 24 files)
2026-11-07T05:53:49Z [load_day 2026-06-12] 2026-06-12: 3813257 events in 24 hours
2026-11-07T05:53:49Z [load_day 2026-06-12] attempt 1 succeeded