orcaLog in

Runs · run 131

load_day 2026-10-05, attempt 1 succeeded

Host
4e84322b8c45:22765
Started
2026-11-07T03:41:17Z
Ended
2026-11-07T03:42:10Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/131/load_day/2026-10-05/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:41:17Z [load_day 2026-10-05] attempt 1 started
2026-11-07T03:41:23Z [load_day 2026-10-05] 2026-10-05 hour 0: 68888 events in 2 files, snapshot 1576501040384873223 (task 3060 ms: download 1058 ms overlapping gunzip 148 ms, parse 515 ms, sort 62 ms, write 1195 ms, index 263 ms: 10 candidates, 37985 repo-hours, 173 releases; waiting 526 ms; commit 616 ms)
2026-11-07T03:41:23Z [load_day 2026-10-05] 2026-10-05 hour 1: 75213 events in 2 files, snapshot 7279849987397770481 (task 3231 ms: download 1187 ms overlapping gunzip 151 ms, parse 520 ms, sort 65 ms, write 1275 ms, index 298 ms: 6 candidates, 42394 repo-hours, 190 releases; waiting 612 ms; commit 414 ms)
2026-11-07T03:41:27Z [load_day 2026-10-05] 2026-10-05 hour 2: 80242 events in 2 files, snapshot 1288152955633291772 (task 3227 ms: download 1339 ms overlapping gunzip 195 ms, parse 619 ms, sort 80 ms, write 1208 ms, index 296 ms: 8 candidates, 46374 repo-hours, 254 releases; waiting 523 ms; commit 748 ms)
2026-11-07T03:41:27Z [load_day 2026-10-05] 2026-10-05 hour 3: 85272 events in 2 files, snapshot 1979171227502875024 (task 3277 ms: download 1249 ms overlapping gunzip 225 ms, parse 632 ms, sort 64 ms, write 1172 ms, index 324 ms: 7 candidates, 52932 repo-hours, 284 releases; waiting 535 ms; commit 618 ms)
2026-11-07T03:41:30Z [load_day 2026-10-05] 2026-10-05 hour 4: 84363 events in 2 files, snapshot 1842172314637684244 (task 3135 ms: download 1283 ms overlapping gunzip 181 ms, parse 592 ms, sort 77 ms, write 1119 ms, index 349 ms: 10 candidates, 52389 repo-hours, 299 releases; waiting 552 ms; commit 699 ms)
2026-11-07T03:41:31Z [load_day 2026-10-05] 2026-10-05 hour 5: 88964 events in 2 files, snapshot 6399687441351583868 (task 3234 ms: download 1404 ms overlapping gunzip 181 ms, parse 585 ms, sort 59 ms, write 1173 ms, index 322 ms: 10 candidates, 53577 repo-hours, 369 releases; waiting 553 ms; commit 611 ms)
2026-11-07T03:41:34Z [load_day 2026-10-05] 2026-10-05 hour 6: 84561 events in 2 files, snapshot 6536225771307376546 (task 3043 ms: download 1437 ms overlapping gunzip 180 ms, parse 573 ms, sort 53 ms, write 1072 ms, index 313 ms: 11 candidates, 52107 repo-hours, 304 releases; waiting 528 ms; commit 673 ms)
2026-11-07T03:41:35Z [load_day 2026-10-05] 2026-10-05 hour 7: 84848 events in 2 files, snapshot 4892638496085232060 (task 2916 ms: download 1061 ms overlapping gunzip 154 ms, parse 508 ms, sort 68 ms, write 1001 ms, index 346 ms: 4 candidates, 51819 repo-hours, 258 releases; waiting 553 ms; commit 673 ms)
2026-11-07T03:41:38Z [load_day 2026-10-05] 2026-10-05 hour 8: 89608 events in 2 files, snapshot 3671008019319340560 (task 3075 ms: download 1093 ms overlapping gunzip 154 ms, parse 519 ms, sort 73 ms, write 1137 ms, index 342 ms: 7 candidates, 55373 repo-hours, 152 releases; waiting 531 ms; commit 603 ms)
2026-11-07T03:41:38Z [load_day 2026-10-05] 2026-10-05 hour 9: 89052 events in 2 files, snapshot 4709381713229748607 (task 2825 ms: download 1051 ms overlapping gunzip 146 ms, parse 498 ms, sort 85 ms, write 973 ms, index 344 ms: 9 candidates, 55722 repo-hours, 107 releases; waiting 544 ms; commit 488 ms)
2026-11-07T03:41:41Z [load_day 2026-10-05] 2026-10-05 hour 10: 84213 events in 2 files, snapshot 2289127559424001130 (task 2530 ms: download 741 ms overlapping gunzip 132 ms, parse 434 ms, sort 59 ms, write 1031 ms, index 341 ms: 6 candidates, 51226 repo-hours, 114 releases; waiting 185 ms; commit 635 ms)
2026-11-07T03:41:42Z [load_day 2026-10-05] 2026-10-05 hour 11: 85069 events in 2 files, snapshot 3137967834843201318 (task 2819 ms: download 1137 ms overlapping gunzip 140 ms, parse 472 ms, sort 60 ms, write 921 ms, index 348 ms: 11 candidates, 53013 repo-hours, 116 releases; waiting 539 ms; commit 603 ms)
2026-11-07T03:41:44Z [load_day 2026-10-05] 2026-10-05 hour 12: 88737 events in 2 files, snapshot 3384076722464616292 (task 3036 ms: download 1067 ms overlapping gunzip 157 ms, parse 512 ms, sort 66 ms, write 1059 ms, index 424 ms: 7 candidates, 56410 repo-hours, 138 releases; waiting 521 ms; commit 551 ms)
2026-11-07T03:41:45Z [load_day 2026-10-05] 2026-10-05 hour 13: 88583 events in 2 files, snapshot 531140505410776830 (task 2869 ms: download 1127 ms overlapping gunzip 139 ms, parse 484 ms, sort 58 ms, write 944 ms, index 357 ms: 9 candidates, 57512 repo-hours, 115 releases; waiting 569 ms; commit 604 ms)
2026-11-07T03:41:48Z [load_day 2026-10-05] 2026-10-05 hour 14: 86739 events in 2 files, snapshot 809861971546480240 (task 3008 ms: download 1089 ms overlapping gunzip 149 ms, parse 480 ms, sort 63 ms, write 1091 ms, index 389 ms: 5 candidates, 57239 repo-hours, 165 releases; waiting 548 ms; commit 706 ms)
2026-11-07T03:41:49Z [load_day 2026-10-05] 2026-10-05 hour 15: 85392 events in 2 files, snapshot 4475667811194990010 (task 2993 ms: download 1153 ms overlapping gunzip 149 ms, parse 493 ms, sort 60 ms, write 1085 ms, index 360 ms: 4 candidates, 56138 repo-hours, 113 releases; waiting 542 ms; commit 564 ms)
2026-11-07T03:41:52Z [load_day 2026-10-05] 2026-10-05 hour 16: 88762 events in 2 files, snapshot 1598580185143251840 (task 2972 ms: download 1136 ms overlapping gunzip 157 ms, parse 537 ms, sort 53 ms, write 1062 ms, index 350 ms: 6 candidates, 56432 repo-hours, 122 releases; waiting 540 ms; commit 797 ms)
2026-11-07T03:41:52Z [load_day 2026-10-05] 2026-10-05 hour 17: 88004 events in 2 files, snapshot 963880514495788907 (task 2930 ms: download 1061 ms overlapping gunzip 151 ms, parse 486 ms, sort 54 ms, write 1063 ms, index 354 ms: 3 candidates, 55985 repo-hours, 118 releases; waiting 544 ms; commit 637 ms)
2026-11-07T03:41:55Z [load_day 2026-10-05] 2026-10-05 hour 18: 89685 events in 2 files, snapshot 9031691421843442588 (task 3000 ms: download 1161 ms overlapping gunzip 161 ms, parse 526 ms, sort 66 ms, write 1061 ms, index 343 ms: 4 candidates, 54334 repo-hours, 119 releases; waiting 529 ms; commit 721 ms)
2026-11-07T03:41:56Z [load_day 2026-10-05] 2026-10-05 hour 19: 79844 events in 2 files, snapshot 8310957824665144490 (task 2902 ms: download 1063 ms overlapping gunzip 156 ms, parse 495 ms, sort 105 ms, write 1001 ms, index 321 ms: 10 candidates, 49883 repo-hours, 115 releases; waiting 532 ms; commit 711 ms)
2026-11-07T03:41:59Z [load_day 2026-10-05] 2026-10-05 hour 20: 74781 events in 2 files, snapshot 5570007213679179895 (task 2889 ms: download 987 ms overlapping gunzip 140 ms, parse 443 ms, sort 44 ms, write 1095 ms, index 313 ms: 8 candidates, 48201 repo-hours, 99 releases; waiting 532 ms; commit 737 ms)
2026-11-07T03:41:59Z [load_day 2026-10-05] 2026-10-05 hour 21: 79886 events in 2 files, snapshot 8837290118071022271 (task 2880 ms: download 1178 ms overlapping gunzip 148 ms, parse 480 ms, sort 54 ms, write 1060 ms, index 303 ms: 9 candidates, 48814 repo-hours, 128 releases; waiting 547 ms; commit 458 ms)
2026-11-07T03:42:02Z [load_day 2026-10-05] 2026-10-05 hour 22: 78879 events in 2 files, snapshot 3114222058796758230 (task 3011 ms: download 1024 ms overlapping gunzip 161 ms, parse 513 ms, sort 50 ms, write 1226 ms, index 290 ms: 9 candidates, 46069 repo-hours, 121 releases; waiting 553 ms; commit 633 ms)
2026-11-07T03:42:03Z [load_day 2026-10-05] 2026-10-05 hour 23: 75945 events in 2 files, snapshot 7777217134499896992 (task 3046 ms: download 1192 ms overlapping gunzip 151 ms, parse 480 ms, sort 49 ms, write 1193 ms, index 289 ms: 3 candidates, 45472 repo-hours, 173 releases; waiting 556 ms; commit 655 ms)
2026-11-07T03:42:09Z [load_day 2026-10-05] 2026-10-05: repo_hour merged from 24 files to 1 (1237400 rows, 5487 ms)
2026-11-07T03:42:10Z [load_day 2026-10-05] 2026-10-05: index committed in 7279 ms (24 + 1 + 24 files)
2026-11-07T03:42:10Z [load_day 2026-10-05] 2026-10-05: 2005530 events in 24 hours
2026-11-07T03:42:10Z [load_day 2026-10-05] attempt 1 succeeded