orcaLog in

Runs · run 170

load_day 2026-09-22, attempt 1 succeeded

Host
4e84322b8c45:29223
Started
2026-11-07T03:53:50Z
Ended
2026-11-07T03:54:43Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/170/load_day/2026-09-22/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:53:50Z [load_day 2026-09-22] attempt 1 started
2026-11-07T03:53:55Z [load_day 2026-09-22] 2026-09-22 hour 0: 42210 events in 1 files, snapshot 2504936144118187041 (task 3446 ms: download 1442 ms overlapping gunzip 192 ms, parse 590 ms, sort 66 ms, write 1360 ms, index 186 ms: 2 candidates, 26288 repo-hours, 366 releases; waiting 716 ms; commit 670 ms)
2026-11-07T03:53:56Z [load_day 2026-09-22] 2026-09-22 hour 1: 37899 events in 1 files, snapshot 7168976942125102625 (task 2846 ms: download 1080 ms overlapping gunzip 141 ms, parse 468 ms, sort 48 ms, write 1113 ms, index 175 ms: 4 candidates, 24487 repo-hours, 288 releases; waiting 582 ms; commit 676 ms)
2026-11-07T03:53:59Z [load_day 2026-09-22] 2026-09-22 hour 2: 46824 events in 1 files, snapshot 7988332648781042243 (task 3005 ms: download 1102 ms overlapping gunzip 155 ms, parse 482 ms, sort 65 ms, write 1265 ms, index 231 ms: 3 candidates, 31123 repo-hours, 325 releases; waiting 540 ms; commit 633 ms)
2026-11-07T03:54:00Z [load_day 2026-09-22] 2026-09-22 hour 3: 64864 events in 2 files, snapshot 6908116170092638697 (task 3640 ms: download 1241 ms overlapping gunzip 264 ms, parse 780 ms, sort 71 ms, write 1477 ms, index 298 ms: 3 candidates, 40500 repo-hours, 379 releases; waiting 543 ms; commit 867 ms)
2026-11-07T03:54:03Z [load_day 2026-09-22] 2026-09-22 hour 4: 77756 events in 2 files, snapshot 260894381692049105 (task 3625 ms: download 1385 ms overlapping gunzip 201 ms, parse 617 ms, sort 59 ms, write 1537 ms, index 360 ms: 3 candidates, 43354 repo-hours, 322 releases; waiting 554 ms; commit 652 ms)
2026-11-07T03:54:04Z [load_day 2026-09-22] 2026-09-22 hour 5: 91997 events in 2 files, snapshot 9167218905364884446 (task 3269 ms: download 1171 ms overlapping gunzip 242 ms, parse 677 ms, sort 67 ms, write 1187 ms, index 296 ms: 7 candidates, 47331 repo-hours, 204 releases; waiting 529 ms; commit 616 ms)
2026-11-07T03:54:07Z [load_day 2026-09-22] 2026-09-22 hour 6: 107941 events in 3 files, snapshot 2976221192515343097 (task 3643 ms: download 1472 ms overlapping gunzip 189 ms, parse 606 ms, sort 77 ms, write 1556 ms, index 338 ms: 3 candidates, 50960 repo-hours, 118 releases; waiting 549 ms; commit 703 ms)
2026-11-07T03:54:08Z [load_day 2026-09-22] 2026-09-22 hour 7: 114040 events in 3 files, snapshot 7360076898159823412 (task 3539 ms: download 1320 ms overlapping gunzip 192 ms, parse 615 ms, sort 72 ms, write 1489 ms, index 332 ms: 6 candidates, 54434 repo-hours, 111 releases; waiting 546 ms; commit 838 ms)
2026-11-07T03:54:11Z [load_day 2026-09-22] 2026-09-22 hour 8: 113883 events in 3 files, snapshot 7527364055361060358 (task 3430 ms: download 1210 ms overlapping gunzip 192 ms, parse 635 ms, sort 83 ms, write 1385 ms, index 335 ms: 4 candidates, 54078 repo-hours, 156 releases; waiting 543 ms; commit 635 ms)
2026-11-07T03:54:12Z [load_day 2026-09-22] 2026-09-22 hour 9: 109078 events in 3 files, snapshot 5971329982464257570 (task 3056 ms: download 1023 ms overlapping gunzip 181 ms, parse 608 ms, sort 81 ms, write 1138 ms, index 338 ms: 9 candidates, 54828 repo-hours, 118 releases; waiting 505 ms; commit 623 ms)
2026-11-07T03:54:15Z [load_day 2026-09-22] 2026-09-22 hour 10: 103836 events in 3 files, snapshot 5321935700657838369 (task 3269 ms: download 1426 ms overlapping gunzip 163 ms, parse 550 ms, sort 65 ms, write 1173 ms, index 370 ms: 11 candidates, 55977 repo-hours, 86 releases; waiting 620 ms; commit 675 ms)
2026-11-07T03:54:16Z [load_day 2026-09-22] 2026-09-22 hour 11: 100100 events in 3 files, snapshot 4616551519536138849 (task 3001 ms: download 1050 ms overlapping gunzip 170 ms, parse 585 ms, sort 69 ms, write 1002 ms, index 349 ms: 5 candidates, 54666 repo-hours, 113 releases; waiting 536 ms; commit 846 ms)
2026-11-07T03:54:19Z [load_day 2026-09-22] 2026-09-22 hour 12: 96922 events in 2 files, snapshot 4511753872484951746 (task 3361 ms: download 1392 ms overlapping gunzip 179 ms, parse 591 ms, sort 80 ms, write 1316 ms, index 337 ms: 11 candidates, 54026 repo-hours, 149 releases; waiting 535 ms; commit 740 ms)
2026-11-07T03:54:20Z [load_day 2026-09-22] 2026-09-22 hour 13: 81430 events in 2 files, snapshot 2056099806685458055 (task 2989 ms: download 1039 ms overlapping gunzip 194 ms, parse 586 ms, sort 55 ms, write 1030 ms, index 312 ms: 8 candidates, 49585 repo-hours, 134 releases; waiting 535 ms; commit 677 ms)
2026-11-07T03:54:23Z [load_day 2026-09-22] 2026-09-22 hour 14: 67456 events in 2 files, snapshot 1687871962978337108 (task 3013 ms: download 1012 ms overlapping gunzip 162 ms, parse 504 ms, sort 49 ms, write 1215 ms, index 309 ms: 6 candidates, 42977 repo-hours, 164 releases; waiting 538 ms; commit 757 ms)
2026-11-07T03:54:23Z [load_day 2026-09-22] 2026-09-22 hour 15: 54890 events in 2 files, snapshot 6333976642036306949 (task 3043 ms: download 1015 ms overlapping gunzip 161 ms, parse 474 ms, sort 59 ms, write 1309 ms, index 268 ms: 3 candidates, 36793 repo-hours, 239 releases; waiting 552 ms; commit 613 ms)
2026-11-07T03:54:26Z [load_day 2026-09-22] 2026-09-22 hour 16: 54988 events in 2 files, snapshot 7066139246301668469 (task 3074 ms: download 1006 ms overlapping gunzip 158 ms, parse 507 ms, sort 47 ms, write 1338 ms, index 261 ms: 4 candidates, 36511 repo-hours, 274 releases; waiting 537 ms; commit 708 ms)
2026-11-07T03:54:27Z [load_day 2026-09-22] 2026-09-22 hour 17: 46796 events in 1 files, snapshot 4672433524303514304 (task 2676 ms: download 987 ms overlapping gunzip 139 ms, parse 470 ms, sort 39 ms, write 1035 ms, index 239 ms: 2 candidates, 32285 repo-hours, 277 releases; waiting 548 ms; commit 669 ms)
2026-11-07T03:54:29Z [load_day 2026-09-22] 2026-09-22 hour 18: 46983 events in 1 files, snapshot 7519581462387194472 (task 2504 ms: download 947 ms overlapping gunzip 122 ms, parse 368 ms, sort 34 ms, write 893 ms, index 214 ms: 4 candidates, 31258 repo-hours, 170 releases; waiting 555 ms; commit 684 ms)
2026-11-07T03:54:31Z [load_day 2026-09-22] 2026-09-22 hour 19: 44582 events in 1 files, snapshot 8271435180647258129 (task 2276 ms: download 1014 ms overlapping gunzip 126 ms, parse 389 ms, sort 31 ms, write 721 ms, index 187 ms: 4 candidates, 29391 repo-hours, 149 releases; waiting 550 ms; commit 1360 ms)
2026-11-07T03:54:32Z [load_day 2026-09-22] 2026-09-22 hour 20: 38211 events in 1 files, snapshot 1267719827939269469 (task 2019 ms: download 668 ms overlapping gunzip 106 ms, parse 321 ms, sort 27 ms, write 812 ms, index 212 ms: 6 candidates, 25688 repo-hours, 191 releases; waiting 325 ms; commit 637 ms)
2026-11-07T03:54:33Z [load_day 2026-09-22] 2026-09-22 hour 21: 45970 events in 1 files, snapshot 5826749256895940841 (task 2512 ms: download 970 ms overlapping gunzip 117 ms, parse 370 ms, sort 34 ms, write 866 ms, index 233 ms: 2 candidates, 29129 repo-hours, 161 releases; waiting 570 ms; commit 615 ms)
2026-11-07T03:54:35Z [load_day 2026-09-22] 2026-09-22 hour 22: 58413 events in 2 files, snapshot 2686144119773912182 (task 2663 ms: download 1008 ms overlapping gunzip 153 ms, parse 462 ms, sort 45 ms, write 906 ms, index 237 ms: 3 candidates, 32184 repo-hours, 126 releases; waiting 537 ms; commit 640 ms)
2026-11-07T03:54:36Z [load_day 2026-09-22] 2026-09-22 hour 23: 66558 events in 2 files, snapshot 6871887817935687780 (task 2589 ms: download 1017 ms overlapping gunzip 135 ms, parse 441 ms, sort 53 ms, write 885 ms, index 235 ms: 5 candidates, 32936 repo-hours, 105 releases; waiting 548 ms; commit 782 ms)
2026-11-07T03:54:41Z [load_day 2026-09-22] 2026-09-22: repo_hour merged from 24 files to 1 (970789 rows, 4994 ms)
2026-11-07T03:54:43Z [load_day 2026-09-22] 2026-09-22: index committed in 6484 ms (24 + 1 + 24 files)
2026-11-07T03:54:43Z [load_day 2026-09-22] 2026-09-22: 1713627 events in 24 hours
2026-11-07T03:54:43Z [load_day 2026-09-22] attempt 1 succeeded