orcaLog in

Runs · run 545

load_day 2026-05-20, attempt 1 succeeded

Host
4e84322b8c45:120781
Started
2026-11-07T06:22:00Z
Ended
2026-11-07T06:23:16Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/545/load_day/2026-05-20/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:22:01Z [load_day 2026-05-20] attempt 1 started
2026-11-07T06:22:09Z [load_day 2026-05-20] 2026-05-20 hour 0: 145623 events in 3 files, snapshot 120513657426239870 (task 5458 ms: download 1785 ms overlapping gunzip 298 ms, parse 1071 ms, sort 145 ms, write 2610 ms, index 482 ms: 7 candidates, 71503 repo-hours, 415 releases; waiting 525 ms; commit 974 ms)
2026-11-07T06:22:11Z [load_day 2026-05-20] 2026-05-20 hour 1: 149280 events in 3 files, snapshot 2605613400394215209 (task 5567 ms: download 1761 ms overlapping gunzip 307 ms, parse 1079 ms, sort 131 ms, write 2773 ms, index 496 ms: 8 candidates, 75581 repo-hours, 450 releases; waiting 508 ms; commit 1222 ms)
2026-11-07T06:22:15Z [load_day 2026-05-20] 2026-05-20 hour 2: 158504 events in 4 files, snapshot 2340353986636563025 (task 4810 ms: download 1379 ms overlapping gunzip 267 ms, parse 986 ms, sort 148 ms, write 2096 ms, index 533 ms: 7 candidates, 85385 repo-hours, 236 releases; waiting 529 ms; commit 1175 ms)
2026-11-07T06:22:16Z [load_day 2026-05-20] 2026-05-20 hour 3: 153516 events in 4 files, snapshot 7892168827303461978 (task 4577 ms: download 1345 ms overlapping gunzip 251 ms, parse 883 ms, sort 105 ms, write 2059 ms, index 522 ms: 8 candidates, 80173 repo-hours, 281 releases; waiting 536 ms; commit 1053 ms)
2026-11-07T06:22:20Z [load_day 2026-05-20] 2026-05-20 hour 4: 153283 events in 4 files, snapshot 6794635774897810021 (task 4638 ms: download 1370 ms overlapping gunzip 254 ms, parse 899 ms, sort 111 ms, write 2044 ms, index 549 ms: 10 candidates, 78129 repo-hours, 295 releases; waiting 542 ms; commit 1090 ms)
2026-11-07T06:22:22Z [load_day 2026-05-20] 2026-05-20 hour 5: 149271 events in 3 files, snapshot 1173095442954874971 (task 4445 ms: download 1544 ms overlapping gunzip 265 ms, parse 892 ms, sort 153 ms, write 1839 ms, index 488 ms: 4 candidates, 72869 repo-hours, 297 releases; waiting 522 ms; commit 1215 ms)
2026-11-07T06:22:26Z [load_day 2026-05-20] 2026-05-20 hour 6: 153326 events in 4 files, snapshot 5931594970090425484 (task 4638 ms: download 1607 ms overlapping gunzip 257 ms, parse 869 ms, sort 111 ms, write 1637 ms, index 590 ms: 7 candidates, 77794 repo-hours, 182 releases; waiting 956 ms; commit 1124 ms)
2026-11-07T06:22:27Z [load_day 2026-05-20] 2026-05-20 hour 7: 152061 events in 4 files, snapshot 6253312000396884109 (task 4163 ms: download 1350 ms overlapping gunzip 220 ms, parse 750 ms, sort 99 ms, write 1668 ms, index 537 ms: 8 candidates, 80890 repo-hours, 74 releases; waiting 554 ms; commit 1197 ms)
2026-11-07T06:22:30Z [load_day 2026-05-20] 2026-05-20 hour 8: 154672 events in 4 files, snapshot 4179521566013275378 (task 3867 ms: download 1226 ms overlapping gunzip 212 ms, parse 768 ms, sort 104 ms, write 1451 ms, index 575 ms: 10 candidates, 83297 repo-hours, 60 releases; waiting 530 ms; commit 1127 ms)
2026-11-07T06:22:32Z [load_day 2026-05-20] 2026-05-20 hour 9: 149423 events in 3 files, snapshot 6111416302764113198 (task 3870 ms: download 1198 ms overlapping gunzip 212 ms, parse 746 ms, sort 97 ms, write 1553 ms, index 523 ms: 8 candidates, 79750 repo-hours, 111 releases; waiting 533 ms; commit 1201 ms)
2026-11-07T06:22:35Z [load_day 2026-05-20] 2026-05-20 hour 10: 152355 events in 4 files, snapshot 8996994995576979445 (task 4029 ms: download 1285 ms overlapping gunzip 208 ms, parse 757 ms, sort 99 ms, write 1572 ms, index 551 ms: 8 candidates, 82962 repo-hours, 88 releases; waiting 534 ms; commit 1164 ms)
2026-11-07T06:22:36Z [load_day 2026-05-20] 2026-05-20 hour 11: 154110 events in 4 files, snapshot 3092620474246028644 (task 4121 ms: download 1327 ms overlapping gunzip 206 ms, parse 753 ms, sort 107 ms, write 1627 ms, index 554 ms: 7 candidates, 83397 repo-hours, 74 releases; waiting 520 ms; commit 1059 ms)
2026-11-07T06:22:40Z [load_day 2026-05-20] 2026-05-20 hour 12: 150763 events in 4 files, snapshot 2365155761138531557 (task 4076 ms: download 1892 ms overlapping gunzip 214 ms, parse 759 ms, sort 95 ms, write 1476 ms, index 560 ms: 4 candidates, 83520 repo-hours, 64 releases; waiting 533 ms; commit 1285 ms)
2026-11-07T06:22:41Z [load_day 2026-05-20] 2026-05-20 hour 13: 148848 events in 3 files, snapshot 1107504304236420796 (task 3789 ms: download 1310 ms overlapping gunzip 216 ms, parse 790 ms, sort 98 ms, write 1356 ms, index 558 ms: 7 candidates, 83320 repo-hours, 104 releases; waiting 536 ms; commit 1166 ms)
2026-11-07T06:22:45Z [load_day 2026-05-20] 2026-05-20 hour 14: 151854 events in 4 files, snapshot 2214602860491787517 (task 4300 ms: download 1460 ms overlapping gunzip 208 ms, parse 767 ms, sort 112 ms, write 1576 ms, index 589 ms: 9 candidates, 90326 repo-hours, 48 releases; waiting 830 ms; commit 1034 ms)
2026-11-07T06:22:46Z [load_day 2026-05-20] 2026-05-20 hour 15: 154673 events in 4 files, snapshot 8176421483966574537 (task 3775 ms: download 963 ms overlapping gunzip 194 ms, parse 722 ms, sort 97 ms, write 1667 ms, index 596 ms: 7 candidates, 89865 repo-hours, 67 releases; waiting 248 ms; commit 939 ms)
2026-11-07T06:22:50Z [load_day 2026-05-20] 2026-05-20 hour 16: 152415 events in 4 files, snapshot 4184808865441210306 (task 4082 ms: download 1168 ms overlapping gunzip 212 ms, parse 778 ms, sort 109 ms, write 1635 ms, index 547 ms: 10 candidates, 80751 repo-hours, 92 releases; waiting 518 ms; commit 1113 ms)
2026-11-07T06:22:51Z [load_day 2026-05-20] 2026-05-20 hour 17: 151684 events in 4 files, snapshot 5842499584690104397 (task 4141 ms: download 1327 ms overlapping gunzip 210 ms, parse 791 ms, sort 132 ms, write 1574 ms, index 594 ms: 11 candidates, 80436 repo-hours, 91 releases; waiting 536 ms; commit 1165 ms)
2026-11-07T06:22:55Z [load_day 2026-05-20] 2026-05-20 hour 18: 157281 events in 4 files, snapshot 987241492213849008 (task 4297 ms: download 1404 ms overlapping gunzip 217 ms, parse 796 ms, sort 108 ms, write 1796 ms, index 562 ms: 10 candidates, 83170 repo-hours, 95 releases; waiting 524 ms; commit 1042 ms)
2026-11-07T06:22:56Z [load_day 2026-05-20] 2026-05-20 hour 19: 156833 events in 4 files, snapshot 6565012060815448965 (task 4215 ms: download 1240 ms overlapping gunzip 224 ms, parse 800 ms, sort 110 ms, write 1830 ms, index 545 ms: 9 candidates, 81504 repo-hours, 142 releases; waiting 405 ms; commit 1376 ms)
2026-11-07T06:22:59Z [load_day 2026-05-20] 2026-05-20 hour 20: 152504 events in 4 files, snapshot 5346708683172893705 (task 3767 ms: download 1223 ms overlapping gunzip 240 ms, parse 835 ms, sort 124 ms, write 1521 ms, index 539 ms: 5 candidates, 77233 repo-hours, 149 releases; waiting 210 ms; commit 1064 ms)
2026-11-07T06:23:01Z [load_day 2026-05-20] 2026-05-20 hour 21: 156842 events in 4 files, snapshot 1513680762930627267 (task 4462 ms: download 1823 ms overlapping gunzip 246 ms, parse 899 ms, sort 111 ms, write 1800 ms, index 542 ms: 7 candidates, 78001 repo-hours, 285 releases; waiting 535 ms; commit 1048 ms)
2026-11-07T06:23:05Z [load_day 2026-05-20] 2026-05-20 hour 22: 154263 events in 4 files, snapshot 2732016988841279015 (task 4952 ms: download 1668 ms overlapping gunzip 286 ms, parse 974 ms, sort 126 ms, write 2205 ms, index 526 ms: 5 candidates, 73989 repo-hours, 352 releases; waiting 539 ms; commit 1332 ms)
2026-11-07T06:23:07Z [load_day 2026-05-20] 2026-05-20 hour 23: 148044 events in 3 files, snapshot 7381970198547315821 (task 5198 ms: download 1736 ms overlapping gunzip 332 ms, parse 1145 ms, sort 124 ms, write 2371 ms, index 462 ms: 5 candidates, 71780 repo-hours, 599 releases; waiting 537 ms; commit 998 ms)
2026-11-07T06:23:14Z [load_day 2026-05-20] 2026-05-20: repo_hour merged from 24 files to 1 (1925625 rows, 7766 ms)
2026-11-07T06:23:16Z [load_day 2026-05-20] 2026-05-20: index committed in 9423 ms (24 + 1 + 24 files)
2026-11-07T06:23:16Z [load_day 2026-05-20] 2026-05-20: 3661428 events in 24 hours
2026-11-07T06:23:16Z [load_day 2026-05-20] attempt 1 succeeded