orcaLog in

Runs · run 83

load_day 2026-10-21, attempt 1 succeeded

Host
4e84322b8c45:17353
Started
2026-11-07T03:30:24Z
Ended
2026-11-07T03:31:06Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/83/load_day/2026-10-21/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:30:24Z [load_day 2026-10-21] attempt 1 started
2026-11-07T03:30:29Z [load_day 2026-10-21] 2026-10-21 hour 0: 50039 events in 2 files, snapshot 8503516205687248196 (task 1875 ms: download 235 ms overlapping gunzip 98 ms, parse 322 ms, sort 48 ms, write 942 ms, index 236 ms: 8 candidates, 33073 repo-hours, 133 releases; waiting 16 ms; commit 632 ms)
2026-11-07T03:30:29Z [load_day 2026-10-21] 2026-10-21 hour 1: 48357 events in 1 files, snapshot 895732348613309473 (task 1954 ms: download 208 ms overlapping gunzip 107 ms, parse 352 ms, sort 50 ms, write 985 ms, index 240 ms: 3 candidates, 32515 repo-hours, 138 releases; waiting 13 ms; commit 654 ms)
2026-11-07T03:30:31Z [load_day 2026-10-21] 2026-10-21 hour 2: 48053 events in 1 files, snapshot 8419185404006164444 (task 1705 ms: download 216 ms overlapping gunzip 103 ms, parse 318 ms, sort 36 ms, write 771 ms, index 255 ms: 11 candidates, 33714 repo-hours, 157 releases; waiting 19 ms; commit 743 ms)
2026-11-07T03:30:32Z [load_day 2026-10-21] 2026-10-21 hour 3: 49103 events in 1 files, snapshot 8409577261418935057 (task 1748 ms: download 255 ms overlapping gunzip 127 ms, parse 367 ms, sort 46 ms, write 756 ms, index 241 ms: 8 candidates, 34678 repo-hours, 195 releases; waiting 19 ms; commit 561 ms)
2026-11-07T03:30:33Z [load_day 2026-10-21] 2026-10-21 hour 4: 48474 events in 1 files, snapshot 5117979120135624961 (task 1659 ms: download 181 ms overlapping gunzip 92 ms, parse 296 ms, sort 35 ms, write 704 ms, index 331 ms: 3 candidates, 32287 repo-hours, 147 releases; waiting 15 ms; commit 741 ms)
2026-11-07T03:30:34Z [load_day 2026-10-21] 2026-10-21 hour 5: 50119 events in 2 files, snapshot 7270678004607257848 (task 1627 ms: download 178 ms overlapping gunzip 106 ms, parse 322 ms, sort 42 ms, write 715 ms, index 229 ms: 11 candidates, 33522 repo-hours, 154 releases; waiting 19 ms; commit 812 ms)
2026-11-07T03:30:37Z [load_day 2026-10-21] 2026-10-21 hour 6: 50944 events in 2 files, snapshot 1583832882098962741 (task 2731 ms: download 1231 ms overlapping gunzip 110 ms, parse 354 ms, sort 37 ms, write 821 ms, index 293 ms: 4 candidates, 34479 repo-hours, 135 releases; waiting 829 ms; commit 915 ms)
2026-11-07T03:30:38Z [load_day 2026-10-21] 2026-10-21 hour 7: 53423 events in 2 files, snapshot 3873795457438644367 (task 2540 ms: download 1125 ms overlapping gunzip 155 ms, parse 432 ms, sort 35 ms, write 778 ms, index 262 ms: 7 candidates, 36451 repo-hours, 133 releases; waiting 562 ms; commit 742 ms)
2026-11-07T03:30:40Z [load_day 2026-10-21] 2026-10-21 hour 8: 54109 events in 2 files, snapshot 5795794983971884103 (task 2388 ms: download 902 ms overlapping gunzip 102 ms, parse 334 ms, sort 38 ms, write 743 ms, index 283 ms: 7 candidates, 37045 repo-hours, 132 releases; waiting 557 ms; commit 758 ms)
2026-11-07T03:30:41Z [load_day 2026-10-21] 2026-10-21 hour 9: 55301 events in 2 files, snapshot 1213954144557131063 (task 2449 ms: download 953 ms overlapping gunzip 109 ms, parse 347 ms, sort 46 ms, write 791 ms, index 250 ms: 5 candidates, 38056 repo-hours, 106 releases; waiting 602 ms; commit 694 ms)
2026-11-07T03:30:42Z [load_day 2026-10-21] 2026-10-21 hour 10: 56050 events in 2 files, snapshot 4189112002049955735 (task 2235 ms: download 830 ms overlapping gunzip 100 ms, parse 338 ms, sort 35 ms, write 746 ms, index 253 ms: 9 candidates, 38553 repo-hours, 108 releases; waiting 442 ms; commit 490 ms)
2026-11-07T03:30:44Z [load_day 2026-10-21] 2026-10-21 hour 11: 54854 events in 2 files, snapshot 5300585847933068151 (task 2378 ms: download 926 ms overlapping gunzip 96 ms, parse 310 ms, sort 36 ms, write 702 ms, index 264 ms: 10 candidates, 37443 repo-hours, 97 releases; waiting 562 ms; commit 688 ms)
2026-11-07T03:30:46Z [load_day 2026-10-21] 2026-10-21 hour 12: 53567 events in 2 files, snapshot 2200913082915584178 (task 2585 ms: download 1145 ms overlapping gunzip 107 ms, parse 348 ms, sort 37 ms, write 826 ms, index 258 ms: 10 candidates, 37096 repo-hours, 115 releases; waiting 756 ms; commit 549 ms)
2026-11-07T03:30:46Z [load_day 2026-10-21] 2026-10-21 hour 13: 56227 events in 2 files, snapshot 1849069170646497848 (task 2315 ms: download 901 ms overlapping gunzip 99 ms, parse 338 ms, sort 36 ms, write 775 ms, index 282 ms: 3 candidates, 40314 repo-hours, 111 releases; waiting 552 ms; commit 563 ms)
2026-11-07T03:30:49Z [load_day 2026-10-21] 2026-10-21 hour 14: 57748 events in 2 files, snapshot 1060096951308263690 (task 2533 ms: download 921 ms overlapping gunzip 111 ms, parse 348 ms, sort 43 ms, write 981 ms, index 281 ms: 6 candidates, 41508 repo-hours, 133 releases; waiting 530 ms; commit 601 ms)
2026-11-07T03:30:50Z [load_day 2026-10-21] 2026-10-21 hour 15: 61207 events in 2 files, snapshot 2222305620001621435 (task 2293 ms: download 205 ms overlapping gunzip 120 ms, parse 379 ms, sort 44 ms, write 1260 ms, index 283 ms: 10 candidates, 43374 repo-hours, 119 releases; waiting 20 ms; commit 522 ms)
2026-11-07T03:30:52Z [load_day 2026-10-21] 2026-10-21 hour 16: 66513 events in 2 files, snapshot 1408752791408195787 (task 2026 ms: download 229 ms overlapping gunzip 117 ms, parse 409 ms, sort 48 ms, write 889 ms, index 338 ms: 10 candidates, 48219 repo-hours, 99 releases; waiting 20 ms; commit 738 ms)
2026-11-07T03:30:53Z [load_day 2026-10-21] 2026-10-21 hour 17: 59038 events in 2 files, snapshot 8187856845813399848 (task 1872 ms: download 214 ms overlapping gunzip 105 ms, parse 339 ms, sort 37 ms, write 892 ms, index 281 ms: 7 candidates, 41337 repo-hours, 113 releases; waiting 20 ms; commit 677 ms)
2026-11-07T03:30:54Z [load_day 2026-10-21] 2026-10-21 hour 18: 65575 events in 2 files, snapshot 8619514644567053116 (task 1899 ms: download 198 ms overlapping gunzip 110 ms, parse 350 ms, sort 40 ms, write 855 ms, index 336 ms: 12 candidates, 43873 repo-hours, 89 releases; waiting 15 ms; commit 644 ms)
2026-11-07T03:30:55Z [load_day 2026-10-21] 2026-10-21 hour 19: 61049 events in 2 files, snapshot 6933796532654982916 (task 1810 ms: download 215 ms overlapping gunzip 104 ms, parse 320 ms, sort 44 ms, write 860 ms, index 284 ms: 10 candidates, 41493 repo-hours, 98 releases; waiting 20 ms; commit 586 ms)
2026-11-07T03:30:57Z [load_day 2026-10-21] 2026-10-21 hour 20: 55477 events in 2 files, snapshot 5217013202361410460 (task 1767 ms: download 185 ms overlapping gunzip 106 ms, parse 319 ms, sort 35 ms, write 861 ms, index 245 ms: 8 candidates, 37824 repo-hours, 111 releases; waiting 14 ms; commit 576 ms)
2026-11-07T03:30:57Z [load_day 2026-10-21] 2026-10-21 hour 21: 53401 events in 2 files, snapshot 3619805575346408434 (task 1607 ms: download 164 ms overlapping gunzip 94 ms, parse 299 ms, sort 36 ms, write 744 ms, index 233 ms: 10 candidates, 36406 repo-hours, 121 releases; waiting 17 ms; commit 582 ms)
2026-11-07T03:30:59Z [load_day 2026-10-21] 2026-10-21 hour 22: 59887 events in 2 files, snapshot 1995992962657649017 (task 1798 ms: download 219 ms overlapping gunzip 105 ms, parse 327 ms, sort 37 ms, write 859 ms, index 255 ms: 9 candidates, 38548 repo-hours, 113 releases; waiting 18 ms; commit 1287 ms)
2026-11-07T03:31:00Z [load_day 2026-10-21] 2026-10-21 hour 23: 51016 events in 2 files, snapshot 1964175799773624977 (task 2285 ms: download 903 ms overlapping gunzip 102 ms, parse 326 ms, sort 34 ms, write 675 ms, index 265 ms: 8 candidates, 33464 repo-hours, 115 releases; waiting 538 ms; commit 635 ms)
2026-11-07T03:31:05Z [load_day 2026-10-21] 2026-10-21: repo_hour merged from 24 files to 1 (905272 rows, 4312 ms)
2026-11-07T03:31:06Z [load_day 2026-10-21] 2026-10-21: index committed in 5821 ms (24 + 1 + 24 files)
2026-11-07T03:31:06Z [load_day 2026-10-21] 2026-10-21: 1319531 events in 24 hours
2026-11-07T03:31:06Z [load_day 2026-10-21] attempt 1 succeeded