orcaLog in

Runs · run 572

load_day 2026-05-11, attempt 1 succeeded

Host
4e84322b8c45:127721
Started
2026-11-07T06:33:25Z
Ended
2026-11-07T06:34:46Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/572/load_day/2026-05-11/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:33:25Z [load_day 2026-05-11] attempt 1 started
2026-11-07T06:33:35Z [load_day 2026-05-11] 2026-05-11 hour 0: 146278 events in 3 files, snapshot 8307754673396452959 (task 6642 ms: download 2263 ms overlapping gunzip 378 ms, parse 1300 ms, sort 163 ms, write 3202 ms, index 451 ms: 1 candidates, 68247 repo-hours, 682 releases; waiting 663 ms; commit 1069 ms)
2026-11-07T06:33:36Z [load_day 2026-05-11] 2026-05-11 hour 1: 146135 events in 3 files, snapshot 5137228594756866584 (task 6456 ms: download 2268 ms overlapping gunzip 359 ms, parse 1229 ms, sort 135 ms, write 3196 ms, index 459 ms: 3 candidates, 72010 repo-hours, 627 releases; waiting 609 ms; commit 1343 ms)
2026-11-07T06:33:41Z [load_day 2026-05-11] 2026-05-11 hour 2: 148808 events in 3 files, snapshot 2764803106388835067 (task 5325 ms: download 2039 ms overlapping gunzip 332 ms, parse 1152 ms, sort 229 ms, write 2148 ms, index 536 ms: 4 candidates, 81932 repo-hours, 492 releases; waiting 622 ms; commit 1208 ms)
2026-11-07T06:33:42Z [load_day 2026-05-11] 2026-05-11 hour 3: 146708 events in 3 files, snapshot 3496010922432391482 (task 5114 ms: download 1910 ms overlapping gunzip 325 ms, parse 1048 ms, sort 109 ms, write 2242 ms, index 462 ms: 11 candidates, 77384 repo-hours, 531 releases; waiting 601 ms; commit 1100 ms)
2026-11-07T06:33:47Z [load_day 2026-05-11] 2026-05-11 hour 4: 149415 events in 3 files, snapshot 3551055739162436193 (task 5560 ms: download 1901 ms overlapping gunzip 338 ms, parse 1133 ms, sort 111 ms, write 2596 ms, index 485 ms: 9 candidates, 75020 repo-hours, 612 releases; waiting 540 ms; commit 1189 ms)
2026-11-07T06:33:48Z [load_day 2026-05-11] 2026-05-11 hour 5: 149061 events in 3 files, snapshot 2671884255831860712 (task 5427 ms: download 2000 ms overlapping gunzip 333 ms, parse 1083 ms, sort 127 ms, write 2597 ms, index 464 ms: 5 candidates, 71831 repo-hours, 553 releases; waiting 562 ms; commit 1001 ms)
2026-11-07T06:33:53Z [load_day 2026-05-11] 2026-05-11 hour 6: 145327 events in 3 files, snapshot 8550414183000923142 (task 5151 ms: download 1636 ms overlapping gunzip 316 ms, parse 1032 ms, sort 102 ms, write 2340 ms, index 495 ms: 7 candidates, 77104 repo-hours, 503 releases; waiting 545 ms; commit 1261 ms)
2026-11-07T06:33:54Z [load_day 2026-05-11] 2026-05-11 hour 7: 144623 events in 3 files, snapshot 4937360934174376433 (task 5015 ms: download 2095 ms overlapping gunzip 288 ms, parse 903 ms, sort 111 ms, write 2207 ms, index 488 ms: 5 candidates, 76623 repo-hours, 356 releases; waiting 659 ms; commit 1143 ms)
2026-11-07T06:33:58Z [load_day 2026-05-11] 2026-05-11 hour 8: 147546 events in 3 files, snapshot 436456214356287450 (task 4922 ms: download 1676 ms overlapping gunzip 286 ms, parse 968 ms, sort 123 ms, write 2154 ms, index 541 ms: 2 candidates, 79153 repo-hours, 347 releases; waiting 531 ms; commit 1238 ms)
2026-11-07T06:33:59Z [load_day 2026-05-11] 2026-05-11 hour 9: 148342 events in 3 files, snapshot 3077723505810018950 (task 4678 ms: download 1556 ms overlapping gunzip 273 ms, parse 905 ms, sort 113 ms, write 2007 ms, index 556 ms: 5 candidates, 81357 repo-hours, 342 releases; waiting 527 ms; commit 1062 ms)
2026-11-07T06:34:04Z [load_day 2026-05-11] 2026-05-11 hour 10: 147853 events in 3 files, snapshot 3043627285512054157 (task 4582 ms: download 2141 ms overlapping gunzip 267 ms, parse 896 ms, sort 113 ms, write 1984 ms, index 536 ms: 10 candidates, 81901 repo-hours, 317 releases; waiting 528 ms; commit 1216 ms)
2026-11-07T06:34:05Z [load_day 2026-05-11] 2026-05-11 hour 11: 148951 events in 3 files, snapshot 1538104980708536611 (task 4700 ms: download 1426 ms overlapping gunzip 296 ms, parse 1023 ms, sort 122 ms, write 1907 ms, index 541 ms: 8 candidates, 83382 repo-hours, 296 releases; waiting 553 ms; commit 1025 ms)
2026-11-07T06:34:09Z [load_day 2026-05-11] 2026-05-11 hour 12: 150107 events in 4 files, snapshot 8526475592352252253 (task 4496 ms: download 1641 ms overlapping gunzip 274 ms, parse 899 ms, sort 135 ms, write 1843 ms, index 511 ms: 8 candidates, 83169 repo-hours, 212 releases; waiting 539 ms; commit 1220 ms)
2026-11-07T06:34:10Z [load_day 2026-05-11] 2026-05-11 hour 13: 149770 events in 3 files, snapshot 8385646936849121620 (task 4236 ms: download 1395 ms overlapping gunzip 270 ms, parse 878 ms, sort 109 ms, write 1524 ms, index 583 ms: 8 candidates, 84141 repo-hours, 150 releases; waiting 533 ms; commit 1400 ms)
2026-11-07T06:34:14Z [load_day 2026-05-11] 2026-05-11 hour 14: 143898 events in 3 files, snapshot 5531518629947326507 (task 4284 ms: download 1422 ms overlapping gunzip 226 ms, parse 795 ms, sort 102 ms, write 1653 ms, index 578 ms: 12 candidates, 90509 repo-hours, 86 releases; waiting 524 ms; commit 1137 ms)
2026-11-07T06:34:15Z [load_day 2026-05-11] 2026-05-11 hour 15: 148031 events in 3 files, snapshot 3165480766776961575 (task 3959 ms: download 1056 ms overlapping gunzip 263 ms, parse 908 ms, sort 112 ms, write 1611 ms, index 578 ms: 7 candidates, 86793 repo-hours, 137 releases; waiting 189 ms; commit 1091 ms)
2026-11-07T06:34:19Z [load_day 2026-05-11] 2026-05-11 hour 16: 147156 events in 3 files, snapshot 2399231389950224172 (task 4309 ms: download 1507 ms overlapping gunzip 229 ms, parse 790 ms, sort 108 ms, write 1810 ms, index 528 ms: 7 candidates, 83952 repo-hours, 182 releases; waiting 539 ms; commit 1183 ms)
2026-11-07T06:34:20Z [load_day 2026-05-11] 2026-05-11 hour 17: 147790 events in 3 files, snapshot 5257420131339554377 (task 4380 ms: download 1590 ms overlapping gunzip 248 ms, parse 852 ms, sort 107 ms, write 1778 ms, index 532 ms: 5 candidates, 83503 repo-hours, 247 releases; waiting 558 ms; commit 1023 ms)
2026-11-07T06:34:24Z [load_day 2026-05-11] 2026-05-11 hour 18: 152451 events in 4 files, snapshot 5992335809341342330 (task 4469 ms: download 1428 ms overlapping gunzip 253 ms, parse 893 ms, sort 111 ms, write 1748 ms, index 622 ms: 13 candidates, 84920 repo-hours, 190 releases; waiting 525 ms; commit 1077 ms)
2026-11-07T06:34:25Z [load_day 2026-05-11] 2026-05-11 hour 19: 152437 events in 4 files, snapshot 4585737075513736529 (task 4441 ms: download 1375 ms overlapping gunzip 297 ms, parse 970 ms, sort 133 ms, write 1777 ms, index 521 ms: 7 candidates, 84801 repo-hours, 259 releases; waiting 521 ms; commit 1081 ms)
2026-11-07T06:34:29Z [load_day 2026-05-11] 2026-05-11 hour 20: 148455 events in 3 files, snapshot 181972670367123557 (task 4751 ms: download 1327 ms overlapping gunzip 272 ms, parse 888 ms, sort 139 ms, write 2167 ms, index 508 ms: 15 candidates, 78416 repo-hours, 294 releases; waiting 532 ms; commit 954 ms)
2026-11-07T06:34:31Z [load_day 2026-05-11] 2026-05-11 hour 21: 148994 events in 3 files, snapshot 2389143698524106404 (task 4881 ms: download 1320 ms overlapping gunzip 306 ms, parse 1010 ms, sort 111 ms, write 2372 ms, index 466 ms: 10 candidates, 75791 repo-hours, 431 releases; waiting 348 ms; commit 1205 ms)
2026-11-07T06:34:35Z [load_day 2026-05-11] 2026-05-11 hour 22: 143196 events in 3 files, snapshot 7406217430496233995 (task 5278 ms: download 1639 ms overlapping gunzip 318 ms, parse 1066 ms, sort 125 ms, write 2477 ms, index 457 ms: 2 candidates, 72177 repo-hours, 424 releases; waiting 536 ms; commit 1114 ms)
2026-11-07T06:34:37Z [load_day 2026-05-11] 2026-05-11 hour 23: 147673 events in 3 files, snapshot 8284041746511801656 (task 5538 ms: download 1978 ms overlapping gunzip 345 ms, parse 1137 ms, sort 152 ms, write 2633 ms, index 445 ms: 4 candidates, 71542 repo-hours, 601 releases; waiting 546 ms; commit 1071 ms)
2026-11-07T06:34:44Z [load_day 2026-05-11] 2026-05-11: repo_hour merged from 24 files to 1 (1905658 rows, 7543 ms)
2026-11-07T06:34:46Z [load_day 2026-05-11] 2026-05-11: index committed in 9105 ms (24 + 1 + 24 files)
2026-11-07T06:34:46Z [load_day 2026-05-11] 2026-05-11: 3549005 events in 24 hours
2026-11-07T06:34:46Z [load_day 2026-05-11] attempt 1 succeeded