orcaLog in

Runs · run 527

load_day 2026-05-26, attempt 1 succeeded

Host
4e84322b8c45:115834
Started
2026-11-07T06:14:01Z
Ended
2026-11-07T06:15:20Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/527/load_day/2026-05-26/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:14:01Z [load_day 2026-05-26] attempt 1 started
2026-11-07T06:14:10Z [load_day 2026-05-26] 2026-05-26 hour 0: 152619 events in 4 files, snapshot 4916443300338040269 (task 5526 ms: download 1695 ms overlapping gunzip 344 ms, parse 1184 ms, sort 155 ms, write 2567 ms, index 459 ms: 6 candidates, 72841 repo-hours, 594 releases; waiting 512 ms; commit 1035 ms)
2026-11-07T06:14:11Z [load_day 2026-05-26] 2026-05-26 hour 1: 154451 events in 4 files, snapshot 4554222198499957084 (task 5108 ms: download 1734 ms overlapping gunzip 323 ms, parse 1118 ms, sort 136 ms, write 2151 ms, index 503 ms: 5 candidates, 77685 repo-hours, 398 releases; waiting 527 ms; commit 1161 ms)
2026-11-07T06:14:15Z [load_day 2026-05-26] 2026-05-26 hour 2: 158441 events in 4 files, snapshot 1581064138126023460 (task 4129 ms: download 1045 ms overlapping gunzip 228 ms, parse 805 ms, sort 150 ms, write 1877 ms, index 556 ms: 3 candidates, 88766 repo-hours, 151 releases; waiting 231 ms; commit 1226 ms)
2026-11-07T06:14:17Z [load_day 2026-05-26] 2026-05-26 hour 3: 153977 events in 4 files, snapshot 6681176487902837168 (task 4674 ms: download 1773 ms overlapping gunzip 265 ms, parse 895 ms, sort 108 ms, write 1890 ms, index 530 ms: 4 candidates, 80177 repo-hours, 304 releases; waiting 647 ms; commit 1191 ms)
2026-11-07T06:14:20Z [load_day 2026-05-26] 2026-05-26 hour 4: 157187 events in 4 files, snapshot 4229871345232507433 (task 4686 ms: download 1525 ms overlapping gunzip 282 ms, parse 948 ms, sort 120 ms, write 1948 ms, index 563 ms: 6 candidates, 80011 repo-hours, 345 releases; waiting 512 ms; commit 1093 ms)
2026-11-07T06:14:22Z [load_day 2026-05-26] 2026-05-26 hour 5: 152867 events in 4 files, snapshot 5974178611847733112 (task 4696 ms: download 1560 ms overlapping gunzip 306 ms, parse 1059 ms, sort 114 ms, write 1815 ms, index 538 ms: 7 candidates, 74206 repo-hours, 287 releases; waiting 526 ms; commit 1076 ms)
2026-11-07T06:14:25Z [load_day 2026-05-26] 2026-05-26 hour 6: 157773 events in 4 files, snapshot 3728514135472011803 (task 4346 ms: download 1458 ms overlapping gunzip 249 ms, parse 845 ms, sort 111 ms, write 1740 ms, index 582 ms: 5 candidates, 81927 repo-hours, 162 releases; waiting 532 ms; commit 1171 ms)
2026-11-07T06:14:27Z [load_day 2026-05-26] 2026-05-26 hour 7: 155893 events in 4 files, snapshot 6179561727817648257 (task 3956 ms: download 1250 ms overlapping gunzip 238 ms, parse 820 ms, sort 103 ms, write 1556 ms, index 527 ms: 6 candidates, 80062 repo-hours, 144 releases; waiting 406 ms; commit 1051 ms)
2026-11-07T06:14:30Z [load_day 2026-05-26] 2026-05-26 hour 8: 154298 events in 4 files, snapshot 5817744457579346095 (task 3987 ms: download 1291 ms overlapping gunzip 212 ms, parse 755 ms, sort 104 ms, write 1535 ms, index 535 ms: 6 candidates, 81403 repo-hours, 81 releases; waiting 536 ms; commit 1148 ms)
2026-11-07T06:14:32Z [load_day 2026-05-26] 2026-05-26 hour 9: 153331 events in 4 files, snapshot 6680020960641657212 (task 4149 ms: download 1866 ms overlapping gunzip 218 ms, parse 797 ms, sort 99 ms, write 1507 ms, index 607 ms: 3 candidates, 81070 repo-hours, 78 releases; waiting 280 ms; commit 1273 ms)
2026-11-07T06:14:34Z [load_day 2026-05-26] 2026-05-26 hour 10: 152129 events in 4 files, snapshot 1917214726960042386 (task 3946 ms: download 1060 ms overlapping gunzip 242 ms, parse 842 ms, sort 110 ms, write 1669 ms, index 529 ms: 7 candidates, 77938 repo-hours, 120 releases; waiting 346 ms; commit 1015 ms)
2026-11-07T06:14:37Z [load_day 2026-05-26] 2026-05-26 hour 11: 158656 events in 4 files, snapshot 6712559520018991470 (task 4205 ms: download 1575 ms overlapping gunzip 237 ms, parse 809 ms, sort 107 ms, write 1615 ms, index 607 ms: 5 candidates, 77012 repo-hours, 87 releases; waiting 531 ms; commit 1179 ms)
2026-11-07T06:14:39Z [load_day 2026-05-26] 2026-05-26 hour 12: 157225 events in 4 files, snapshot 3469847786908060557 (task 3972 ms: download 1444 ms overlapping gunzip 217 ms, parse 771 ms, sort 107 ms, write 1519 ms, index 560 ms: 7 candidates, 81865 repo-hours, 66 releases; waiting 520 ms; commit 1222 ms)
2026-11-07T06:14:41Z [load_day 2026-05-26] 2026-05-26 hour 13: 148426 events in 3 files, snapshot 3233143479756539144 (task 3747 ms: download 1229 ms overlapping gunzip 199 ms, parse 713 ms, sort 103 ms, write 1385 ms, index 560 ms: 7 candidates, 82457 repo-hours, 70 releases; waiting 544 ms; commit 1142 ms)
2026-11-07T06:14:44Z [load_day 2026-05-26] 2026-05-26 hour 14: 150430 events in 4 files, snapshot 2329872093351024144 (task 3885 ms: download 1410 ms overlapping gunzip 191 ms, parse 707 ms, sort 96 ms, write 1356 ms, index 703 ms: 8 candidates, 87473 repo-hours, 55 releases; waiting 548 ms; commit 1137 ms)
2026-11-07T06:14:46Z [load_day 2026-05-26] 2026-05-26 hour 15: 150183 events in 4 files, snapshot 332081799658612188 (task 3762 ms: download 1216 ms overlapping gunzip 192 ms, parse 715 ms, sort 109 ms, write 1343 ms, index 596 ms: 9 candidates, 87661 repo-hours, 53 releases; waiting 534 ms; commit 1253 ms)
2026-11-07T06:14:48Z [load_day 2026-05-26] 2026-05-26 hour 16: 151307 events in 4 files, snapshot 7921980288096003746 (task 3918 ms: download 1437 ms overlapping gunzip 208 ms, parse 764 ms, sort 108 ms, write 1428 ms, index 541 ms: 9 candidates, 81957 repo-hours, 50 releases; waiting 534 ms; commit 1006 ms)
2026-11-07T06:14:50Z [load_day 2026-05-26] 2026-05-26 hour 17: 152781 events in 4 files, snapshot 2145642702749097329 (task 3905 ms: download 1150 ms overlapping gunzip 208 ms, parse 760 ms, sort 111 ms, write 1448 ms, index 644 ms: 8 candidates, 79644 repo-hours, 165 releases; waiting 517 ms; commit 1021 ms)
2026-11-07T06:14:53Z [load_day 2026-05-26] 2026-05-26 hour 18: 156730 events in 4 files, snapshot 4303548781595876950 (task 4005 ms: download 1495 ms overlapping gunzip 220 ms, parse 784 ms, sort 105 ms, write 1511 ms, index 542 ms: 5 candidates, 78616 repo-hours, 95 releases; waiting 537 ms; commit 1102 ms)
2026-11-07T06:14:56Z [load_day 2026-05-26] 2026-05-26 hour 19: 156474 events in 4 files, snapshot 5275716518579599511 (task 4258 ms: download 1466 ms overlapping gunzip 229 ms, parse 835 ms, sort 117 ms, write 1609 ms, index 632 ms: 10 candidates, 81739 repo-hours, 112 releases; waiting 519 ms; commit 1234 ms)
2026-11-07T06:15:04Z [load_day 2026-05-26] 2026-05-26 hour 20: 154672 events in 4 files, snapshot 2315598694447014163 (task 5154 ms: download 1707 ms overlapping gunzip 226 ms, parse 795 ms, sort 110 ms, write 1507 ms, index 1655 ms: 9 candidates, 80497 repo-hours, 148 releases; waiting 547 ms; commit 6281 ms)
2026-11-07T06:15:05Z [load_day 2026-05-26] 2026-05-26 hour 21: 153819 events in 4 files, snapshot 7791135312474278264 (task 7053 ms: download 1502 ms overlapping gunzip 264 ms, parse 899 ms, sort 127 ms, write 3514 ms, index 1405 ms: 11 candidates, 79488 repo-hours, 268 releases; waiting 538 ms; commit 1014 ms)
2026-11-07T06:15:06Z [load_day 2026-05-26] 2026-05-26 hour 22: 149010 events in 3 files, snapshot 2066536857667598430 (task 4588 ms: download 1440 ms overlapping gunzip 266 ms, parse 935 ms, sort 122 ms, write 1892 ms, index 500 ms: 4 candidates, 72671 repo-hours, 343 releases; waiting 552 ms; commit 1248 ms)
2026-11-07T06:15:10Z [load_day 2026-05-26] 2026-05-26 hour 23: 145437 events in 3 files, snapshot 4250753724309451514 (task 4836 ms: download 1565 ms overlapping gunzip 308 ms, parse 1031 ms, sort 109 ms, write 2074 ms, index 468 ms: 2 candidates, 72247 repo-hours, 698 releases; waiting 474 ms; commit 1199 ms)
2026-11-07T06:15:18Z [load_day 2026-05-26] 2026-05-26: repo_hour merged from 24 files to 1 (1919413 rows, 7696 ms)
2026-11-07T06:15:20Z [load_day 2026-05-26] 2026-05-26: index committed in 9427 ms (24 + 1 + 24 files)
2026-11-07T06:15:20Z [load_day 2026-05-26] 2026-05-26: 3688116 events in 24 hours
2026-11-07T06:15:20Z [load_day 2026-05-26] attempt 1 succeeded