orcaLog in

Runs · run 645

load_day 2026-04-17, attempt 1 succeeded

Host
4e84322b8c45:157501
Started
2026-11-07T12:49:21Z
Ended
2026-11-07T12:50:50Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/645/load_day/2026-04-17/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T12:49:21Z [load_day 2026-04-17] attempt 1 started
2026-11-07T12:49:31Z [load_day 2026-04-17] 2026-04-17 hour 0: 151187 events in 4 files, snapshot 316624377550958345 (task 6781 ms: download 2323 ms overlapping gunzip 408 ms, parse 1416 ms, sort 249 ms, write 3345 ms, index 482 ms: 5 candidates, 70492 repo-hours, 856 releases; waiting 552 ms; commit 1163 ms)
2026-11-07T12:49:32Z [load_day 2026-04-17] 2026-04-17 hour 1: 161037 events in 4 files, snapshot 5326805853013583689 (task 6462 ms: download 2419 ms overlapping gunzip 390 ms, parse 1326 ms, sort 176 ms, write 3008 ms, index 567 ms: 9 candidates, 87851 repo-hours, 578 releases; waiting 671 ms; commit 1049 ms)
2026-11-07T12:49:38Z [load_day 2026-04-17] 2026-04-17 hour 2: 162538 events in 4 files, snapshot 8064574317982714284 (task 5847 ms: download 1827 ms overlapping gunzip 330 ms, parse 1093 ms, sort 131 ms, write 2753 ms, index 606 ms: 14 candidates, 94712 repo-hours, 499 releases; waiting 608 ms; commit 1381 ms)
2026-11-07T12:49:39Z [load_day 2026-04-17] 2026-04-17 hour 3: 153629 events in 4 files, snapshot 3933199766164619802 (task 6185 ms: download 2046 ms overlapping gunzip 374 ms, parse 1235 ms, sort 167 ms, write 3015 ms, index 523 ms: 5 candidates, 79957 repo-hours, 671 releases; waiting 548 ms; commit 1250 ms)
2026-11-07T12:49:45Z [load_day 2026-04-17] 2026-04-17 hour 4: 148745 events in 3 files, snapshot 9221380037743457566 (task 6362 ms: download 2079 ms overlapping gunzip 388 ms, parse 1263 ms, sort 137 ms, write 3250 ms, index 517 ms: 6 candidates, 72963 repo-hours, 835 releases; waiting 495 ms; commit 1165 ms)
2026-11-07T12:49:46Z [load_day 2026-04-17] 2026-04-17 hour 5: 153698 events in 4 files, snapshot 7581158809996802271 (task 6328 ms: download 2092 ms overlapping gunzip 366 ms, parse 1166 ms, sort 160 ms, write 3160 ms, index 546 ms: 8 candidates, 77932 repo-hours, 680 releases; waiting 592 ms; commit 1252 ms)
2026-11-07T12:49:52Z [load_day 2026-04-17] 2026-04-17 hour 6: 156541 events in 4 files, snapshot 6587781285206089898 (task 6197 ms: download 2113 ms overlapping gunzip 387 ms, parse 1173 ms, sort 166 ms, write 2875 ms, index 543 ms: 6 candidates, 80782 repo-hours, 494 releases; waiting 749 ms; commit 1282 ms)
2026-11-07T12:49:53Z [load_day 2026-04-17] 2026-04-17 hour 7: 157283 events in 4 files, snapshot 4060691368851323910 (task 5161 ms: download 1711 ms overlapping gunzip 310 ms, parse 985 ms, sort 121 ms, write 2357 ms, index 580 ms: 8 candidates, 85188 repo-hours, 372 releases; waiting 531 ms; commit 1098 ms)
2026-11-07T12:49:57Z [load_day 2026-04-17] 2026-04-17 hour 8: 154263 events in 4 files, snapshot 1646266397617498083 (task 5148 ms: download 1756 ms overlapping gunzip 280 ms, parse 917 ms, sort 131 ms, write 2251 ms, index 575 ms: 8 candidates, 84346 repo-hours, 326 releases; waiting 643 ms; commit 1188 ms)
2026-11-07T12:49:59Z [load_day 2026-04-17] 2026-04-17 hour 9: 147376 events in 3 files, snapshot 669563481575078399 (task 4732 ms: download 2188 ms overlapping gunzip 287 ms, parse 950 ms, sort 132 ms, write 1791 ms, index 578 ms: 9 candidates, 82422 repo-hours, 319 releases; waiting 771 ms; commit 1194 ms)
2026-11-07T12:50:03Z [load_day 2026-04-17] 2026-04-17 hour 10: 144891 events in 3 files, snapshot 3579449706485983998 (task 4460 ms: download 1477 ms overlapping gunzip 241 ms, parse 849 ms, sort 119 ms, write 1723 ms, index 647 ms: 8 candidates, 81309 repo-hours, 228 releases; waiting 543 ms; commit 1428 ms)
2026-11-07T12:50:04Z [load_day 2026-04-17] 2026-04-17 hour 11: 143111 events in 3 files, snapshot 4733198600432449481 (task 4986 ms: download 1736 ms overlapping gunzip 276 ms, parse 962 ms, sort 127 ms, write 2136 ms, index 636 ms: 5 candidates, 80730 repo-hours, 383 releases; waiting 512 ms; commit 1207 ms)
2026-11-07T12:50:07Z [load_day 2026-04-17] 2026-04-17 hour 12: 143135 events in 3 files, snapshot 7679360539052980344 (task 4107 ms: download 849 ms overlapping gunzip 245 ms, parse 810 ms, sort 132 ms, write 1772 ms, index 580 ms: 5 candidates, 81938 repo-hours, 232 releases; waiting 217 ms; commit 1251 ms)
2026-11-07T12:50:10Z [load_day 2026-04-17] 2026-04-17 hour 13: 154427 events in 4 files, snapshot 6731975488000660897 (task 4568 ms: download 1340 ms overlapping gunzip 239 ms, parse 888 ms, sort 154 ms, write 1688 ms, index 732 ms: 11 candidates, 95023 repo-hours, 93 releases; waiting 530 ms; commit 1403 ms)
2026-11-07T12:50:13Z [load_day 2026-04-17] 2026-04-17 hour 14: 156846 events in 4 files, snapshot 1282414889288898173 (task 4665 ms: download 1528 ms overlapping gunzip 226 ms, parse 805 ms, sort 127 ms, write 1826 ms, index 622 ms: 8 candidates, 88824 repo-hours, 96 releases; waiting 553 ms; commit 1324 ms)
2026-11-07T12:50:15Z [load_day 2026-04-17] 2026-04-17 hour 15: 153888 events in 4 files, snapshot 82109890120454087 (task 4514 ms: download 1211 ms overlapping gunzip 242 ms, parse 845 ms, sort 114 ms, write 2128 ms, index 639 ms: 11 candidates, 87432 repo-hours, 262 releases; waiting 246 ms; commit 1378 ms)
2026-11-07T12:50:18Z [load_day 2026-04-17] 2026-04-17 hour 16: 154287 events in 4 files, snapshot 7814672119795961711 (task 4688 ms: download 1344 ms overlapping gunzip 254 ms, parse 882 ms, sort 134 ms, write 2020 ms, index 657 ms: 12 candidates, 86099 repo-hours, 212 releases; waiting 386 ms; commit 1158 ms)
2026-11-07T12:50:20Z [load_day 2026-04-17] 2026-04-17 hour 17: 153324 events in 4 files, snapshot 2464943790453489012 (task 4752 ms: download 1561 ms overlapping gunzip 262 ms, parse 901 ms, sort 135 ms, write 1975 ms, index 583 ms: 8 candidates, 83410 repo-hours, 265 releases; waiting 544 ms; commit 1118 ms)
2026-11-07T12:50:24Z [load_day 2026-04-17] 2026-04-17 hour 18: 154423 events in 4 files, snapshot 6320615995908178546 (task 5144 ms: download 2083 ms overlapping gunzip 282 ms, parse 968 ms, sort 122 ms, write 2140 ms, index 644 ms: 15 candidates, 83304 repo-hours, 265 releases; waiting 742 ms; commit 1226 ms)
2026-11-07T12:50:27Z [load_day 2026-04-17] 2026-04-17 hour 19: 151374 events in 4 files, snapshot 4496374695827499174 (task 5324 ms: download 2616 ms overlapping gunzip 346 ms, parse 1085 ms, sort 144 ms, write 2595 ms, index 567 ms: 4 candidates, 81623 repo-hours, 381 releases; waiting 354 ms; commit 1315 ms)
2026-11-07T12:50:33Z [load_day 2026-04-17] 2026-04-17 hour 20: 153786 events in 4 files, snapshot 397389753790645692 (task 7847 ms: download 2479 ms overlapping gunzip 498 ms, parse 1288 ms, sort 183 ms, write 4238 ms, index 565 ms: 5 candidates, 78731 repo-hours, 443 releases; waiting 727 ms; commit 1081 ms)
2026-11-07T12:50:34Z [load_day 2026-04-17] 2026-04-17 hour 21: 147832 events in 3 files, snapshot 2317357209328623498 (task 5751 ms: download 2131 ms overlapping gunzip 370 ms, parse 1173 ms, sort 200 ms, write 2453 ms, index 589 ms: 10 candidates, 74774 repo-hours, 551 releases; waiting 598 ms; commit 1252 ms)
2026-11-07T12:50:38Z [load_day 2026-04-17] 2026-04-17 hour 22: 151184 events in 4 files, snapshot 4146560279410158257 (task 4962 ms: download 670 ms overlapping gunzip 384 ms, parse 1236 ms, sort 137 ms, write 2464 ms, index 519 ms: 8 candidates, 73993 repo-hours, 691 releases; waiting 16 ms; commit 1358 ms)
2026-11-07T12:50:40Z [load_day 2026-04-17] 2026-04-17 hour 23: 141792 events in 3 files, snapshot 2793514020797424354 (task 5817 ms: download 1803 ms overlapping gunzip 408 ms, parse 1423 ms, sort 143 ms, write 2587 ms, index 398 ms: 3 candidates, 64525 repo-hours, 901 releases; waiting 518 ms; commit 1127 ms)
2026-11-07T12:50:48Z [load_day 2026-04-17] 2026-04-17: repo_hour merged from 24 files to 1 (1958360 rows, 8143 ms)
2026-11-07T12:50:50Z [load_day 2026-04-17] 2026-04-17: index committed in 10217 ms (24 + 1 + 24 files)
2026-11-07T12:50:50Z [load_day 2026-04-17] 2026-04-17: 3650597 events in 24 hours
2026-11-07T12:50:50Z [load_day 2026-04-17] attempt 1 succeeded