orcaLog in

Runs · run 714

load_day 2026-03-25, attempt 1 succeeded

Host
4e84322b8c45:177207
Started
2026-11-07T13:27:46Z
Ended
2026-11-07T13:29:21Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/714/load_day/2026-03-25/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T13:27:46Z [load_day 2026-03-25] attempt 1 started
2026-11-07T13:27:57Z [load_day 2026-03-25] 2026-03-25 hour 0: 154561 events in 4 files, snapshot 1196127799435114377 (task 7342 ms: download 2571 ms overlapping gunzip 503 ms, parse 1606 ms, sort 233 ms, write 3387 ms, index 525 ms: 7 candidates, 75705 repo-hours, 874 releases; waiting 770 ms; commit 1206 ms)
2026-11-07T13:27:58Z [load_day 2026-03-25] 2026-03-25 hour 1: 165186 events in 4 files, snapshot 6514367306818130325 (task 6200 ms: download 1818 ms overlapping gunzip 414 ms, parse 1362 ms, sort 237 ms, write 2675 ms, index 662 ms: 4 candidates, 96903 repo-hours, 423 releases; waiting 533 ms; commit 1448 ms)
2026-11-07T13:28:03Z [load_day 2026-03-25] 2026-03-25 hour 2: 166656 events in 4 files, snapshot 5982728712779325581 (task 5443 ms: download 1586 ms overlapping gunzip 408 ms, parse 1283 ms, sort 193 ms, write 2341 ms, index 723 ms: 2 candidates, 93370 repo-hours, 469 releases; waiting 226 ms; commit 1358 ms)
2026-11-07T13:28:05Z [load_day 2026-03-25] 2026-03-25 hour 3: 155468 events in 4 files, snapshot 5406696921469982063 (task 6527 ms: download 2509 ms overlapping gunzip 480 ms, parse 1623 ms, sort 174 ms, write 2674 ms, index 530 ms: 11 candidates, 73464 repo-hours, 676 releases; waiting 595 ms; commit 1389 ms)
2026-11-07T13:28:11Z [load_day 2026-03-25] 2026-03-25 hour 4: 163265 events in 4 files, snapshot 7593259758940581891 (task 7059 ms: download 2284 ms overlapping gunzip 515 ms, parse 1577 ms, sort 206 ms, write 3004 ms, index 530 ms: 6 candidates, 78677 repo-hours, 700 releases; waiting 625 ms; commit 1182 ms)
2026-11-07T13:28:13Z [load_day 2026-03-25] 2026-03-25 hour 5: 163178 events in 4 files, snapshot 6101426663018331543 (task 6426 ms: download 2529 ms overlapping gunzip 504 ms, parse 1633 ms, sort 170 ms, write 2664 ms, index 564 ms: 5 candidates, 80688 repo-hours, 635 releases; waiting 570 ms; commit 1265 ms)
2026-11-07T13:28:18Z [load_day 2026-03-25] 2026-03-25 hour 6: 161132 events in 4 files, snapshot 7109283043239561813 (task 6490 ms: download 2726 ms overlapping gunzip 464 ms, parse 1529 ms, sort 166 ms, write 2433 ms, index 628 ms: 10 candidates, 84741 repo-hours, 506 releases; waiting 943 ms; commit 1274 ms)
2026-11-07T13:28:19Z [load_day 2026-03-25] 2026-03-25 hour 7: 157572 events in 4 files, snapshot 2875651338843324541 (task 5547 ms: download 2013 ms overlapping gunzip 369 ms, parse 1109 ms, sort 158 ms, write 2409 ms, index 558 ms: 8 candidates, 84372 repo-hours, 430 releases; waiting 630 ms; commit 1101 ms)
2026-11-07T13:28:25Z [load_day 2026-03-25] 2026-03-25 hour 8: 158373 events in 4 files, snapshot 7807742144515353845 (task 5602 ms: download 2073 ms overlapping gunzip 349 ms, parse 1138 ms, sort 148 ms, write 2453 ms, index 604 ms: 13 candidates, 86111 repo-hours, 332 releases; waiting 639 ms; commit 2077 ms)
2026-11-07T13:28:26Z [load_day 2026-03-25] 2026-03-25 hour 9: 156337 events in 4 files, snapshot 1220111959912912401 (task 5341 ms: download 1877 ms overlapping gunzip 295 ms, parse 979 ms, sort 186 ms, write 2268 ms, index 598 ms: 10 candidates, 88014 repo-hours, 273 releases; waiting 557 ms; commit 1150 ms)
2026-11-07T13:28:31Z [load_day 2026-03-25] 2026-03-25 hour 10: 161944 events in 4 files, snapshot 4121665616020875452 (task 5579 ms: download 1956 ms overlapping gunzip 303 ms, parse 979 ms, sort 145 ms, write 2472 ms, index 606 ms: 5 candidates, 90885 repo-hours, 208 releases; waiting 733 ms; commit 1142 ms)
2026-11-07T13:28:33Z [load_day 2026-03-25] 2026-03-25 hour 11: 161561 events in 4 files, snapshot 5989209159374287693 (task 5536 ms: download 1502 ms overlapping gunzip 327 ms, parse 1053 ms, sort 132 ms, write 2690 ms, index 702 ms: 11 candidates, 89755 repo-hours, 194 releases; waiting 338 ms; commit 1319 ms)
2026-11-07T13:28:37Z [load_day 2026-03-25] 2026-03-25 hour 12: 162966 events in 4 files, snapshot 1613525698787957577 (task 4752 ms: download 1608 ms overlapping gunzip 262 ms, parse 878 ms, sort 131 ms, write 1927 ms, index 695 ms: 3 candidates, 97101 repo-hours, 133 releases; waiting 545 ms; commit 1300 ms)
2026-11-07T13:28:39Z [load_day 2026-03-25] 2026-03-25 hour 13: 163304 events in 4 files, snapshot 2088157076686782247 (task 4978 ms: download 1875 ms overlapping gunzip 324 ms, parse 1024 ms, sort 138 ms, write 1952 ms, index 748 ms: 8 candidates, 97824 repo-hours, 87 releases; waiting 542 ms; commit 1375 ms)
2026-11-07T13:28:42Z [load_day 2026-03-25] 2026-03-25 hour 14: 154793 events in 4 files, snapshot 5013397012200327984 (task 4639 ms: download 1321 ms overlapping gunzip 255 ms, parse 864 ms, sort 156 ms, write 2071 ms, index 653 ms: 5 candidates, 91594 repo-hours, 143 releases; waiting 266 ms; commit 1222 ms)
2026-11-07T13:28:44Z [load_day 2026-03-25] 2026-03-25 hour 15: 156910 events in 4 files, snapshot 7722936366422013262 (task 4829 ms: download 1627 ms overlapping gunzip 285 ms, parse 950 ms, sort 129 ms, write 2087 ms, index 635 ms: 11 candidates, 90036 repo-hours, 160 releases; waiting 442 ms; commit 1493 ms)
2026-11-07T13:28:48Z [load_day 2026-03-25] 2026-03-25 hour 16: 163421 events in 4 files, snapshot 1813098154533004896 (task 5276 ms: download 1689 ms overlapping gunzip 290 ms, parse 954 ms, sort 149 ms, write 2218 ms, index 733 ms: 6 candidates, 92897 repo-hours, 117 releases; waiting 618 ms; commit 1182 ms)
2026-11-07T13:28:50Z [load_day 2026-03-25] 2026-03-25 hour 17: 162552 events in 4 files, snapshot 5533961339231712087 (task 4855 ms: download 1656 ms overlapping gunzip 269 ms, parse 898 ms, sort 138 ms, write 2107 ms, index 634 ms: 8 candidates, 92278 repo-hours, 109 releases; waiting 573 ms; commit 1181 ms)
2026-11-07T13:28:54Z [load_day 2026-03-25] 2026-03-25 hour 18: 163934 events in 4 files, snapshot 6422319373753326162 (task 5065 ms: download 1868 ms overlapping gunzip 282 ms, parse 967 ms, sort 153 ms, write 2096 ms, index 683 ms: 17 candidates, 93335 repo-hours, 131 releases; waiting 541 ms; commit 1251 ms)
2026-11-07T13:28:56Z [load_day 2026-03-25] 2026-03-25 hour 19: 159781 events in 4 files, snapshot 1559229375064200422 (task 5443 ms: download 1830 ms overlapping gunzip 316 ms, parse 1009 ms, sort 134 ms, write 2346 ms, index 654 ms: 9 candidates, 83813 repo-hours, 254 releases; waiting 674 ms; commit 1410 ms)
2026-11-07T13:29:00Z [load_day 2026-03-25] 2026-03-25 hour 20: 160893 events in 4 files, snapshot 8698080468592536983 (task 5813 ms: download 1949 ms overlapping gunzip 350 ms, parse 1188 ms, sort 178 ms, write 2569 ms, index 633 ms: 9 candidates, 87129 repo-hours, 209 releases; waiting 563 ms; commit 1352 ms)
2026-11-07T13:29:03Z [load_day 2026-03-25] 2026-03-25 hour 21: 162900 events in 4 files, snapshot 26142148941346141 (task 5778 ms: download 1977 ms overlapping gunzip 354 ms, parse 1136 ms, sort 140 ms, write 2673 ms, index 586 ms: 3 candidates, 84627 repo-hours, 278 releases; waiting 590 ms; commit 1407 ms)
2026-11-07T13:29:07Z [load_day 2026-03-25] 2026-03-25 hour 22: 159633 events in 4 files, snapshot 2110065029244884029 (task 6033 ms: download 2042 ms overlapping gunzip 398 ms, parse 1261 ms, sort 172 ms, write 2678 ms, index 547 ms: 8 candidates, 82342 repo-hours, 397 releases; waiting 745 ms; commit 1364 ms)
2026-11-07T13:29:10Z [load_day 2026-03-25] 2026-03-25 hour 23: 157818 events in 4 files, snapshot 2510703105119023942 (task 6542 ms: download 2527 ms overlapping gunzip 410 ms, parse 1347 ms, sort 221 ms, write 2532 ms, index 574 ms: 8 candidates, 80570 repo-hours, 561 releases; waiting 928 ms; commit 1294 ms)
2026-11-07T13:29:19Z [load_day 2026-03-25] 2026-03-25: repo_hour merged from 24 files to 1 (2096231 rows, 8872 ms)
2026-11-07T13:29:21Z [load_day 2026-03-25] 2026-03-25: index committed in 10945 ms (24 + 1 + 24 files)
2026-11-07T13:29:21Z [load_day 2026-03-25] 2026-03-25: 3854138 events in 24 hours
2026-11-07T13:29:21Z [load_day 2026-03-25] attempt 1 succeeded