orcaLog in

Runs · run 200

load_day 2026-09-12, attempt 1 succeeded

Host
4e84322b8c45:34649
Started
2026-11-07T04:05:11Z
Ended
2026-11-07T04:06:46Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/200/load_day/2026-09-12/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:05:11Z [load_day 2026-09-12] attempt 1 started
2026-11-07T04:05:22Z [load_day 2026-09-12] 2026-09-12 hour 0: 69325 events in 2 files, snapshot 2762243290992407540 (task 8137 ms: download 2265 ms overlapping gunzip 602 ms, parse 1925 ms, sort 192 ms, write 4352 ms, index 214 ms: 5 candidates, 33285 repo-hours, 1776 releases; waiting 506 ms; commit 705 ms)
2026-11-07T04:05:22Z [load_day 2026-09-12] 2026-09-12 hour 1: 66105 events in 2 files, snapshot 6058770713189900690 (task 7658 ms: download 2578 ms overlapping gunzip 502 ms, parse 1520 ms, sort 155 ms, write 4244 ms, index 284 ms: 4 candidates, 32384 repo-hours, 1521 releases; waiting 593 ms; commit 710 ms)
2026-11-07T04:05:29Z [load_day 2026-09-12] 2026-09-12 hour 2: 64003 events in 2 files, snapshot 450719355126152485 (task 7216 ms: download 2525 ms overlapping gunzip 475 ms, parse 1367 ms, sort 207 ms, write 3672 ms, index 338 ms: 5 candidates, 32007 repo-hours, 1346 releases; waiting 837 ms; commit 726 ms)
2026-11-07T04:05:30Z [load_day 2026-09-12] 2026-09-12 hour 3: 70870 events in 2 files, snapshot 7436847562226092156 (task 7063 ms: download 2466 ms overlapping gunzip 481 ms, parse 1413 ms, sort 242 ms, write 3676 ms, index 224 ms: 5 candidates, 33822 repo-hours, 1695 releases; waiting 697 ms; commit 610 ms)
2026-11-07T04:05:38Z [load_day 2026-09-12] 2026-09-12 hour 4: 73094 events in 2 files, snapshot 4649816425303240471 (task 8226 ms: download 2779 ms overlapping gunzip 547 ms, parse 1645 ms, sort 192 ms, write 4354 ms, index 215 ms: 4 candidates, 34598 repo-hours, 1783 releases; waiting 983 ms; commit 667 ms)
2026-11-07T04:05:39Z [load_day 2026-09-12] 2026-09-12 hour 5: 71920 events in 2 files, snapshot 8173092640695690876 (task 7757 ms: download 2662 ms overlapping gunzip 520 ms, parse 1547 ms, sort 156 ms, write 4319 ms, index 226 ms: 3 candidates, 35555 repo-hours, 1771 releases; waiting 630 ms; commit 670 ms)
2026-11-07T04:05:46Z [load_day 2026-09-12] 2026-09-12 hour 6: 68683 events in 2 files, snapshot 3334795235773326406 (task 7628 ms: download 2611 ms overlapping gunzip 516 ms, parse 1523 ms, sort 159 ms, write 4085 ms, index 266 ms: 5 candidates, 35577 repo-hours, 1831 releases; waiting 737 ms; commit 699 ms)
2026-11-07T04:05:47Z [load_day 2026-09-12] 2026-09-12 hour 7: 66380 events in 2 files, snapshot 2491258178910095615 (task 7249 ms: download 2325 ms overlapping gunzip 583 ms, parse 1739 ms, sort 315 ms, write 3582 ms, index 234 ms: 3 candidates, 35171 repo-hours, 1828 releases; waiting 342 ms; commit 748 ms)
2026-11-07T04:05:55Z [load_day 2026-09-12] 2026-09-12 hour 8: 67088 events in 2 files, snapshot 789178960892645328 (task 7940 ms: download 2732 ms overlapping gunzip 545 ms, parse 1586 ms, sort 228 ms, write 4185 ms, index 280 ms: 4 candidates, 35240 repo-hours, 1922 releases; waiting 776 ms; commit 834 ms)
2026-11-07T04:05:56Z [load_day 2026-09-12] 2026-09-12 hour 9: 70208 events in 2 files, snapshot 2259464506393821517 (task 7784 ms: download 2511 ms overlapping gunzip 541 ms, parse 1700 ms, sort 169 ms, write 3911 ms, index 451 ms: 7 candidates, 35640 repo-hours, 1921 releases; waiting 698 ms; commit 781 ms)
2026-11-07T04:06:03Z [load_day 2026-09-12] 2026-09-12 hour 10: 75267 events in 2 files, snapshot 1578348260400104739 (task 7228 ms: download 2953 ms overlapping gunzip 465 ms, parse 1355 ms, sort 143 ms, write 3597 ms, index 317 ms: 3 candidates, 38672 repo-hours, 1721 releases; waiting 1060 ms; commit 851 ms)
2026-11-07T04:06:03Z [load_day 2026-09-12] 2026-09-12 hour 11: 72056 events in 2 files, snapshot 3781879123647167041 (task 6728 ms: download 2000 ms overlapping gunzip 544 ms, parse 1592 ms, sort 141 ms, write 3253 ms, index 255 ms: 3 candidates, 38426 repo-hours, 1444 releases; waiting 623 ms; commit 828 ms)
2026-11-07T04:06:10Z [load_day 2026-09-12] 2026-09-12 hour 12: 70338 events in 2 files, snapshot 2507807317864821349 (task 5968 ms: download 2174 ms overlapping gunzip 408 ms, parse 1176 ms, sort 140 ms, write 3023 ms, index 266 ms: 5 candidates, 39258 repo-hours, 1230 releases; waiting 655 ms; commit 1144 ms)
2026-11-07T04:06:10Z [load_day 2026-09-12] 2026-09-12 hour 13: 71918 events in 2 files, snapshot 3117382768494201421 (task 5823 ms: download 2417 ms overlapping gunzip 439 ms, parse 1348 ms, sort 119 ms, write 2542 ms, index 267 ms: 4 candidates, 41185 repo-hours, 1155 releases; waiting 758 ms; commit 681 ms)
2026-11-07T04:06:15Z [load_day 2026-09-12] 2026-09-12 hour 14: 76601 events in 2 files, snapshot 4867066604323568797 (task 4801 ms: download 1479 ms overlapping gunzip 308 ms, parse 883 ms, sort 75 ms, write 2418 ms, index 268 ms: 7 candidates, 44306 repo-hours, 897 releases; waiting 546 ms; commit 841 ms)
2026-11-07T04:06:16Z [load_day 2026-09-12] 2026-09-12 hour 15: 82239 events in 2 files, snapshot 2364169163867539990 (task 5259 ms: download 1790 ms overlapping gunzip 316 ms, parse 941 ms, sort 90 ms, write 2678 ms, index 274 ms: 1 candidates, 42759 repo-hours, 899 releases; waiting 639 ms; commit 681 ms)
2026-11-07T04:06:21Z [load_day 2026-09-12] 2026-09-12 hour 16: 70145 events in 2 files, snapshot 1006286656798348432 (task 5867 ms: download 2475 ms overlapping gunzip 329 ms, parse 902 ms, sort 102 ms, write 2482 ms, index 257 ms: 3 candidates, 40219 repo-hours, 920 releases; waiting 1377 ms; commit 856 ms)
2026-11-07T04:06:22Z [load_day 2026-09-12] 2026-09-12 hour 17: 66701 events in 2 files, snapshot 6745499685852671645 (task 4973 ms: download 1824 ms overlapping gunzip 363 ms, parse 1066 ms, sort 99 ms, write 2362 ms, index 254 ms: 4 candidates, 40160 repo-hours, 879 releases; waiting 517 ms; commit 683 ms)
2026-11-07T04:06:27Z [load_day 2026-09-12] 2026-09-12 hour 18: 63831 events in 2 files, snapshot 6698309644581898923 (task 5570 ms: download 2272 ms overlapping gunzip 327 ms, parse 932 ms, sort 99 ms, write 2613 ms, index 261 ms: 5 candidates, 37132 repo-hours, 851 releases; waiting 1004 ms; commit 924 ms)
2026-11-07T04:06:28Z [load_day 2026-09-12] 2026-09-12 hour 19: 66347 events in 2 files, snapshot 5611892794675880590 (task 5359 ms: download 1929 ms overlapping gunzip 394 ms, parse 1168 ms, sort 69 ms, write 2591 ms, index 271 ms: 5 candidates, 37977 repo-hours, 838 releases; waiting 580 ms; commit 776 ms)
2026-11-07T04:06:33Z [load_day 2026-09-12] 2026-09-12 hour 20: 63791 events in 2 files, snapshot 2398200613271973715 (task 5540 ms: download 1951 ms overlapping gunzip 338 ms, parse 1027 ms, sort 111 ms, write 2689 ms, index 248 ms: 9 candidates, 37593 repo-hours, 879 releases; waiting 811 ms; commit 783 ms)
2026-11-07T04:06:34Z [load_day 2026-09-12] 2026-09-12 hour 21: 61652 events in 2 files, snapshot 8161495518362078093 (task 5486 ms: download 2232 ms overlapping gunzip 388 ms, parse 1159 ms, sort 111 ms, write 2285 ms, index 279 ms: 4 candidates, 37697 repo-hours, 885 releases; waiting 948 ms; commit 567 ms)
2026-11-07T04:06:39Z [load_day 2026-09-12] 2026-09-12 hour 22: 61585 events in 2 files, snapshot 6993928257644943978 (task 5420 ms: download 2567 ms overlapping gunzip 368 ms, parse 1052 ms, sort 125 ms, write 2721 ms, index 226 ms: 6 candidates, 36215 repo-hours, 948 releases; waiting 635 ms; commit 881 ms)
2026-11-07T04:06:40Z [load_day 2026-09-12] 2026-09-12 hour 23: 69437 events in 2 files, snapshot 1190036593667232766 (task 5735 ms: download 2376 ms overlapping gunzip 433 ms, parse 1283 ms, sort 114 ms, write 2539 ms, index 264 ms: 7 candidates, 40348 repo-hours, 984 releases; waiting 787 ms; commit 812 ms)
2026-11-07T04:06:45Z [load_day 2026-09-12] 2026-09-12: repo_hour merged from 24 files to 1 (895226 rows, 4155 ms)
2026-11-07T04:06:46Z [load_day 2026-09-12] 2026-09-12: index committed in 5646 ms (24 + 1 + 24 files)
2026-11-07T04:06:46Z [load_day 2026-09-12] 2026-09-12: 1659584 events in 24 hours
2026-11-07T04:06:46Z [load_day 2026-09-12] attempt 1 succeeded