orcaLog in

Runs · run 188

load_day 2026-09-16, attempt 1 succeeded

Host
4e84322b8c45:32437
Started
2026-11-07T03:59:42Z
Ended
2026-11-07T04:01:02Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/188/load_day/2026-09-16/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:59:42Z [load_day 2026-09-16] attempt 1 started
2026-11-07T03:59:51Z [load_day 2026-09-16] 2026-09-16 hour 0: 72929 events in 2 files, snapshot 2621381162261218428 (task 7042 ms: download 1844 ms overlapping gunzip 429 ms, parse 1350 ms, sort 157 ms, write 3973 ms, index 256 ms: 2 candidates, 38574 repo-hours, 1205 releases; waiting 639 ms; commit 718 ms)
2026-11-07T03:59:52Z [load_day 2026-09-16] 2026-09-16 hour 1: 85300 events in 2 files, snapshot 8647964308048456896 (task 7562 ms: download 2307 ms overlapping gunzip 489 ms, parse 1509 ms, sort 148 ms, write 4049 ms, index 326 ms: 7 candidates, 44808 repo-hours, 1232 releases; waiting 679 ms; commit 620 ms)
2026-11-07T03:59:59Z [load_day 2026-09-16] 2026-09-16 hour 2: 90204 events in 2 files, snapshot 2798507499710265677 (task 7362 ms: download 2318 ms overlapping gunzip 423 ms, parse 1275 ms, sort 123 ms, write 3957 ms, index 298 ms: 5 candidates, 48635 repo-hours, 1235 releases; waiting 1006 ms; commit 605 ms)
2026-11-07T04:00:00Z [load_day 2026-09-16] 2026-09-16 hour 3: 94829 events in 2 files, snapshot 9048418044655434007 (task 6937 ms: download 2102 ms overlapping gunzip 422 ms, parse 1316 ms, sort 160 ms, write 3889 ms, index 308 ms: 5 candidates, 48562 repo-hours, 1119 releases; waiting 541 ms; commit 692 ms)
2026-11-07T04:00:06Z [load_day 2026-09-16] 2026-09-16 hour 4: 85109 events in 2 files, snapshot 4214256982313780664 (task 6175 ms: download 2286 ms overlapping gunzip 369 ms, parse 1113 ms, sort 109 ms, write 2980 ms, index 303 ms: 5 candidates, 44237 repo-hours, 966 releases; waiting 942 ms; commit 986 ms)
2026-11-07T04:00:07Z [load_day 2026-09-16] 2026-09-16 hour 5: 83840 events in 2 files, snapshot 1225198001342294430 (task 5738 ms: download 2259 ms overlapping gunzip 404 ms, parse 1239 ms, sort 107 ms, write 2625 ms, index 293 ms: 5 candidates, 43309 repo-hours, 861 releases; waiting 728 ms; commit 686 ms)
2026-11-07T04:00:12Z [load_day 2026-09-16] 2026-09-16 hour 6: 85648 events in 2 files, snapshot 5283380699652391772 (task 5049 ms: download 1780 ms overlapping gunzip 309 ms, parse 909 ms, sort 74 ms, write 2447 ms, index 355 ms: 1 candidates, 41932 repo-hours, 625 releases; waiting 654 ms; commit 766 ms)
2026-11-07T04:00:12Z [load_day 2026-09-16] 2026-09-16 hour 7: 88986 events in 2 files, snapshot 695813602393668133 (task 4908 ms: download 1580 ms overlapping gunzip 373 ms, parse 1046 ms, sort 99 ms, write 2234 ms, index 269 ms: 3 candidates, 40971 repo-hours, 599 releases; waiting 566 ms; commit 663 ms)
2026-11-07T04:00:18Z [load_day 2026-09-16] 2026-09-16 hour 8: 88369 events in 2 files, snapshot 4221111754887150238 (task 5274 ms: download 1935 ms overlapping gunzip 312 ms, parse 899 ms, sort 114 ms, write 2544 ms, index 304 ms: 2 candidates, 40880 repo-hours, 654 releases; waiting 764 ms; commit 929 ms)
2026-11-07T04:00:18Z [load_day 2026-09-16] 2026-09-16 hour 9: 97174 events in 2 files, snapshot 8770923503850907334 (task 4672 ms: download 1896 ms overlapping gunzip 326 ms, parse 951 ms, sort 88 ms, write 2143 ms, index 232 ms: 0 candidates, 35001 repo-hours, 486 releases; waiting 607 ms; commit 576 ms)
2026-11-07T04:00:22Z [load_day 2026-09-16] 2026-09-16 hour 10: 81086 events in 2 files, snapshot 4512134817916458018 (task 4155 ms: download 1457 ms overlapping gunzip 265 ms, parse 789 ms, sort 72 ms, write 1900 ms, index 261 ms: 4 candidates, 30825 repo-hours, 476 releases; waiting 563 ms; commit 776 ms)
2026-11-07T04:00:23Z [load_day 2026-09-16] 2026-09-16 hour 11: 77279 events in 2 files, snapshot 185266251640329191 (task 4019 ms: download 1218 ms overlapping gunzip 312 ms, parse 928 ms, sort 88 ms, write 1811 ms, index 210 ms: 2 candidates, 30281 repo-hours, 518 releases; waiting 408 ms; commit 646 ms)
2026-11-07T04:00:27Z [load_day 2026-09-16] 2026-09-16 hour 12: 66189 events in 2 files, snapshot 2554787786552137011 (task 4231 ms: download 1605 ms overlapping gunzip 268 ms, parse 781 ms, sort 70 ms, write 1841 ms, index 208 ms: 2 candidates, 29062 repo-hours, 526 releases; waiting 706 ms; commit 838 ms)
2026-11-07T04:00:28Z [load_day 2026-09-16] 2026-09-16 hour 13: 59979 events in 2 files, snapshot 8455881654939469234 (task 4062 ms: download 1433 ms overlapping gunzip 292 ms, parse 875 ms, sort 80 ms, write 1719 ms, index 208 ms: 3 candidates, 28281 repo-hours, 534 releases; waiting 586 ms; commit 646 ms)
2026-11-07T04:00:32Z [load_day 2026-09-16] 2026-09-16 hour 14: 62233 events in 2 files, snapshot 6936065335460216561 (task 4597 ms: download 1664 ms overlapping gunzip 255 ms, parse 759 ms, sort 87 ms, write 2171 ms, index 268 ms: 4 candidates, 30663 repo-hours, 595 releases; waiting 756 ms; commit 674 ms)
2026-11-07T04:00:33Z [load_day 2026-09-16] 2026-09-16 hour 15: 62583 events in 2 files, snapshot 4906009586737490540 (task 4139 ms: download 1377 ms overlapping gunzip 277 ms, parse 797 ms, sort 87 ms, write 1898 ms, index 209 ms: 4 candidates, 31757 repo-hours, 546 releases; waiting 628 ms; commit 845 ms)
2026-11-07T04:00:37Z [load_day 2026-09-16] 2026-09-16 hour 16: 56275 events in 2 files, snapshot 7186484942243152557 (task 3749 ms: download 868 ms overlapping gunzip 253 ms, parse 758 ms, sort 67 ms, write 1989 ms, index 214 ms: 2 candidates, 31506 repo-hours, 554 releases; waiting 224 ms; commit 808 ms)
2026-11-07T04:00:38Z [load_day 2026-09-16] 2026-09-16 hour 17: 56130 events in 2 files, snapshot 872759327223966819 (task 3914 ms: download 1331 ms overlapping gunzip 302 ms, parse 894 ms, sort 86 ms, write 1822 ms, index 188 ms: 2 candidates, 28665 repo-hours, 590 releases; waiting 315 ms; commit 861 ms)
2026-11-07T04:00:42Z [load_day 2026-09-16] 2026-09-16 hour 18: 53946 events in 2 files, snapshot 809587136046429137 (task 4463 ms: download 1635 ms overlapping gunzip 280 ms, parse 839 ms, sort 102 ms, write 2059 ms, index 182 ms: 4 candidates, 28062 repo-hours, 680 releases; waiting 726 ms; commit 807 ms)
2026-11-07T04:00:43Z [load_day 2026-09-16] 2026-09-16 hour 19: 51111 events in 2 files, snapshot 9003986180364375268 (task 4771 ms: download 2437 ms overlapping gunzip 246 ms, parse 757 ms, sort 80 ms, write 1739 ms, index 172 ms: 6 candidates, 26086 repo-hours, 524 releases; waiting 1481 ms; commit 764 ms)
2026-11-07T04:00:48Z [load_day 2026-09-16] 2026-09-16 hour 20: 60631 events in 2 files, snapshot 7305238677486524524 (task 5828 ms: download 1959 ms overlapping gunzip 353 ms, parse 1042 ms, sort 120 ms, write 2996 ms, index 246 ms: 4 candidates, 32832 repo-hours, 1064 releases; waiting 762 ms; commit 753 ms)
2026-11-07T04:00:49Z [load_day 2026-09-16] 2026-09-16 hour 21: 61983 events in 2 files, snapshot 5341983992755032703 (task 5666 ms: download 1837 ms overlapping gunzip 438 ms, parse 1386 ms, sort 117 ms, write 2629 ms, index 226 ms: 9 candidates, 33473 repo-hours, 977 releases; waiting 579 ms; commit 752 ms)
2026-11-07T04:00:55Z [load_day 2026-09-16] 2026-09-16 hour 22: 75578 events in 2 files, snapshot 3267849449973977812 (task 5897 ms: download 1844 ms overlapping gunzip 390 ms, parse 1148 ms, sort 126 ms, write 2795 ms, index 430 ms: 4 candidates, 36502 repo-hours, 882 releases; waiting 660 ms; commit 1059 ms)
2026-11-07T04:00:56Z [load_day 2026-09-16] 2026-09-16 hour 23: 83423 events in 2 files, snapshot 898225309086567474 (task 6060 ms: download 2082 ms overlapping gunzip 459 ms, parse 1345 ms, sort 120 ms, write 2943 ms, index 247 ms: 4 candidates, 37814 repo-hours, 918 releases; waiting 656 ms; commit 1058 ms)
2026-11-07T04:01:00Z [load_day 2026-09-16] 2026-09-16: repo_hour merged from 24 files to 1 (862718 rows, 4072 ms)
2026-11-07T04:01:02Z [load_day 2026-09-16] 2026-09-16: index committed in 5750 ms (23 + 1 + 24 files)
2026-11-07T04:01:02Z [load_day 2026-09-16] 2026-09-16: 1780814 events in 24 hours
2026-11-07T04:01:02Z [load_day 2026-09-16] attempt 1 succeeded