orcaLog in

Runs · run 623

load_day 2026-04-24, attempt 1 succeeded

Host
4e84322b8c45:151128
Started
2026-11-07T12:38:52Z
Ended
2026-11-07T12:40:18Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/623/load_day/2026-04-24/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T12:38:52Z [load_day 2026-04-24] attempt 1 started
2026-11-07T12:39:01Z [load_day 2026-04-24] 2026-04-24 hour 0: 148852 events in 3 files, snapshot 8292150305869384600 (task 6113 ms: download 2138 ms overlapping gunzip 381 ms, parse 1328 ms, sort 196 ms, write 2825 ms, index 507 ms: 10 candidates, 70740 repo-hours, 707 releases; waiting 522 ms; commit 1103 ms)
2026-11-07T12:39:02Z [load_day 2026-04-24] 2026-04-24 hour 1: 152119 events in 4 files, snapshot 8941684762363786289 (task 5925 ms: download 2072 ms overlapping gunzip 312 ms, parse 1106 ms, sort 150 ms, write 2824 ms, index 536 ms: 6 candidates, 81907 repo-hours, 535 releases; waiting 635 ms; commit 1148 ms)
2026-11-07T12:39:08Z [load_day 2026-04-24] 2026-04-24 hour 2: 153792 events in 4 files, snapshot 3629667463039884647 (task 5518 ms: download 1686 ms overlapping gunzip 296 ms, parse 1012 ms, sort 153 ms, write 2612 ms, index 581 ms: 13 candidates, 87404 repo-hours, 473 releases; waiting 539 ms; commit 1291 ms)
2026-11-07T12:39:08Z [load_day 2026-04-24] 2026-04-24 hour 3: 153031 events in 4 files, snapshot 7084836879677802363 (task 5794 ms: download 1910 ms overlapping gunzip 345 ms, parse 1151 ms, sort 162 ms, write 2750 ms, index 506 ms: 8 candidates, 77430 repo-hours, 733 releases; waiting 562 ms; commit 896 ms)
2026-11-07T12:39:15Z [load_day 2026-04-24] 2026-04-24 hour 4: 147154 events in 3 files, snapshot 8547823631739954033 (task 6525 ms: download 2761 ms overlapping gunzip 384 ms, parse 1245 ms, sort 151 ms, write 3010 ms, index 472 ms: 13 candidates, 71319 repo-hours, 720 releases; waiting 903 ms; commit 1110 ms)
2026-11-07T12:39:16Z [load_day 2026-04-24] 2026-04-24 hour 5: 150969 events in 4 files, snapshot 2636564298717141026 (task 5629 ms: download 1813 ms overlapping gunzip 344 ms, parse 1063 ms, sort 179 ms, write 2713 ms, index 518 ms: 8 candidates, 77077 repo-hours, 613 releases; waiting 540 ms; commit 1244 ms)
2026-11-07T12:39:21Z [load_day 2026-04-24] 2026-04-24 hour 6: 153059 events in 4 files, snapshot 3460495017003203565 (task 5096 ms: download 1657 ms overlapping gunzip 316 ms, parse 1063 ms, sort 146 ms, write 2125 ms, index 613 ms: 10 candidates, 80611 repo-hours, 444 releases; waiting 554 ms; commit 1117 ms)
2026-11-07T12:39:22Z [load_day 2026-04-24] 2026-04-24 hour 7: 152716 events in 4 files, snapshot 737925089877246979 (task 4784 ms: download 1614 ms overlapping gunzip 283 ms, parse 925 ms, sort 135 ms, write 1984 ms, index 586 ms: 7 candidates, 84818 repo-hours, 323 releases; waiting 557 ms; commit 1120 ms)
2026-11-07T12:39:27Z [load_day 2026-04-24] 2026-04-24 hour 8: 152883 events in 4 files, snapshot 1302293802416879022 (task 5217 ms: download 1901 ms overlapping gunzip 304 ms, parse 1043 ms, sort 120 ms, write 2117 ms, index 570 ms: 10 candidates, 82972 repo-hours, 288 releases; waiting 747 ms; commit 1137 ms)
2026-11-07T12:39:28Z [load_day 2026-04-24] 2026-04-24 hour 9: 155573 events in 4 files, snapshot 1845257406040001882 (task 4264 ms: download 1054 ms overlapping gunzip 286 ms, parse 957 ms, sort 135 ms, write 1835 ms, index 558 ms: 7 candidates, 83042 repo-hours, 250 releases; waiting 185 ms; commit 1277 ms)
2026-11-07T12:39:32Z [load_day 2026-04-24] 2026-04-24 hour 10: 158869 events in 4 files, snapshot 6368705853173941600 (task 4607 ms: download 1224 ms overlapping gunzip 256 ms, parse 891 ms, sort 134 ms, write 2167 ms, index 561 ms: 6 candidates, 84989 repo-hours, 275 releases; waiting 285 ms; commit 1233 ms)
2026-11-07T12:39:33Z [load_day 2026-04-24] 2026-04-24 hour 11: 153291 events in 4 files, snapshot 4373367367548795855 (task 4396 ms: download 1023 ms overlapping gunzip 246 ms, parse 832 ms, sort 124 ms, write 2095 ms, index 549 ms: 3 candidates, 83924 repo-hours, 215 releases; waiting 202 ms; commit 1025 ms)
2026-11-07T12:39:37Z [load_day 2026-04-24] 2026-04-24 hour 12: 158539 events in 4 files, snapshot 3713521789864387031 (task 4444 ms: download 1455 ms overlapping gunzip 240 ms, parse 860 ms, sort 127 ms, write 1835 ms, index 567 ms: 9 candidates, 88164 repo-hours, 203 releases; waiting 541 ms; commit 1118 ms)
2026-11-07T12:39:38Z [load_day 2026-04-24] 2026-04-24 hour 13: 156602 events in 4 files, snapshot 4679937986086799835 (task 4173 ms: download 1590 ms overlapping gunzip 207 ms, parse 767 ms, sort 98 ms, write 1535 ms, index 640 ms: 12 candidates, 95465 repo-hours, 49 releases; waiting 556 ms; commit 1009 ms)
2026-11-07T12:39:42Z [load_day 2026-04-24] 2026-04-24 hour 14: 157782 events in 4 files, snapshot 4688498227774829221 (task 4804 ms: download 1420 ms overlapping gunzip 224 ms, parse 792 ms, sort 100 ms, write 1937 ms, index 602 ms: 7 candidates, 88506 repo-hours, 90 releases; waiting 821 ms; commit 1126 ms)
2026-11-07T12:39:43Z [load_day 2026-04-24] 2026-04-24 hour 15: 154802 events in 4 files, snapshot 6673348038297038029 (task 4611 ms: download 1652 ms overlapping gunzip 228 ms, parse 804 ms, sort 120 ms, write 1743 ms, index 587 ms: 6 candidates, 84843 repo-hours, 129 releases; waiting 823 ms; commit 1133 ms)
2026-11-07T12:39:48Z [load_day 2026-04-24] 2026-04-24 hour 16: 155897 events in 4 files, snapshot 4353349266255883325 (task 4930 ms: download 1711 ms overlapping gunzip 282 ms, parse 931 ms, sort 139 ms, write 1810 ms, index 588 ms: 7 candidates, 85615 repo-hours, 130 releases; waiting 873 ms; commit 1236 ms)
2026-11-07T12:39:49Z [load_day 2026-04-24] 2026-04-24 hour 17: 153418 events in 4 files, snapshot 6958096223673781272 (task 4310 ms: download 1302 ms overlapping gunzip 242 ms, parse 884 ms, sort 131 ms, write 1804 ms, index 589 ms: 9 candidates, 84968 repo-hours, 184 releases; waiting 401 ms; commit 1092 ms)
2026-11-07T12:39:54Z [load_day 2026-04-24] 2026-04-24 hour 18: 154626 events in 4 files, snapshot 3471401871847990777 (task 5016 ms: download 1718 ms overlapping gunzip 250 ms, parse 892 ms, sort 106 ms, write 2070 ms, index 593 ms: 9 candidates, 84285 repo-hours, 203 releases; waiting 534 ms; commit 1180 ms)
2026-11-07T12:39:55Z [load_day 2026-04-24] 2026-04-24 hour 19: 152821 events in 4 files, snapshot 84801931541625389 (task 4939 ms: download 1819 ms overlapping gunzip 274 ms, parse 939 ms, sort 145 ms, write 2192 ms, index 556 ms: 7 candidates, 79301 repo-hours, 358 releases; waiting 537 ms; commit 1066 ms)
2026-11-07T12:39:59Z [load_day 2026-04-24] 2026-04-24 hour 20: 148178 events in 3 files, snapshot 3816980715513093929 (task 5061 ms: download 1843 ms overlapping gunzip 304 ms, parse 1029 ms, sort 135 ms, write 2178 ms, index 559 ms: 6 candidates, 76329 repo-hours, 363 releases; waiting 550 ms; commit 1206 ms)
2026-11-07T12:40:01Z [load_day 2026-04-24] 2026-04-24 hour 21: 147499 events in 3 files, snapshot 1557049589992883530 (task 5351 ms: download 2090 ms overlapping gunzip 360 ms, parse 1133 ms, sort 150 ms, write 2315 ms, index 497 ms: 4 candidates, 72574 repo-hours, 599 releases; waiting 557 ms; commit 1172 ms)
2026-11-07T12:40:06Z [load_day 2026-04-24] 2026-04-24 hour 22: 146572 events in 3 files, snapshot 2763424508580509507 (task 6227 ms: download 2132 ms overlapping gunzip 364 ms, parse 1226 ms, sort 168 ms, write 3082 ms, index 506 ms: 3 candidates, 70901 repo-hours, 663 releases; waiting 539 ms; commit 1290 ms)
2026-11-07T12:40:08Z [load_day 2026-04-24] 2026-04-24 hour 23: 146292 events in 3 files, snapshot 3813793163322233249 (task 6144 ms: download 2134 ms overlapping gunzip 389 ms, parse 1266 ms, sort 173 ms, write 2951 ms, index 426 ms: 5 candidates, 65346 repo-hours, 746 releases; waiting 603 ms; commit 1198 ms)
2026-11-07T12:40:16Z [load_day 2026-04-24] 2026-04-24: repo_hour merged from 24 files to 1 (1942530 rows, 7921 ms)
2026-11-07T12:40:17Z [load_day 2026-04-24] 2026-04-24: index committed in 9701 ms (24 + 1 + 24 files)
2026-11-07T12:40:17Z [load_day 2026-04-24] 2026-04-24: 3665336 events in 24 hours
2026-11-07T12:40:17Z [load_day 2026-04-24] attempt 1 succeeded