orcaLog in

Runs · run 203

load_day 2026-09-11, attempt 1 succeeded

Host
4e84322b8c45:35121
Started
2026-11-07T04:06:47Z
Ended
2026-11-07T04:08:50Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/203/load_day/2026-09-11/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:06:47Z [load_day 2026-09-11] attempt 1 started
2026-11-07T04:07:00Z [load_day 2026-09-11] 2026-09-11 hour 0: 87540 events in 2 files, snapshot 4962460794172074534 (task 10269 ms: download 3787 ms overlapping gunzip 666 ms, parse 2110 ms, sort 252 ms, write 6005 ms, index 273 ms: 5 candidates, 43560 repo-hours, 1998 releases; waiting 641 ms; commit 927 ms)
2026-11-07T04:07:01Z [load_day 2026-09-11] 2026-09-11 hour 1: 90193 events in 2 files, snapshot 8371858232375995984 (task 10222 ms: download 3621 ms overlapping gunzip 657 ms, parse 1940 ms, sort 180 ms, write 6106 ms, index 294 ms: 3 candidates, 45724 repo-hours, 1788 releases; waiting 688 ms; commit 827 ms)
2026-11-07T04:07:10Z [load_day 2026-09-11] 2026-09-11 hour 2: 93173 events in 2 files, snapshot 6736271086995147199 (task 9624 ms: download 3195 ms overlapping gunzip 714 ms, parse 2084 ms, sort 197 ms, write 5262 ms, index 298 ms: 5 candidates, 46438 repo-hours, 2032 releases; waiting 777 ms; commit 876 ms)
2026-11-07T04:07:11Z [load_day 2026-09-11] 2026-09-11 hour 3: 90775 events in 2 files, snapshot 4071962300780915212 (task 9117 ms: download 2921 ms overlapping gunzip 837 ms, parse 2473 ms, sort 322 ms, write 4408 ms, index 298 ms: 4 candidates, 46868 repo-hours, 2182 releases; waiting 569 ms; commit 699 ms)
2026-11-07T04:07:21Z [load_day 2026-09-11] 2026-09-11 hour 4: 91668 events in 2 files, snapshot 1262398323544176649 (task 10001 ms: download 3567 ms overlapping gunzip 663 ms, parse 1978 ms, sort 199 ms, write 5648 ms, index 308 ms: 5 candidates, 47284 repo-hours, 2105 releases; waiting 881 ms; commit 973 ms)
2026-11-07T04:07:22Z [load_day 2026-09-11] 2026-09-11 hour 5: 86583 events in 2 files, snapshot 1575540395929777280 (task 8741 ms: download 2553 ms overlapping gunzip 559 ms, parse 1720 ms, sort 236 ms, write 5117 ms, index 300 ms: 7 candidates, 45889 repo-hours, 1800 releases; waiting 513 ms; commit 859 ms)
2026-11-07T04:07:30Z [load_day 2026-09-11] 2026-09-11 hour 6: 88604 events in 2 files, snapshot 5045917386778979258 (task 8186 ms: download 2501 ms overlapping gunzip 542 ms, parse 1586 ms, sort 170 ms, write 4649 ms, index 319 ms: 3 candidates, 49743 repo-hours, 1696 releases; waiting 620 ms; commit 755 ms)
2026-11-07T04:07:31Z [load_day 2026-09-11] 2026-09-11 hour 7: 89961 events in 2 files, snapshot 944381664197343626 (task 8003 ms: download 2108 ms overlapping gunzip 673 ms, parse 1975 ms, sort 266 ms, write 4206 ms, index 326 ms: 3 candidates, 51033 repo-hours, 1755 releases; waiting 290 ms; commit 884 ms)
2026-11-07T04:07:39Z [load_day 2026-09-11] 2026-09-11 hour 8: 85885 events in 2 files, snapshot 7121725298479119349 (task 7903 ms: download 2384 ms overlapping gunzip 531 ms, parse 1586 ms, sort 127 ms, write 4141 ms, index 295 ms: 6 candidates, 49184 repo-hours, 1499 releases; waiting 582 ms; commit 747 ms)
2026-11-07T04:07:39Z [load_day 2026-09-11] 2026-09-11 hour 9: 82786 events in 2 files, snapshot 9094370965655221363 (task 7240 ms: download 2167 ms overlapping gunzip 511 ms, parse 1514 ms, sort 180 ms, write 3781 ms, index 279 ms: 1 candidates, 47748 repo-hours, 1422 releases; waiting 678 ms; commit 714 ms)
2026-11-07T04:07:47Z [load_day 2026-09-11] 2026-09-11 hour 10: 76874 events in 2 files, snapshot 2374142155500867428 (task 7579 ms: download 2452 ms overlapping gunzip 498 ms, parse 1456 ms, sort 205 ms, write 3983 ms, index 318 ms: 6 candidates, 45456 repo-hours, 1322 releases; waiting 829 ms; commit 941 ms)
2026-11-07T04:07:48Z [load_day 2026-09-11] 2026-09-11 hour 11: 74835 events in 2 files, snapshot 1112109473736981534 (task 6901 ms: download 2516 ms overlapping gunzip 460 ms, parse 1418 ms, sort 180 ms, write 3468 ms, index 270 ms: 5 candidates, 45311 repo-hours, 1231 releases; waiting 812 ms; commit 773 ms)
2026-11-07T04:07:53Z [load_day 2026-09-11] 2026-09-11 hour 12: 72835 events in 2 files, snapshot 3189217827817992367 (task 6021 ms: download 1794 ms overlapping gunzip 408 ms, parse 1164 ms, sort 128 ms, write 3145 ms, index 282 ms: 5 candidates, 45839 repo-hours, 1257 releases; waiting 585 ms; commit 770 ms)
2026-11-07T04:07:55Z [load_day 2026-09-11] 2026-09-11 hour 13: 75951 events in 2 files, snapshot 7017778620062110830 (task 6556 ms: download 2091 ms overlapping gunzip 514 ms, parse 1508 ms, sort 125 ms, write 3165 ms, index 282 ms: 2 candidates, 48161 repo-hours, 1294 releases; waiting 564 ms; commit 866 ms)
2026-11-07T04:08:02Z [load_day 2026-09-11] 2026-09-11 hour 14: 76385 events in 2 files, snapshot 7008003387634358023 (task 7972 ms: download 2497 ms overlapping gunzip 603 ms, parse 1737 ms, sort 287 ms, write 4048 ms, index 306 ms: 5 candidates, 46724 repo-hours, 1566 releases; waiting 691 ms; commit 884 ms)
2026-11-07T04:08:05Z [load_day 2026-09-11] 2026-09-11 hour 15: 83273 events in 2 files, snapshot 2373850249016839759 (task 9111 ms: download 2850 ms overlapping gunzip 757 ms, parse 2295 ms, sort 213 ms, write 4610 ms, index 323 ms: 4 candidates, 46273 repo-hours, 1874 releases; waiting 614 ms; commit 939 ms)
2026-11-07T04:08:13Z [load_day 2026-09-11] 2026-09-11 hour 16: 87219 events in 2 files, snapshot 9104580681386291261 (task 10011 ms: download 3684 ms overlapping gunzip 692 ms, parse 2035 ms, sort 188 ms, write 5318 ms, index 401 ms: 9 candidates, 46676 repo-hours, 1997 releases; waiting 808 ms; commit 747 ms)
2026-11-07T04:08:15Z [load_day 2026-09-11] 2026-09-11 hour 17: 88160 events in 2 files, snapshot 7879327386312674234 (task 9365 ms: download 2663 ms overlapping gunzip 830 ms, parse 2352 ms, sort 191 ms, write 4812 ms, index 295 ms: 7 candidates, 46460 repo-hours, 2199 releases; waiting 570 ms; commit 821 ms)
2026-11-07T04:08:23Z [load_day 2026-09-11] 2026-09-11 hour 18: 85614 events in 2 files, snapshot 7897968447929032640 (task 9301 ms: download 3012 ms overlapping gunzip 677 ms, parse 1993 ms, sort 216 ms, write 4938 ms, index 351 ms: 6 candidates, 45442 repo-hours, 2058 releases; waiting 850 ms; commit 811 ms)
2026-11-07T04:08:25Z [load_day 2026-09-11] 2026-09-11 hour 19: 82963 events in 2 files, snapshot 7946830666401658364 (task 9081 ms: download 2648 ms overlapping gunzip 797 ms, parse 2351 ms, sort 188 ms, write 4615 ms, index 274 ms: 8 candidates, 42251 repo-hours, 1932 releases; waiting 561 ms; commit 840 ms)
2026-11-07T04:08:32Z [load_day 2026-09-11] 2026-09-11 hour 20: 80194 events in 2 files, snapshot 8325898840590915187 (task 8877 ms: download 2989 ms overlapping gunzip 615 ms, parse 1847 ms, sort 195 ms, write 4800 ms, index 280 ms: 7 candidates, 40800 repo-hours, 1809 releases; waiting 788 ms; commit 790 ms)
2026-11-07T04:08:34Z [load_day 2026-09-11] 2026-09-11 hour 21: 81076 events in 2 files, snapshot 6618928736175284681 (task 9023 ms: download 2859 ms overlapping gunzip 764 ms, parse 2234 ms, sort 199 ms, write 4592 ms, index 295 ms: 11 candidates, 39888 repo-hours, 1965 releases; waiting 614 ms; commit 882 ms)
2026-11-07T04:08:42Z [load_day 2026-09-11] 2026-09-11 hour 22: 77691 events in 2 files, snapshot 4625370247583369729 (task 8959 ms: download 2639 ms overlapping gunzip 671 ms, parse 2002 ms, sort 241 ms, write 4771 ms, index 263 ms: 9 candidates, 37529 repo-hours, 1798 releases; waiting 632 ms; commit 884 ms)
2026-11-07T04:08:43Z [load_day 2026-09-11] 2026-09-11 hour 23: 73467 events in 2 files, snapshot 3520374153824571101 (task 8475 ms: download 2807 ms overlapping gunzip 697 ms, parse 2261 ms, sort 219 ms, write 4078 ms, index 280 ms: 8 candidates, 34392 repo-hours, 1788 releases; waiting 656 ms; commit 1061 ms)
2026-11-07T04:08:48Z [load_day 2026-09-11] 2026-09-11: repo_hour merged from 24 files to 1 (1084673 rows, 4942 ms)
2026-11-07T04:08:50Z [load_day 2026-09-11] 2026-09-11: index committed in 6717 ms (24 + 1 + 24 files)
2026-11-07T04:08:50Z [load_day 2026-09-11] 2026-09-11: 2003705 events in 24 hours
2026-11-07T04:08:50Z [load_day 2026-09-11] attempt 1 succeeded