orcaLog in

Runs · run 1469

load_day 2023-09-06, attempt 1 succeeded

Host
3c2b29713ce8:301195
Started
2026-11-08T00:34:20Z
Ended
2026-11-08T00:38:27Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1469/load_day/2023-09-06/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T00:34:20Z [load_day 2023-09-06] attempt 1 started
2026-11-08T00:34:22Z [load_day 2023-09-06] 2023-09-06: 2 hours in flight, about 1200 MB
2026-11-08T00:34:43Z [load_day 2023-09-06] 2023-09-06 hour 0: 168171 events in 4 files, snapshot 8259262035600030694 (task 15944 ms: download 6596 ms overlapping gunzip 879 ms, parse 4093 ms, sort 118 ms, write 9394 ms, index 576 ms: 6 candidates, 86917 repo-hours, 948 releases; waiting 524 ms; commit 3763 ms)
2026-11-08T00:34:46Z [load_day 2023-09-06] 2023-09-06 hour 1: 160265 events in 4 files, snapshot 3645653830930510514 (task 14855 ms: download 5909 ms overlapping gunzip 694 ms, parse 3297 ms, sort 148 ms, write 9134 ms, index 656 ms: 5 candidates, 88224 repo-hours, 722 releases; waiting 625 ms; commit 2510 ms)
2026-11-08T00:34:58Z [load_day 2023-09-06] 2023-09-06 hour 2: 140555 events in 3 files, snapshot 8464145170631427490 (task 14870 ms: download 6431 ms overlapping gunzip 748 ms, parse 3138 ms, sort 200 ms, write 7825 ms, index 609 ms: 6 candidates, 59957 repo-hours, 835 releases; waiting 1606 ms; commit 2592 ms)
2026-11-08T00:35:00Z [load_day 2023-09-06] 2023-09-06 hour 3: 134145 events in 3 files, snapshot 6340946631793397441 (task 11861 ms: download 4854 ms overlapping gunzip 729 ms, parse 3257 ms, sort 97 ms, write 6619 ms, index 437 ms: 4 candidates, 56948 repo-hours, 823 releases; waiting 511 ms; commit 2507 ms)
2026-11-08T00:35:12Z [load_day 2023-09-06] 2023-09-06 hour 4: 129269 events in 3 files, snapshot 4250644406895809745 (task 11856 ms: download 4893 ms overlapping gunzip 735 ms, parse 3042 ms, sort 88 ms, write 6908 ms, index 377 ms: 6 candidates, 53849 repo-hours, 660 releases; waiting 500 ms; commit 3811 ms)
2026-11-08T00:35:16Z [load_day 2023-09-06] 2023-09-06 hour 5: 145490 events in 3 files, snapshot 1865413704051341957 (task 14412 ms: download 5353 ms overlapping gunzip 790 ms, parse 3571 ms, sort 169 ms, write 8520 ms, index 513 ms: 3 candidates, 60428 repo-hours, 775 releases; waiting 533 ms; commit 2818 ms)
2026-11-08T00:35:30Z [load_day 2023-09-06] 2023-09-06 hour 6: 172103 events in 4 files, snapshot 4708645923309135978 (task 17249 ms: download 9947 ms overlapping gunzip 1106 ms, parse 4786 ms, sort 154 ms, write 9882 ms, index 718 ms: 3 candidates, 77883 repo-hours, 926 releases; waiting 269 ms; commit 3381 ms)
2026-11-08T00:35:37Z [load_day 2023-09-06] 2023-09-06 hour 7: 179566 events in 4 files, snapshot 8495376934433536152 (task 19261 ms: download 10488 ms overlapping gunzip 1223 ms, parse 5551 ms, sort 161 ms, write 10947 ms, index 602 ms: 6 candidates, 78574 repo-hours, 985 releases; waiting 518 ms; commit 3013 ms)
2026-11-08T00:35:51Z [load_day 2023-09-06] 2023-09-06 hour 8: 184931 events in 4 files, snapshot 6694575910475784149 (task 21195 ms: download 12617 ms overlapping gunzip 1175 ms, parse 5114 ms, sort 162 ms, write 13383 ms, index 605 ms: 3 candidates, 83007 repo-hours, 1024 releases; waiting 502 ms; commit 2116 ms)
2026-11-08T00:35:57Z [load_day 2023-09-06] 2023-09-06 hour 9: 185975 events in 4 files, snapshot 3052172795798370017 (task 18413 ms: download 11176 ms overlapping gunzip 1203 ms, parse 5435 ms, sort 122 ms, write 10275 ms, index 602 ms: 4 candidates, 81584 repo-hours, 1229 releases; waiting 483 ms; commit 3176 ms)
2026-11-08T00:36:08Z [load_day 2023-09-06] 2023-09-06 hour 10: 183768 events in 4 files, snapshot 1825574606469024819 (task 16141 ms: download 9124 ms overlapping gunzip 920 ms, parse 4075 ms, sort 112 ms, write 9071 ms, index 590 ms: 9 candidates, 78815 repo-hours, 1070 releases; waiting 973 ms; commit 2066 ms)
2026-11-08T00:36:13Z [load_day 2023-09-06] 2023-09-06 hour 11: 184476 events in 4 files, snapshot 2570575507236663649 (task 16094 ms: download 8835 ms overlapping gunzip 928 ms, parse 4192 ms, sort 121 ms, write 9514 ms, index 724 ms: 4 candidates, 78264 repo-hours, 1033 releases; waiting 353 ms; commit 2879 ms)
2026-11-08T00:36:33Z [load_day 2023-09-06] 2023-09-06 hour 12: 223637 events in 5 files, snapshot 5977794468315238872 (task 19827 ms: download 10640 ms overlapping gunzip 1084 ms, parse 5046 ms, sort 192 ms, write 12069 ms, index 672 ms: 9 candidates, 108209 repo-hours, 1109 releases; waiting 500 ms; commit 6934 ms)
2026-11-08T00:36:36Z [load_day 2023-09-06] 2023-09-06 hour 13: 205082 events in 5 files, snapshot 3180338037328694461 (task 21825 ms: download 11653 ms overlapping gunzip 1152 ms, parse 5178 ms, sort 222 ms, write 13604 ms, index 914 ms: 4 candidates, 102296 repo-hours, 1106 releases; waiting 503 ms; commit 2377 ms)
2026-11-08T00:36:53Z [load_day 2023-09-06] 2023-09-06 hour 14: 198384 events in 4 files, snapshot 5185210209765385914 (task 23276 ms: download 13190 ms overlapping gunzip 1322 ms, parse 6445 ms, sort 141 ms, write 13968 ms, index 608 ms: 5 candidates, 90528 repo-hours, 1162 releases; waiting 500 ms; commit 2591 ms)
2026-11-08T00:36:58Z [load_day 2023-09-06] 2023-09-06 hour 15: 188973 events in 4 files, snapshot 2981636394849411746 (task 20792 ms: download 11565 ms overlapping gunzip 1106 ms, parse 5095 ms, sort 180 ms, write 12853 ms, index 915 ms: 5 candidates, 86709 repo-hours, 1105 releases; waiting 344 ms; commit 2916 ms)
2026-11-08T00:37:16Z [load_day 2023-09-06] 2023-09-06 hour 16: 178930 events in 4 files, snapshot 5361940205420847865 (task 19969 ms: download 12136 ms overlapping gunzip 1084 ms, parse 4653 ms, sort 121 ms, write 12620 ms, index 635 ms: 5 candidates, 80526 repo-hours, 1121 releases; waiting 512 ms; commit 3802 ms)
2026-11-08T00:37:19Z [load_day 2023-09-06] 2023-09-06 hour 17: 179461 events in 4 files, snapshot 6939306934426463286 (task 19695 ms: download 11612 ms overlapping gunzip 1068 ms, parse 4587 ms, sort 141 ms, write 11852 ms, index 1034 ms: 5 candidates, 77745 repo-hours, 1025 releases; waiting 635 ms; commit 2420 ms)
2026-11-08T00:37:39Z [load_day 2023-09-06] 2023-09-06 hour 18: 188748 events in 4 files, snapshot 2743647964821814514 (task 21437 ms: download 12676 ms overlapping gunzip 1428 ms, parse 6016 ms, sort 183 ms, write 11973 ms, index 659 ms: 5 candidates, 85088 repo-hours, 1132 releases; waiting 729 ms; commit 4453 ms)
2026-11-08T00:37:42Z [load_day 2023-09-06] 2023-09-06 hour 19: 171171 events in 4 files, snapshot 6031685560639103640 (task 18133 ms: download 10960 ms overlapping gunzip 982 ms, parse 4370 ms, sort 173 ms, write 11267 ms, index 557 ms: 3 candidates, 72137 repo-hours, 1125 releases; waiting 494 ms; commit 2813 ms)
2026-11-08T00:37:57Z [load_day 2023-09-06] 2023-09-06 hour 20: 172615 events in 4 files, snapshot 3621385896609235026 (task 19864 ms: download 12195 ms overlapping gunzip 1231 ms, parse 5334 ms, sort 237 ms, write 11778 ms, index 566 ms: 3 candidates, 72846 repo-hours, 877 releases; waiting 475 ms; commit 2462 ms)
2026-11-08T00:38:02Z [load_day 2023-09-06] 2023-09-06 hour 21: 158748 events in 4 files, snapshot 7185361931839923663 (task 18871 ms: download 12398 ms overlapping gunzip 1320 ms, parse 5681 ms, sort 176 ms, write 10112 ms, index 643 ms: 5 candidates, 64119 repo-hours, 1121 releases; waiting 631 ms; commit 2753 ms)
2026-11-08T00:38:14Z [load_day 2023-09-06] 2023-09-06 hour 22: 134258 events in 3 files, snapshot 2756453830378093736 (task 15553 ms: download 7024 ms overlapping gunzip 1055 ms, parse 4401 ms, sort 134 ms, write 8768 ms, index 482 ms: 1 candidates, 55011 repo-hours, 850 releases; waiting 501 ms; commit 2321 ms)
2026-11-08T00:38:16Z [load_day 2023-09-06] 2023-09-06 hour 23: 127310 events in 3 files, snapshot 1701629050937514170 (task 13926 ms: download 6427 ms overlapping gunzip 771 ms, parse 3247 ms, sort 77 ms, write 8607 ms, index 466 ms: 4 candidates, 52331 repo-hours, 623 releases; waiting 477 ms; commit 2002 ms)
2026-11-08T00:38:24Z [load_day 2023-09-06] 2023-09-06: repo_hour merged from 24 files to 1 (1831995 rows, 7822 ms)
2026-11-08T00:38:27Z [load_day 2023-09-06] 2023-09-06: index committed in 10372 ms (24 + 1 + 24 files)
2026-11-08T00:38:27Z [load_day 2023-09-06] 2023-09-06: 4096031 events in 24 hours
2026-11-08T00:38:27Z [load_day 2023-09-06] attempt 1 succeeded