orcaLog in

Runs · run 221

load_day 2026-09-05, attempt 1 succeeded

Host
4e84322b8c45:37895
Started
2026-11-07T04:15:00Z
Ended
2026-11-07T04:17:14Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/221/load_day/2026-09-05/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:15:00Z [load_day 2026-09-05] attempt 1 started
2026-11-07T04:15:14Z [load_day 2026-09-05] 2026-09-05 hour 0: 81070 events in 2 files, snapshot 5578739655425693843 (task 11513 ms: download 3014 ms overlapping gunzip 863 ms, parse 2688 ms, sort 291 ms, write 6559 ms, index 197 ms: 1 candidates, 30556 repo-hours, 2235 releases; waiting 519 ms; commit 879 ms)
2026-11-07T04:15:15Z [load_day 2026-09-05] 2026-09-05 hour 1: 80325 events in 2 files, snapshot 4475135817839179490 (task 10988 ms: download 3640 ms overlapping gunzip 744 ms, parse 2327 ms, sort 216 ms, write 6424 ms, index 197 ms: 2 candidates, 30611 repo-hours, 2107 releases; waiting 739 ms; commit 843 ms)
2026-11-07T04:15:27Z [load_day 2026-09-05] 2026-09-05 hour 2: 81756 events in 2 files, snapshot 6649167841740292150 (task 11656 ms: download 3543 ms overlapping gunzip 777 ms, parse 2351 ms, sort 302 ms, write 6709 ms, index 202 ms: 6 candidates, 32384 repo-hours, 2313 releases; waiting 963 ms; commit 852 ms)
2026-11-07T04:15:28Z [load_day 2026-09-05] 2026-09-05 hour 3: 75619 events in 2 files, snapshot 787554275014442230 (task 10293 ms: download 2877 ms overlapping gunzip 708 ms, parse 2118 ms, sort 215 ms, write 6254 ms, index 198 ms: 8 candidates, 30884 repo-hours, 2373 releases; waiting 573 ms; commit 767 ms)
2026-11-07T04:15:38Z [load_day 2026-09-05] 2026-09-05 hour 4: 75191 events in 2 files, snapshot 3457202336271407221 (task 10329 ms: download 3909 ms overlapping gunzip 786 ms, parse 2426 ms, sort 206 ms, write 5693 ms, index 193 ms: 5 candidates, 31122 repo-hours, 2140 releases; waiting 792 ms; commit 659 ms)
2026-11-07T04:15:38Z [load_day 2026-09-05] 2026-09-05 hour 5: 73475 events in 2 files, snapshot 6492433481668221041 (task 9565 ms: download 2829 ms overlapping gunzip 661 ms, parse 1937 ms, sort 309 ms, write 5527 ms, index 197 ms: 6 candidates, 30900 repo-hours, 2120 releases; waiting 664 ms; commit 725 ms)
2026-11-07T04:15:48Z [load_day 2026-09-05] 2026-09-05 hour 6: 75042 events in 2 files, snapshot 2544755458109664385 (task 9361 ms: download 2955 ms overlapping gunzip 678 ms, parse 1989 ms, sort 244 ms, write 5166 ms, index 226 ms: 1 candidates, 32490 repo-hours, 2231 releases; waiting 727 ms; commit 780 ms)
2026-11-07T04:15:50Z [load_day 2026-09-05] 2026-09-05 hour 7: 73609 events in 2 files, snapshot 9172371359795049668 (task 9690 ms: download 2809 ms overlapping gunzip 848 ms, parse 2576 ms, sort 210 ms, write 5005 ms, index 226 ms: 4 candidates, 31992 repo-hours, 2415 releases; waiting 562 ms; commit 1823 ms)
2026-11-07T04:15:57Z [load_day 2026-09-05] 2026-09-05 hour 8: 70672 events in 2 files, snapshot 6158635295306129469 (task 8925 ms: download 2809 ms overlapping gunzip 629 ms, parse 1820 ms, sort 187 ms, write 4914 ms, index 290 ms: 7 candidates, 32240 repo-hours, 2269 releases; waiting 740 ms; commit 848 ms)
2026-11-07T04:15:59Z [load_day 2026-09-05] 2026-09-05 hour 9: 74595 events in 2 files, snapshot 7423500649724849150 (task 9289 ms: download 3288 ms overlapping gunzip 729 ms, parse 2228 ms, sort 285 ms, write 4877 ms, index 251 ms: 7 candidates, 34011 repo-hours, 2392 releases; waiting 621 ms; commit 861 ms)
2026-11-07T04:16:07Z [load_day 2026-09-05] 2026-09-05 hour 10: 71829 events in 2 files, snapshot 8640706363110677119 (task 9130 ms: download 2670 ms overlapping gunzip 633 ms, parse 1910 ms, sort 195 ms, write 5249 ms, index 264 ms: 6 candidates, 32970 repo-hours, 2468 releases; waiting 614 ms; commit 902 ms)
2026-11-07T04:16:08Z [load_day 2026-09-05] 2026-09-05 hour 11: 74669 events in 2 files, snapshot 7596669195172315291 (task 8804 ms: download 2967 ms overlapping gunzip 686 ms, parse 2094 ms, sort 278 ms, write 4715 ms, index 241 ms: 6 candidates, 35081 repo-hours, 2454 releases; waiting 574 ms; commit 799 ms)
2026-11-07T04:16:18Z [load_day 2026-09-05] 2026-09-05 hour 12: 77906 events in 2 files, snapshot 2603436615621991454 (task 10336 ms: download 3377 ms overlapping gunzip 684 ms, parse 2112 ms, sort 195 ms, write 5716 ms, index 253 ms: 7 candidates, 38272 repo-hours, 2194 releases; waiting 1115 ms; commit 722 ms)
2026-11-07T04:16:19Z [load_day 2026-09-05] 2026-09-05 hour 13: 75982 events in 2 files, snapshot 4596629652140364389 (task 9463 ms: download 2622 ms overlapping gunzip 613 ms, parse 1796 ms, sort 179 ms, write 5634 ms, index 254 ms: 16 candidates, 39254 repo-hours, 2233 releases; waiting 661 ms; commit 720 ms)
2026-11-07T04:16:28Z [load_day 2026-09-05] 2026-09-05 hour 14: 80848 events in 2 files, snapshot 1811279497414410987 (task 8751 ms: download 2849 ms overlapping gunzip 630 ms, parse 1837 ms, sort 182 ms, write 4719 ms, index 450 ms: 10 candidates, 43178 repo-hours, 2219 releases; waiting 621 ms; commit 782 ms)
2026-11-07T04:16:29Z [load_day 2026-09-05] 2026-09-05 hour 15: 84492 events in 2 files, snapshot 8770931830638812425 (task 9664 ms: download 2864 ms overlapping gunzip 865 ms, parse 2505 ms, sort 194 ms, write 4732 ms, index 287 ms: 10 candidates, 42617 repo-hours, 2236 releases; waiting 772 ms; commit 766 ms)
2026-11-07T04:16:38Z [load_day 2026-09-05] 2026-09-05 hour 16: 83777 events in 2 files, snapshot 308052258408400074 (task 9853 ms: download 3201 ms overlapping gunzip 663 ms, parse 2021 ms, sort 256 ms, write 5615 ms, index 327 ms: 7 candidates, 41972 repo-hours, 2362 releases; waiting 671 ms; commit 687 ms)
2026-11-07T04:16:39Z [load_day 2026-09-05] 2026-09-05 hour 17: 85998 events in 2 files, snapshot 4470483270793060658 (task 9127 ms: download 2548 ms overlapping gunzip 841 ms, parse 2501 ms, sort 262 ms, write 4676 ms, index 277 ms: 8 candidates, 42372 repo-hours, 2428 releases; waiting 303 ms; commit 806 ms)
2026-11-07T04:16:48Z [load_day 2026-09-05] 2026-09-05 hour 18: 82376 events in 2 files, snapshot 1857651372226955702 (task 9556 ms: download 3095 ms overlapping gunzip 689 ms, parse 2025 ms, sort 190 ms, write 5408 ms, index 288 ms: 12 candidates, 39418 repo-hours, 2041 releases; waiting 660 ms; commit 787 ms)
2026-11-07T04:16:49Z [load_day 2026-09-05] 2026-09-05 hour 19: 82384 events in 2 files, snapshot 1189952407397948374 (task 9256 ms: download 3226 ms overlapping gunzip 808 ms, parse 2404 ms, sort 199 ms, write 4469 ms, index 257 ms: 7 candidates, 38320 repo-hours, 2183 releases; waiting 793 ms; commit 582 ms)
2026-11-07T04:16:59Z [load_day 2026-09-05] 2026-09-05 hour 20: 79767 events in 2 files, snapshot 8845702238007967738 (task 9894 ms: download 3440 ms overlapping gunzip 689 ms, parse 2134 ms, sort 204 ms, write 5395 ms, index 234 ms: 9 candidates, 36439 repo-hours, 2087 releases; waiting 960 ms; commit 982 ms)
2026-11-07T04:17:00Z [load_day 2026-09-05] 2026-09-05 hour 21: 78027 events in 2 files, snapshot 1734519867068747307 (task 9587 ms: download 3315 ms overlapping gunzip 738 ms, parse 2207 ms, sort 366 ms, write 5025 ms, index 245 ms: 3 candidates, 34984 repo-hours, 1862 releases; waiting 662 ms; commit 798 ms)
2026-11-07T04:17:08Z [load_day 2026-09-05] 2026-09-05 hour 22: 77502 events in 2 files, snapshot 5937072904742028680 (task 8452 ms: download 2404 ms overlapping gunzip 636 ms, parse 1806 ms, sort 243 ms, write 4764 ms, index 224 ms: 7 candidates, 33675 repo-hours, 1896 releases; waiting 552 ms; commit 838 ms)
2026-11-07T04:17:09Z [load_day 2026-09-05] 2026-09-05 hour 23: 71080 events in 2 files, snapshot 4405671945219196962 (task 7952 ms: download 2174 ms overlapping gunzip 631 ms, parse 1959 ms, sort 384 ms, write 4171 ms, index 195 ms: 6 candidates, 30963 repo-hours, 1898 releases; waiting 250 ms; commit 834 ms)
2026-11-07T04:17:13Z [load_day 2026-09-05] 2026-09-05: repo_hour merged from 24 files to 1 (846705 rows, 3901 ms)
2026-11-07T04:17:14Z [load_day 2026-09-05] 2026-09-05: index committed in 5559 ms (24 + 1 + 24 files)
2026-11-07T04:17:14Z [load_day 2026-09-05] 2026-09-05: 1867991 events in 24 hours
2026-11-07T04:17:14Z [load_day 2026-09-05] attempt 1 succeeded