orcaLog in

Runs · run 347

load_day 2026-07-25, attempt 1 succeeded

Host
4e84322b8c45:64739
Started
2026-11-07T04:56:10Z
Ended
2026-11-07T04:57:11Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/347/load_day/2026-07-25/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:56:10Z [load_day 2026-07-25] attempt 1 started
2026-11-07T04:56:17Z [load_day 2026-07-25] 2026-07-25 hour 0: 163047 events in 4 files, snapshot 6358619668496196334 (task 3737 ms: download 1160 ms overlapping gunzip 197 ms, parse 777 ms, sort 107 ms, write 1584 ms, index 311 ms: 1 candidates, 48974 repo-hours, 21 releases; waiting 530 ms; commit 906 ms)
2026-11-07T04:56:18Z [load_day 2026-07-25] 2026-07-25 hour 1: 166959 events in 4 files, snapshot 4253939728654822576 (task 3953 ms: download 1458 ms overlapping gunzip 212 ms, parse 865 ms, sort 118 ms, write 1582 ms, index 349 ms: 2 candidates, 56459 repo-hours, 26 releases; waiting 516 ms; commit 799 ms)
2026-11-07T04:56:21Z [load_day 2026-07-25] 2026-07-25 hour 2: 167963 events in 4 files, snapshot 2104698905442245019 (task 3940 ms: download 1429 ms overlapping gunzip 206 ms, parse 796 ms, sort 100 ms, write 1566 ms, index 363 ms: 6 candidates, 54582 repo-hours, 24 releases; waiting 511 ms; commit 887 ms)
2026-11-07T04:56:22Z [load_day 2026-07-25] 2026-07-25 hour 3: 169265 events in 4 files, snapshot 5966852280572449186 (task 3596 ms: download 1644 ms overlapping gunzip 206 ms, parse 778 ms, sort 103 ms, write 1470 ms, index 205 ms: 2 candidates, 31400 repo-hours, 38 releases; waiting 519 ms; commit 901 ms)
2026-11-07T04:56:25Z [load_day 2026-07-25] 2026-07-25 hour 4: 173172 events in 4 files, snapshot 3403655406309424219 (task 3420 ms: download 1138 ms overlapping gunzip 207 ms, parse 796 ms, sort 111 ms, write 1497 ms, index 177 ms: 3 candidates, 27000 repo-hours, 17 releases; waiting 340 ms; commit 1099 ms)
2026-11-07T04:56:26Z [load_day 2026-07-25] 2026-07-25 hour 5: 171168 events in 4 files, snapshot 2265078192266426580 (task 3576 ms: download 1141 ms overlapping gunzip 194 ms, parse 760 ms, sort 103 ms, write 1552 ms, index 176 ms: 2 candidates, 27754 repo-hours, 27 releases; waiting 520 ms; commit 879 ms)
2026-11-07T04:56:29Z [load_day 2026-07-25] 2026-07-25 hour 6: 167565 events in 4 files, snapshot 4564230299232388763 (task 3562 ms: download 1236 ms overlapping gunzip 192 ms, parse 741 ms, sort 104 ms, write 1496 ms, index 202 ms: 2 candidates, 29148 repo-hours, 19 releases; waiting 531 ms; commit 902 ms)
2026-11-07T04:56:31Z [load_day 2026-07-25] 2026-07-25 hour 7: 170842 events in 4 files, snapshot 3292125201033037155 (task 3789 ms: download 1280 ms overlapping gunzip 204 ms, parse 800 ms, sort 109 ms, write 1624 ms, index 190 ms: 1 candidates, 27041 repo-hours, 24 releases; waiting 541 ms; commit 867 ms)
2026-11-07T04:56:33Z [load_day 2026-07-25] 2026-07-25 hour 8: 169278 events in 4 files, snapshot 6057826020300957150 (task 3515 ms: download 1326 ms overlapping gunzip 200 ms, parse 736 ms, sort 101 ms, write 1438 ms, index 197 ms: 4 candidates, 27072 repo-hours, 7 releases; waiting 530 ms; commit 880 ms)
2026-11-07T04:56:35Z [load_day 2026-07-25] 2026-07-25 hour 9: 165487 events in 4 files, snapshot 6836498396773145027 (task 3493 ms: download 975 ms overlapping gunzip 186 ms, parse 749 ms, sort 99 ms, write 1407 ms, index 172 ms: 1 candidates, 26019 repo-hours, 9 releases; waiting 386 ms; commit 901 ms)
2026-11-07T04:56:38Z [load_day 2026-07-25] 2026-07-25 hour 10: 172991 events in 4 files, snapshot 7887044788635509156 (task 3832 ms: download 1703 ms overlapping gunzip 207 ms, parse 800 ms, sort 105 ms, write 1635 ms, index 212 ms: 5 candidates, 29536 repo-hours, 13 releases; waiting 521 ms; commit 842 ms)
2026-11-07T04:56:39Z [load_day 2026-07-25] 2026-07-25 hour 11: 173678 events in 4 files, snapshot 8687849972924963099 (task 3667 ms: download 1543 ms overlapping gunzip 196 ms, parse 780 ms, sort 106 ms, write 1569 ms, index 208 ms: 2 candidates, 32481 repo-hours, 12 releases; waiting 513 ms; commit 737 ms)
2026-11-07T04:56:42Z [load_day 2026-07-25] 2026-07-25 hour 12: 171990 events in 4 files, snapshot 3038528205513853127 (task 3640 ms: download 1326 ms overlapping gunzip 197 ms, parse 793 ms, sort 110 ms, write 1507 ms, index 197 ms: 1 candidates, 30590 repo-hours, 6 releases; waiting 523 ms; commit 1018 ms)
2026-11-07T04:56:44Z [load_day 2026-07-25] 2026-07-25 hour 13: 168684 events in 4 files, snapshot 5801472142616800278 (task 3581 ms: download 1386 ms overlapping gunzip 184 ms, parse 750 ms, sort 109 ms, write 1483 ms, index 237 ms: 3 candidates, 35310 repo-hours, 15 releases; waiting 521 ms; commit 1008 ms)
2026-11-07T04:56:46Z [load_day 2026-07-25] 2026-07-25 hour 14: 170678 events in 4 files, snapshot 6172620710876723942 (task 3767 ms: download 1354 ms overlapping gunzip 202 ms, parse 792 ms, sort 105 ms, write 1621 ms, index 239 ms: 2 candidates, 33941 repo-hours, 16 releases; waiting 530 ms; commit 946 ms)
2026-11-07T04:56:48Z [load_day 2026-07-25] 2026-07-25 hour 15: 167280 events in 4 files, snapshot 1260968559102009491 (task 3636 ms: download 1611 ms overlapping gunzip 194 ms, parse 739 ms, sort 96 ms, write 1481 ms, index 247 ms: 3 candidates, 36510 repo-hours, 10 releases; waiting 535 ms; commit 722 ms)
2026-11-07T04:56:51Z [load_day 2026-07-25] 2026-07-25 hour 16: 168133 events in 4 files, snapshot 7637317215563082049 (task 4124 ms: download 1615 ms overlapping gunzip 207 ms, parse 807 ms, sort 103 ms, write 1548 ms, index 273 ms: 3 candidates, 39543 repo-hours, 22 releases; waiting 860 ms; commit 975 ms)
2026-11-07T04:56:52Z [load_day 2026-07-25] 2026-07-25 hour 17: 167373 events in 4 files, snapshot 3733710429735604165 (task 3610 ms: download 1256 ms overlapping gunzip 192 ms, parse 740 ms, sort 105 ms, write 1471 ms, index 291 ms: 5 candidates, 45704 repo-hours, 15 releases; waiting 523 ms; commit 918 ms)
2026-11-07T04:56:56Z [load_day 2026-07-25] 2026-07-25 hour 18: 172286 events in 4 files, snapshot 3280960745154414588 (task 3867 ms: download 1411 ms overlapping gunzip 210 ms, parse 818 ms, sort 104 ms, write 1619 ms, index 309 ms: 4 candidates, 46397 repo-hours, 10 releases; waiting 533 ms; commit 1068 ms)
2026-11-07T04:56:57Z [load_day 2026-07-25] 2026-07-25 hour 19: 166865 events in 4 files, snapshot 4786624599129086130 (task 3548 ms: download 1178 ms overlapping gunzip 203 ms, parse 749 ms, sort 110 ms, write 1440 ms, index 296 ms: 4 candidates, 46664 repo-hours, 19 releases; waiting 528 ms; commit 888 ms)
2026-11-07T04:57:00Z [load_day 2026-07-25] 2026-07-25 hour 20: 168666 events in 4 files, snapshot 4564927820669303944 (task 3789 ms: download 1281 ms overlapping gunzip 197 ms, parse 752 ms, sort 105 ms, write 1586 ms, index 335 ms: 4 candidates, 48181 repo-hours, 20 releases; waiting 526 ms; commit 994 ms)
2026-11-07T04:57:01Z [load_day 2026-07-25] 2026-07-25 hour 21: 174171 events in 4 files, snapshot 7796698444565121337 (task 3785 ms: download 1224 ms overlapping gunzip 204 ms, parse 783 ms, sort 110 ms, write 1582 ms, index 322 ms: 3 candidates, 47929 repo-hours, 22 releases; waiting 526 ms; commit 925 ms)
2026-11-07T04:57:04Z [load_day 2026-07-25] 2026-07-25 hour 22: 172972 events in 4 files, snapshot 1878692197314549844 (task 3711 ms: download 1133 ms overlapping gunzip 219 ms, parse 792 ms, sort 112 ms, write 1627 ms, index 308 ms: 1 candidates, 47238 repo-hours, 25 releases; waiting 294 ms; commit 798 ms)
2026-11-07T04:57:05Z [load_day 2026-07-25] 2026-07-25 hour 23: 163371 events in 4 files, snapshot 5836715436450553442 (task 3272 ms: download 786 ms overlapping gunzip 201 ms, parse 762 ms, sort 98 ms, write 1390 ms, index 306 ms: 0 candidates, 43581 repo-hours, 24 releases; waiting 199 ms; commit 774 ms)
2026-11-07T04:57:09Z [load_day 2026-07-25] 2026-07-25: repo_hour merged from 24 files to 1 (919054 rows, 4231 ms)
2026-11-07T04:57:11Z [load_day 2026-07-25] 2026-07-25: index committed in 6211 ms (23 + 1 + 24 files)
2026-11-07T04:57:11Z [load_day 2026-07-25] 2026-07-25: 4063884 events in 24 hours
2026-11-07T04:57:11Z [load_day 2026-07-25] attempt 1 succeeded