orcaLog in

Runs · run 305

load_day 2026-08-08, attempt 1 succeeded

Host
4e84322b8c45:53561
Started
2026-11-07T04:40:47Z
Ended
2026-11-07T04:41:51Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/305/load_day/2026-08-08/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:40:47Z [load_day 2026-08-08] attempt 1 started
2026-11-07T04:40:53Z [load_day 2026-08-08] 2026-08-08 hour 0: 164724 events in 4 files, snapshot 38110235318103107 (task 3662 ms: download 1151 ms overlapping gunzip 230 ms, parse 835 ms, sort 131 ms, write 1613 ms, index 273 ms: 3 candidates, 41830 repo-hours, 56 releases; waiting 284 ms; commit 913 ms)
2026-11-07T04:40:54Z [load_day 2026-08-08] 2026-08-08 hour 1: 164320 events in 4 files, snapshot 3982569517094731497 (task 4374 ms: download 2445 ms overlapping gunzip 245 ms, parse 935 ms, sort 117 ms, write 1727 ms, index 517 ms: 7 candidates, 70227 repo-hours, 118 releases; waiting 520 ms; commit 1021 ms)
2026-11-07T04:40:58Z [load_day 2026-08-08] 2026-08-08 hour 2: 163640 events in 4 files, snapshot 4225653109066816975 (task 4255 ms: download 1406 ms overlapping gunzip 244 ms, parse 896 ms, sort 121 ms, write 1803 ms, index 311 ms: 7 candidates, 53141 repo-hours, 161 releases; waiting 580 ms; commit 882 ms)
2026-11-07T04:41:00Z [load_day 2026-08-08] 2026-08-08 hour 3: 164153 events in 4 files, snapshot 942864705892300824 (task 4560 ms: download 1710 ms overlapping gunzip 271 ms, parse 938 ms, sort 113 ms, write 1992 ms, index 314 ms: 2 candidates, 47783 repo-hours, 207 releases; waiting 628 ms; commit 949 ms)
2026-11-07T04:41:03Z [load_day 2026-08-08] 2026-08-08 hour 4: 163089 events in 4 files, snapshot 5877455581751849682 (task 4073 ms: download 1393 ms overlapping gunzip 226 ms, parse 829 ms, sort 117 ms, write 1685 ms, index 367 ms: 1 candidates, 56945 repo-hours, 92 releases; waiting 482 ms; commit 1012 ms)
2026-11-07T04:41:04Z [load_day 2026-08-08] 2026-08-08 hour 5: 168854 events in 4 files, snapshot 7731898981670002553 (task 3773 ms: download 1457 ms overlapping gunzip 199 ms, parse 752 ms, sort 100 ms, write 1647 ms, index 259 ms: 1 candidates, 37858 repo-hours, 16 releases; waiting 519 ms; commit 876 ms)
2026-11-07T04:41:08Z [load_day 2026-08-08] 2026-08-08 hour 6: 167428 events in 4 files, snapshot 5580864322559287559 (task 3941 ms: download 1551 ms overlapping gunzip 219 ms, parse 821 ms, sort 105 ms, write 1690 ms, index 284 ms: 5 candidates, 42699 repo-hours, 52 releases; waiting 538 ms; commit 844 ms)
2026-11-07T04:41:08Z [load_day 2026-08-08] 2026-08-08 hour 7: 170337 events in 4 files, snapshot 5833701294642096238 (task 3758 ms: download 1657 ms overlapping gunzip 204 ms, parse 796 ms, sort 110 ms, write 1583 ms, index 231 ms: 1 candidates, 34686 repo-hours, 40 releases; waiting 530 ms; commit 603 ms)
2026-11-07T04:41:12Z [load_day 2026-08-08] 2026-08-08 hour 8: 168977 events in 4 files, snapshot 2604144856845414086 (task 3712 ms: download 1378 ms overlapping gunzip 192 ms, parse 789 ms, sort 107 ms, write 1521 ms, index 236 ms: 2 candidates, 36105 repo-hours, 18 releases; waiting 513 ms; commit 1005 ms)
2026-11-07T04:41:13Z [load_day 2026-08-08] 2026-08-08 hour 9: 172457 events in 4 files, snapshot 1845714086755109777 (task 3745 ms: download 1428 ms overlapping gunzip 196 ms, parse 768 ms, sort 104 ms, write 1566 ms, index 257 ms: 1 candidates, 37793 repo-hours, 22 releases; waiting 550 ms; commit 913 ms)
2026-11-07T04:41:17Z [load_day 2026-08-08] 2026-08-08 hour 10: 167550 events in 4 files, snapshot 1774922956505618983 (task 3722 ms: download 1386 ms overlapping gunzip 196 ms, parse 766 ms, sort 105 ms, write 1510 ms, index 283 ms: 7 candidates, 43085 repo-hours, 27 releases; waiting 526 ms; commit 1042 ms)
2026-11-07T04:41:18Z [load_day 2026-08-08] 2026-08-08 hour 11: 165706 events in 4 files, snapshot 332297168943623298 (task 3788 ms: download 1215 ms overlapping gunzip 198 ms, parse 755 ms, sort 101 ms, write 1456 ms, index 312 ms: 5 candidates, 49828 repo-hours, 15 releases; waiting 586 ms; commit 965 ms)
2026-11-07T04:41:21Z [load_day 2026-08-08] 2026-08-08 hour 12: 169056 events in 4 files, snapshot 3292563192808533974 (task 4149 ms: download 1660 ms overlapping gunzip 199 ms, parse 790 ms, sort 101 ms, write 1582 ms, index 333 ms: 4 candidates, 52734 repo-hours, 21 releases; waiting 802 ms; commit 678 ms)
2026-11-07T04:41:22Z [load_day 2026-08-08] 2026-08-08 hour 13: 165163 events in 4 files, snapshot 6264161991787296814 (task 3938 ms: download 1540 ms overlapping gunzip 201 ms, parse 767 ms, sort 112 ms, write 1558 ms, index 265 ms: 2 candidates, 36514 repo-hours, 25 releases; waiting 537 ms; commit 765 ms)
2026-11-07T04:41:26Z [load_day 2026-08-08] 2026-08-08 hour 14: 170437 events in 4 files, snapshot 9096866725813265115 (task 4042 ms: download 1791 ms overlapping gunzip 209 ms, parse 796 ms, sort 113 ms, write 1785 ms, index 309 ms: 3 candidates, 42539 repo-hours, 33 releases; waiting 537 ms; commit 1003 ms)
2026-11-07T04:41:27Z [load_day 2026-08-08] 2026-08-08 hour 15: 168489 events in 4 files, snapshot 7492650285294919375 (task 3839 ms: download 1193 ms overlapping gunzip 196 ms, parse 770 ms, sort 106 ms, write 1679 ms, index 267 ms: 1 candidates, 40903 repo-hours, 10 releases; waiting 526 ms; commit 847 ms)
2026-11-07T04:41:30Z [load_day 2026-08-08] 2026-08-08 hour 16: 168578 events in 4 files, snapshot 898055287381817144 (task 3755 ms: download 1309 ms overlapping gunzip 201 ms, parse 772 ms, sort 104 ms, write 1582 ms, index 303 ms: 6 candidates, 47622 repo-hours, 12 releases; waiting 523 ms; commit 906 ms)
2026-11-07T04:41:31Z [load_day 2026-08-08] 2026-08-08 hour 17: 170186 events in 4 files, snapshot 2849294098251877500 (task 3819 ms: download 1498 ms overlapping gunzip 203 ms, parse 777 ms, sort 108 ms, write 1521 ms, index 344 ms: 3 candidates, 48972 repo-hours, 18 releases; waiting 531 ms; commit 938 ms)
2026-11-07T04:41:35Z [load_day 2026-08-08] 2026-08-08 hour 18: 167216 events in 4 files, snapshot 51008826562131421 (task 3911 ms: download 1610 ms overlapping gunzip 227 ms, parse 850 ms, sort 116 ms, write 1572 ms, index 327 ms: 4 candidates, 51589 repo-hours, 12 releases; waiting 515 ms; commit 940 ms)
2026-11-07T04:41:36Z [load_day 2026-08-08] 2026-08-08 hour 19: 167177 events in 4 files, snapshot 8589685703364709581 (task 3677 ms: download 1617 ms overlapping gunzip 196 ms, parse 748 ms, sort 102 ms, write 1456 ms, index 311 ms: 2 candidates, 48330 repo-hours, 12 releases; waiting 532 ms; commit 745 ms)
2026-11-07T04:41:39Z [load_day 2026-08-08] 2026-08-08 hour 20: 168173 events in 4 files, snapshot 6418838417358748993 (task 3796 ms: download 1254 ms overlapping gunzip 200 ms, parse 777 ms, sort 108 ms, write 1526 ms, index 342 ms: 4 candidates, 50901 repo-hours, 16 releases; waiting 531 ms; commit 957 ms)
2026-11-07T04:41:40Z [load_day 2026-08-08] 2026-08-08 hour 21: 161577 events in 4 files, snapshot 1758074481871962902 (task 3667 ms: download 1266 ms overlapping gunzip 197 ms, parse 746 ms, sort 105 ms, write 1393 ms, index 356 ms: 4 candidates, 52370 repo-hours, 16 releases; waiting 511 ms; commit 890 ms)
2026-11-07T04:41:43Z [load_day 2026-08-08] 2026-08-08 hour 22: 170661 events in 4 files, snapshot 7297877657643899053 (task 3805 ms: download 1318 ms overlapping gunzip 199 ms, parse 786 ms, sort 106 ms, write 1549 ms, index 336 ms: 2 candidates, 51774 repo-hours, 23 releases; waiting 512 ms; commit 929 ms)
2026-11-07T04:41:44Z [load_day 2026-08-08] 2026-08-08 hour 23: 164674 events in 4 files, snapshot 2456290988967012251 (task 3720 ms: download 1792 ms overlapping gunzip 200 ms, parse 761 ms, sort 105 ms, write 1478 ms, index 314 ms: 4 candidates, 51500 repo-hours, 27 releases; waiting 519 ms; commit 847 ms)
2026-11-07T04:41:49Z [load_day 2026-08-08] 2026-08-08: repo_hour merged from 24 files to 1 (1127728 rows, 4953 ms)
2026-11-07T04:41:51Z [load_day 2026-08-08] 2026-08-08: index committed in 6643 ms (24 + 1 + 24 files)
2026-11-07T04:41:51Z [load_day 2026-08-08] 2026-08-08: 4012622 events in 24 hours
2026-11-07T04:41:51Z [load_day 2026-08-08] attempt 1 succeeded