orcaLog in

Runs · run 362

load_day 2026-07-20, attempt 1 succeeded

Host
4e84322b8c45:69000
Started
2026-11-07T05:01:33Z
Ended
2026-11-07T05:02:39Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/362/load_day/2026-07-20/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:01:33Z [load_day 2026-07-20] attempt 1 started
2026-11-07T05:01:40Z [load_day 2026-07-20] 2026-07-20 hour 0: 171499 events in 4 files, snapshot 5035910645042174088 (task 3860 ms: download 1377 ms overlapping gunzip 210 ms, parse 844 ms, sort 124 ms, write 1562 ms, index 323 ms: 2 candidates, 44170 repo-hours, 9 releases; waiting 507 ms; commit 1044 ms)
2026-11-07T05:01:41Z [load_day 2026-07-20] 2026-07-20 hour 1: 168169 events in 4 files, snapshot 6702956032645086356 (task 3923 ms: download 1451 ms overlapping gunzip 194 ms, parse 776 ms, sort 111 ms, write 1660 ms, index 323 ms: 4 candidates, 49943 repo-hours, 12 releases; waiting 516 ms; commit 986 ms)
2026-11-07T05:01:45Z [load_day 2026-07-20] 2026-07-20 hour 2: 168452 events in 4 files, snapshot 8792680982030712182 (task 3964 ms: download 1511 ms overlapping gunzip 196 ms, parse 782 ms, sort 119 ms, write 1669 ms, index 370 ms: 3 candidates, 50263 repo-hours, 14 releases; waiting 530 ms; commit 861 ms)
2026-11-07T05:01:46Z [load_day 2026-07-20] 2026-07-20 hour 3: 172477 events in 4 files, snapshot 611463498494271375 (task 4013 ms: download 1403 ms overlapping gunzip 203 ms, parse 771 ms, sort 129 ms, write 1705 ms, index 354 ms: 3 candidates, 46650 repo-hours, 11 releases; waiting 539 ms; commit 967 ms)
2026-11-07T05:01:49Z [load_day 2026-07-20] 2026-07-20 hour 4: 167891 events in 4 files, snapshot 1464588248428988166 (task 3794 ms: download 1723 ms overlapping gunzip 196 ms, parse 748 ms, sort 104 ms, write 1625 ms, index 234 ms: 0 candidates, 35431 repo-hours, 11 releases; waiting 528 ms; commit 990 ms)
2026-11-07T05:01:50Z [load_day 2026-07-20] 2026-07-20 hour 5: 168873 events in 4 files, snapshot 4876243179974153436 (task 3651 ms: download 1604 ms overlapping gunzip 204 ms, parse 774 ms, sort 104 ms, write 1440 ms, index 283 ms: 2 candidates, 36132 repo-hours, 14 releases; waiting 527 ms; commit 873 ms)
2026-11-07T05:01:53Z [load_day 2026-07-20] 2026-07-20 hour 6: 167080 events in 4 files, snapshot 8956083014307022020 (task 3276 ms: download 873 ms overlapping gunzip 186 ms, parse 735 ms, sort 103 ms, write 1471 ms, index 246 ms: 1 candidates, 33995 repo-hours, 7 releases; waiting 283 ms; commit 832 ms)
2026-11-07T05:01:54Z [load_day 2026-07-20] 2026-07-20 hour 7: 163688 events in 4 files, snapshot 1250499144238228474 (task 3493 ms: download 1240 ms overlapping gunzip 189 ms, parse 728 ms, sort 99 ms, write 1454 ms, index 226 ms: 7 candidates, 30950 repo-hours, 6 releases; waiting 511 ms; commit 917 ms)
2026-11-07T05:01:58Z [load_day 2026-07-20] 2026-07-20 hour 8: 170481 events in 4 files, snapshot 554397018233749188 (task 3839 ms: download 1197 ms overlapping gunzip 204 ms, parse 867 ms, sort 115 ms, write 1565 ms, index 249 ms: 3 candidates, 33307 repo-hours, 9 releases; waiting 518 ms; commit 948 ms)
2026-11-07T05:01:59Z [load_day 2026-07-20] 2026-07-20 hour 9: 161384 events in 4 files, snapshot 4937951892775065264 (task 3295 ms: download 1016 ms overlapping gunzip 187 ms, parse 716 ms, sort 98 ms, write 1434 ms, index 224 ms: 2 candidates, 32781 repo-hours, 11 releases; waiting 351 ms; commit 1024 ms)
2026-11-07T05:02:02Z [load_day 2026-07-20] 2026-07-20 hour 10: 168385 events in 4 files, snapshot 4928619715420779196 (task 3858 ms: download 1367 ms overlapping gunzip 206 ms, parse 783 ms, sort 107 ms, write 1612 ms, index 271 ms: 2 candidates, 38699 repo-hours, 12 releases; waiting 535 ms; commit 1035 ms)
2026-11-07T05:02:03Z [load_day 2026-07-20] 2026-07-20 hour 11: 161577 events in 4 files, snapshot 2100927445762649074 (task 3708 ms: download 1333 ms overlapping gunzip 184 ms, parse 739 ms, sort 108 ms, write 1549 ms, index 282 ms: 1 candidates, 36059 repo-hours, 9 releases; waiting 529 ms; commit 871 ms)
2026-11-07T05:02:06Z [load_day 2026-07-20] 2026-07-20 hour 12: 162180 events in 4 files, snapshot 5735870640503935614 (task 3702 ms: download 1400 ms overlapping gunzip 192 ms, parse 747 ms, sort 99 ms, write 1510 ms, index 236 ms: 3 candidates, 34936 repo-hours, 11 releases; waiting 598 ms; commit 1000 ms)
2026-11-07T05:02:07Z [load_day 2026-07-20] 2026-07-20 hour 13: 159481 events in 4 files, snapshot 4162554673135318884 (task 3580 ms: download 1336 ms overlapping gunzip 188 ms, parse 717 ms, sort 99 ms, write 1424 ms, index 318 ms: 3 candidates, 40752 repo-hours, 12 releases; waiting 513 ms; commit 1033 ms)
2026-11-07T05:02:11Z [load_day 2026-07-20] 2026-07-20 hour 14: 161288 events in 4 files, snapshot 1735098263172819908 (task 3764 ms: download 1635 ms overlapping gunzip 205 ms, parse 780 ms, sort 117 ms, write 1511 ms, index 328 ms: 1 candidates, 45991 repo-hours, 7 releases; waiting 517 ms; commit 924 ms)
2026-11-07T05:02:15Z [load_day 2026-07-20] 2026-07-20 hour 15: 155483 events in 4 files, snapshot 5920580331831096331 (task 3552 ms: download 1931 ms overlapping gunzip 187 ms, parse 727 ms, sort 102 ms, write 1323 ms, index 303 ms: 2 candidates, 45318 repo-hours, 17 releases; waiting 543 ms; commit 3812 ms)
2026-11-07T05:02:15Z [load_day 2026-07-20] 2026-07-20 hour 16: 157978 events in 4 files, snapshot 3607985618854668858 (task 3513 ms: download 1355 ms overlapping gunzip 193 ms, parse 734 ms, sort 99 ms, write 1373 ms, index 313 ms: 3 candidates, 45205 repo-hours, 14 releases; waiting 520 ms; commit 959 ms)
2026-11-07T05:02:19Z [load_day 2026-07-20] 2026-07-20 hour 17: 165572 events in 4 files, snapshot 3538275961000379302 (task 3960 ms: download 1241 ms overlapping gunzip 205 ms, parse 820 ms, sort 120 ms, write 1674 ms, index 382 ms: 2 candidates, 50376 repo-hours, 11 releases; waiting 507 ms; commit 853 ms)
2026-11-07T05:02:20Z [load_day 2026-07-20] 2026-07-20 hour 18: 163172 events in 4 files, snapshot 8859069565358479795 (task 3860 ms: download 1451 ms overlapping gunzip 204 ms, parse 766 ms, sort 113 ms, write 1554 ms, index 366 ms: 6 candidates, 51438 repo-hours, 12 releases; waiting 541 ms; commit 897 ms)
2026-11-07T05:02:24Z [load_day 2026-07-20] 2026-07-20 hour 19: 169973 events in 4 files, snapshot 7856640342061311969 (task 4228 ms: download 1993 ms overlapping gunzip 214 ms, parse 819 ms, sort 119 ms, write 1835 ms, index 410 ms: 5 candidates, 57097 repo-hours, 12 releases; waiting 522 ms; commit 1018 ms)
2026-11-07T05:02:25Z [load_day 2026-07-20] 2026-07-20 hour 20: 163967 events in 4 files, snapshot 380587335937299184 (task 3930 ms: download 1376 ms overlapping gunzip 201 ms, parse 755 ms, sort 108 ms, write 1638 ms, index 360 ms: 4 candidates, 53827 repo-hours, 6 releases; waiting 544 ms; commit 831 ms)
2026-11-07T05:02:29Z [load_day 2026-07-20] 2026-07-20 hour 21: 168865 events in 4 files, snapshot 8322726848387146929 (task 3787 ms: download 1371 ms overlapping gunzip 210 ms, parse 795 ms, sort 105 ms, write 1515 ms, index 346 ms: 5 candidates, 53952 repo-hours, 18 releases; waiting 517 ms; commit 1014 ms)
2026-11-07T05:02:30Z [load_day 2026-07-20] 2026-07-20 hour 22: 164273 events in 4 files, snapshot 897228305798623520 (task 4073 ms: download 1504 ms overlapping gunzip 208 ms, parse 788 ms, sort 109 ms, write 1532 ms, index 329 ms: 5 candidates, 51199 repo-hours, 18 releases; waiting 524 ms; commit 985 ms)
2026-11-07T05:02:33Z [load_day 2026-07-20] 2026-07-20 hour 23: 166760 events in 4 files, snapshot 7403244341978613055 (task 3870 ms: download 1394 ms overlapping gunzip 206 ms, parse 763 ms, sort 103 ms, write 1476 ms, index 443 ms: 8 candidates, 52809 repo-hours, 10 releases; waiting 536 ms; commit 834 ms)
2026-11-07T05:02:38Z [load_day 2026-07-20] 2026-07-20: repo_hour merged from 24 files to 1 (1051280 rows, 4982 ms)
2026-11-07T05:02:39Z [load_day 2026-07-20] 2026-07-20: index committed in 6710 ms (23 + 1 + 24 files)
2026-11-07T05:02:39Z [load_day 2026-07-20] 2026-07-20: 3968948 events in 24 hours
2026-11-07T05:02:39Z [load_day 2026-07-20] attempt 1 succeeded