orcaLog in

Runs · run 290

load_day 2026-08-13, attempt 1 succeeded

Host
4e84322b8c45:49417
Started
2026-11-07T04:35:14Z
Ended
2026-11-07T04:36:19Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/290/load_day/2026-08-13/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:35:14Z [load_day 2026-08-13] attempt 1 started
2026-11-07T04:35:21Z [load_day 2026-08-13] 2026-08-13 hour 0: 164364 events in 4 files, snapshot 5716335161048242695 (task 4088 ms: download 1465 ms overlapping gunzip 218 ms, parse 878 ms, sort 164 ms, write 1558 ms, index 394 ms: 5 candidates, 60869 repo-hours, 24 releases; waiting 520 ms; commit 941 ms)
2026-11-07T04:35:22Z [load_day 2026-08-13] 2026-08-13 hour 1: 163994 events in 4 files, snapshot 1565735114967643618 (task 4109 ms: download 1292 ms overlapping gunzip 202 ms, parse 797 ms, sort 121 ms, write 1664 ms, index 499 ms: 5 candidates, 77971 repo-hours, 23 releases; waiting 513 ms; commit 978 ms)
2026-11-07T04:35:26Z [load_day 2026-08-13] 2026-08-13 hour 2: 168340 events in 4 files, snapshot 329862603193616512 (task 4200 ms: download 1606 ms overlapping gunzip 221 ms, parse 823 ms, sort 110 ms, write 1676 ms, index 507 ms: 4 candidates, 77513 repo-hours, 37 releases; waiting 548 ms; commit 970 ms)
2026-11-07T04:35:27Z [load_day 2026-08-13] 2026-08-13 hour 3: 167617 events in 4 files, snapshot 8780384179431821746 (task 3949 ms: download 1282 ms overlapping gunzip 211 ms, parse 803 ms, sort 117 ms, write 1503 ms, index 506 ms: 1 candidates, 69755 repo-hours, 32 releases; waiting 510 ms; commit 784 ms)
2026-11-07T04:35:31Z [load_day 2026-08-13] 2026-08-13 hour 4: 163664 events in 4 files, snapshot 118039732961971515 (task 4059 ms: download 1430 ms overlapping gunzip 213 ms, parse 790 ms, sort 109 ms, write 1646 ms, index 417 ms: 1 candidates, 62285 repo-hours, 41 releases; waiting 527 ms; commit 853 ms)
2026-11-07T04:35:31Z [load_day 2026-08-13] 2026-08-13 hour 5: 164170 events in 4 files, snapshot 6118417496412198818 (task 3725 ms: download 1566 ms overlapping gunzip 201 ms, parse 793 ms, sort 105 ms, write 1520 ms, index 295 ms: 2 candidates, 40204 repo-hours, 23 releases; waiting 523 ms; commit 723 ms)
2026-11-07T04:35:35Z [load_day 2026-08-13] 2026-08-13 hour 6: 163286 events in 4 files, snapshot 7594279622809711532 (task 3871 ms: download 1703 ms overlapping gunzip 201 ms, parse 765 ms, sort 100 ms, write 1557 ms, index 272 ms: 2 candidates, 38468 repo-hours, 19 releases; waiting 559 ms; commit 821 ms)
2026-11-07T04:35:36Z [load_day 2026-08-13] 2026-08-13 hour 7: 161886 events in 4 files, snapshot 1477890858186944928 (task 3720 ms: download 1936 ms overlapping gunzip 189 ms, parse 721 ms, sort 107 ms, write 1579 ms, index 260 ms: 1 candidates, 38800 repo-hours, 7 releases; waiting 528 ms; commit 913 ms)
2026-11-07T04:35:40Z [load_day 2026-08-13] 2026-08-13 hour 8: 164784 events in 4 files, snapshot 8102768886486008265 (task 3881 ms: download 1225 ms overlapping gunzip 203 ms, parse 783 ms, sort 113 ms, write 1660 ms, index 302 ms: 3 candidates, 39140 repo-hours, 10 releases; waiting 536 ms; commit 913 ms)
2026-11-07T04:35:40Z [load_day 2026-08-13] 2026-08-13 hour 9: 159983 events in 4 files, snapshot 4719758774934776506 (task 3717 ms: download 1197 ms overlapping gunzip 186 ms, parse 727 ms, sort 104 ms, write 1650 ms, index 258 ms: 4 candidates, 38350 repo-hours, 13 releases; waiting 530 ms; commit 851 ms)
2026-11-07T04:35:44Z [load_day 2026-08-13] 2026-08-13 hour 10: 163065 events in 4 files, snapshot 8602669614592834734 (task 3899 ms: download 1326 ms overlapping gunzip 194 ms, parse 734 ms, sort 100 ms, write 1609 ms, index 272 ms: 5 candidates, 37478 repo-hours, 26 releases; waiting 527 ms; commit 1037 ms)
2026-11-07T04:35:45Z [load_day 2026-08-13] 2026-08-13 hour 11: 163786 events in 4 files, snapshot 1579833114089944464 (task 3522 ms: download 1424 ms overlapping gunzip 197 ms, parse 761 ms, sort 113 ms, write 1419 ms, index 272 ms: 4 candidates, 40547 repo-hours, 10 releases; waiting 525 ms; commit 1023 ms)
2026-11-07T04:35:48Z [load_day 2026-08-13] 2026-08-13 hour 12: 164570 events in 4 files, snapshot 6678361533076626943 (task 3728 ms: download 1182 ms overlapping gunzip 192 ms, parse 770 ms, sort 105 ms, write 1508 ms, index 347 ms: 6 candidates, 44300 repo-hours, 13 releases; waiting 523 ms; commit 949 ms)
2026-11-07T04:35:49Z [load_day 2026-08-13] 2026-08-13 hour 13: 162696 events in 4 files, snapshot 4666166292973767131 (task 3622 ms: download 1301 ms overlapping gunzip 194 ms, parse 726 ms, sort 104 ms, write 1483 ms, index 314 ms: 4 candidates, 48529 repo-hours, 8 releases; waiting 531 ms; commit 934 ms)
2026-11-07T04:35:53Z [load_day 2026-08-13] 2026-08-13 hour 14: 161148 events in 4 files, snapshot 7535024145612138497 (task 3685 ms: download 1506 ms overlapping gunzip 191 ms, parse 733 ms, sort 105 ms, write 1462 ms, index 340 ms: 2 candidates, 48753 repo-hours, 13 releases; waiting 538 ms; commit 895 ms)
2026-11-07T04:35:54Z [load_day 2026-08-13] 2026-08-13 hour 15: 162781 events in 4 files, snapshot 2127254486768783219 (task 3668 ms: download 1271 ms overlapping gunzip 207 ms, parse 771 ms, sort 103 ms, write 1441 ms, index 310 ms: 3 candidates, 44628 repo-hours, 16 releases; waiting 506 ms; commit 845 ms)
2026-11-07T04:35:57Z [load_day 2026-08-13] 2026-08-13 hour 16: 159464 events in 4 files, snapshot 4871447522427511705 (task 3847 ms: download 1313 ms overlapping gunzip 227 ms, parse 891 ms, sort 136 ms, write 1468 ms, index 326 ms: 6 candidates, 51704 repo-hours, 17 releases; waiting 513 ms; commit 908 ms)
2026-11-07T04:35:58Z [load_day 2026-08-13] 2026-08-13 hour 17: 157155 events in 4 files, snapshot 92130519232008331 (task 3798 ms: download 1430 ms overlapping gunzip 237 ms, parse 827 ms, sort 116 ms, write 1474 ms, index 340 ms: 6 candidates, 52644 repo-hours, 98 releases; waiting 518 ms; commit 920 ms)
2026-11-07T04:36:02Z [load_day 2026-08-13] 2026-08-13 hour 18: 161260 events in 4 files, snapshot 136117039295395242 (task 3855 ms: download 1415 ms overlapping gunzip 210 ms, parse 764 ms, sort 108 ms, write 1531 ms, index 411 ms: 4 candidates, 63204 repo-hours, 33 releases; waiting 528 ms; commit 1058 ms)
2026-11-07T04:36:03Z [load_day 2026-08-13] 2026-08-13 hour 19: 159855 events in 4 files, snapshot 6194998295281015150 (task 4009 ms: download 1435 ms overlapping gunzip 227 ms, parse 811 ms, sort 112 ms, write 1493 ms, index 540 ms: 8 candidates, 66989 repo-hours, 29 releases; waiting 514 ms; commit 883 ms)
2026-11-07T04:36:06Z [load_day 2026-08-13] 2026-08-13 hour 20: 158346 events in 4 files, snapshot 2887194843341480318 (task 3459 ms: download 1078 ms overlapping gunzip 205 ms, parse 720 ms, sort 105 ms, write 1506 ms, index 441 ms: 9 candidates, 65870 repo-hours, 25 releases; waiting 211 ms; commit 895 ms)
2026-11-07T04:36:08Z [load_day 2026-08-13] 2026-08-13 hour 21: 157748 events in 4 files, snapshot 6722994260557721468 (task 3921 ms: download 1261 ms overlapping gunzip 200 ms, parse 735 ms, sort 108 ms, write 1612 ms, index 453 ms: 15 candidates, 64250 repo-hours, 27 releases; waiting 520 ms; commit 1017 ms)
2026-11-07T04:36:10Z [load_day 2026-08-13] 2026-08-13 hour 22: 161160 events in 4 files, snapshot 3222980618170168793 (task 3804 ms: download 1543 ms overlapping gunzip 201 ms, parse 766 ms, sort 104 ms, write 1496 ms, index 412 ms: 7 candidates, 62579 repo-hours, 26 releases; waiting 537 ms; commit 740 ms)
2026-11-07T04:36:12Z [load_day 2026-08-13] 2026-08-13 hour 23: 159612 events in 4 files, snapshot 406955232360177906 (task 3731 ms: download 1641 ms overlapping gunzip 196 ms, parse 752 ms, sort 108 ms, write 1418 ms, index 382 ms: 7 candidates, 61176 repo-hours, 31 releases; waiting 532 ms; commit 771 ms)
2026-11-07T04:36:17Z [load_day 2026-08-13] 2026-08-13: repo_hour merged from 24 files to 1 (1296006 rows, 5676 ms)
2026-11-07T04:36:19Z [load_day 2026-08-13] 2026-08-13: index committed in 7557 ms (24 + 1 + 24 files)
2026-11-07T04:36:19Z [load_day 2026-08-13] 2026-08-13: 3894734 events in 24 hours
2026-11-07T04:36:19Z [load_day 2026-08-13] attempt 1 succeeded