orcaLog in

Runs · run 464

load_day 2026-06-16, attempt 1 succeeded

Host
4e84322b8c45:98334
Started
2026-11-07T05:46:49Z
Ended
2026-11-07T05:47:59Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/464/load_day/2026-06-16/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:46:49Z [load_day 2026-06-16] attempt 1 started
2026-11-07T05:46:57Z [load_day 2026-06-16] 2026-06-16 hour 0: 154945 events in 4 files, snapshot 361130606693135453 (task 4699 ms: download 1673 ms overlapping gunzip 260 ms, parse 896 ms, sort 113 ms, write 2075 ms, index 480 ms: 7 candidates, 70956 repo-hours, 233 releases; waiting 529 ms; commit 969 ms)
2026-11-07T05:46:58Z [load_day 2026-06-16] 2026-06-16 hour 1: 158166 events in 4 files, snapshot 1355834295944102760 (task 4655 ms: download 1285 ms overlapping gunzip 273 ms, parse 977 ms, sort 131 ms, write 2322 ms, index 494 ms: 8 candidates, 72206 repo-hours, 320 releases; waiting 171 ms; commit 997 ms)
2026-11-07T05:47:02Z [load_day 2026-06-16] 2026-06-16 hour 2: 163347 events in 4 files, snapshot 3114823954081256186 (task 4466 ms: download 1548 ms overlapping gunzip 253 ms, parse 885 ms, sort 113 ms, write 1852 ms, index 521 ms: 10 candidates, 80551 repo-hours, 181 releases; waiting 529 ms; commit 941 ms)
2026-11-07T05:47:03Z [load_day 2026-06-16] 2026-06-16 hour 3: 161706 events in 4 files, snapshot 2800283731563461856 (task 4264 ms: download 1439 ms overlapping gunzip 234 ms, parse 823 ms, sort 103 ms, write 1913 ms, index 514 ms: 7 candidates, 79702 repo-hours, 149 releases; waiting 382 ms; commit 924 ms)
2026-11-07T05:47:07Z [load_day 2026-06-16] 2026-06-16 hour 4: 161163 events in 4 files, snapshot 8558253679366989256 (task 4157 ms: download 1651 ms overlapping gunzip 219 ms, parse 802 ms, sort 108 ms, write 1614 ms, index 542 ms: 5 candidates, 80660 repo-hours, 99 releases; waiting 522 ms; commit 1158 ms)
2026-11-07T05:47:08Z [load_day 2026-06-16] 2026-06-16 hour 5: 158590 events in 4 files, snapshot 843867735397948731 (task 3999 ms: download 1552 ms overlapping gunzip 224 ms, parse 828 ms, sort 103 ms, write 1458 ms, index 523 ms: 11 candidates, 76579 repo-hours, 88 releases; waiting 541 ms; commit 1121 ms)
2026-11-07T05:47:11Z [load_day 2026-06-16] 2026-06-16 hour 6: 160620 events in 4 files, snapshot 4307850169022629661 (task 3909 ms: download 1299 ms overlapping gunzip 214 ms, parse 778 ms, sort 104 ms, write 1452 ms, index 538 ms: 9 candidates, 77348 repo-hours, 57 releases; waiting 220 ms; commit 1044 ms)
2026-11-07T05:47:13Z [load_day 2026-06-16] 2026-06-16 hour 7: 165145 events in 4 files, snapshot 9023190170144975594 (task 3975 ms: download 1385 ms overlapping gunzip 209 ms, parse 778 ms, sort 102 ms, write 1557 ms, index 514 ms: 6 candidates, 80118 repo-hours, 40 releases; waiting 517 ms; commit 1004 ms)
2026-11-07T05:47:16Z [load_day 2026-06-16] 2026-06-16 hour 8: 161421 events in 4 files, snapshot 1529969809928960067 (task 4044 ms: download 1535 ms overlapping gunzip 210 ms, parse 772 ms, sort 103 ms, write 1568 ms, index 547 ms: 6 candidates, 78159 repo-hours, 36 releases; waiting 547 ms; commit 1047 ms)
2026-11-07T05:47:17Z [load_day 2026-06-16] 2026-06-16 hour 9: 160919 events in 4 files, snapshot 553893639325616950 (task 3980 ms: download 1502 ms overlapping gunzip 214 ms, parse 781 ms, sort 107 ms, write 1543 ms, index 534 ms: 8 candidates, 76894 repo-hours, 34 releases; waiting 515 ms; commit 952 ms)
2026-11-07T05:47:20Z [load_day 2026-06-16] 2026-06-16 hour 10: 156750 events in 4 files, snapshot 8708515361366842984 (task 3381 ms: download 730 ms overlapping gunzip 191 ms, parse 694 ms, sort 102 ms, write 1449 ms, index 528 ms: 7 candidates, 78963 repo-hours, 43 releases; waiting 187 ms; commit 960 ms)
2026-11-07T05:47:22Z [load_day 2026-06-16] 2026-06-16 hour 11: 158100 events in 4 files, snapshot 4281554736410302639 (task 3847 ms: download 1117 ms overlapping gunzip 203 ms, parse 749 ms, sort 99 ms, write 1424 ms, index 531 ms: 5 candidates, 80580 repo-hours, 43 releases; waiting 224 ms; commit 1012 ms)
2026-11-07T05:47:25Z [load_day 2026-06-16] 2026-06-16 hour 12: 162233 events in 4 files, snapshot 7704784904127102240 (task 4048 ms: download 1743 ms overlapping gunzip 207 ms, parse 775 ms, sort 101 ms, write 1607 ms, index 527 ms: 11 candidates, 78265 repo-hours, 32 releases; waiting 521 ms; commit 1152 ms)
2026-11-07T05:47:27Z [load_day 2026-06-16] 2026-06-16 hour 13: 158143 events in 4 files, snapshot 5024549962112956560 (task 3795 ms: download 1614 ms overlapping gunzip 200 ms, parse 744 ms, sort 103 ms, write 1374 ms, index 531 ms: 10 candidates, 76791 repo-hours, 9 releases; waiting 521 ms; commit 1000 ms)
2026-11-07T05:47:29Z [load_day 2026-06-16] 2026-06-16 hour 14: 156508 events in 4 files, snapshot 2967181986051656721 (task 3947 ms: download 1558 ms overlapping gunzip 203 ms, parse 727 ms, sort 96 ms, write 1457 ms, index 601 ms: 12 candidates, 78599 repo-hours, 37 releases; waiting 536 ms; commit 1221 ms)
2026-11-07T05:47:31Z [load_day 2026-06-16] 2026-06-16 hour 15: 156938 events in 4 files, snapshot 8736789567866172229 (task 3978 ms: download 1265 ms overlapping gunzip 197 ms, parse 718 ms, sort 106 ms, write 1407 ms, index 714 ms: 10 candidates, 77961 repo-hours, 49 releases; waiting 549 ms; commit 1034 ms)
2026-11-07T05:47:34Z [load_day 2026-06-16] 2026-06-16 hour 16: 160902 events in 4 files, snapshot 8707509840036498931 (task 4097 ms: download 1401 ms overlapping gunzip 197 ms, parse 746 ms, sort 102 ms, write 1529 ms, index 696 ms: 8 candidates, 86230 repo-hours, 24 releases; waiting 531 ms; commit 971 ms)
2026-11-07T05:47:36Z [load_day 2026-06-16] 2026-06-16 hour 17: 159042 events in 4 files, snapshot 3936794752684272693 (task 3756 ms: download 1468 ms overlapping gunzip 192 ms, parse 730 ms, sort 103 ms, write 1364 ms, index 571 ms: 7 candidates, 75874 repo-hours, 27 releases; waiting 529 ms; commit 1134 ms)
2026-11-07T05:47:38Z [load_day 2026-06-16] 2026-06-16 hour 18: 157258 events in 4 files, snapshot 6237937920894807473 (task 3830 ms: download 1350 ms overlapping gunzip 200 ms, parse 745 ms, sort 102 ms, write 1444 ms, index 507 ms: 9 candidates, 73656 repo-hours, 41 releases; waiting 529 ms; commit 1197 ms)
2026-11-07T05:47:40Z [load_day 2026-06-16] 2026-06-16 hour 19: 158973 events in 4 files, snapshot 6727787818511634551 (task 3855 ms: download 1231 ms overlapping gunzip 196 ms, parse 746 ms, sort 96 ms, write 1539 ms, index 571 ms: 12 candidates, 72615 repo-hours, 46 releases; waiting 400 ms; commit 962 ms)
2026-11-07T05:47:42Z [load_day 2026-06-16] 2026-06-16 hour 20: 163201 events in 4 files, snapshot 9209588827684285290 (task 3863 ms: download 1440 ms overlapping gunzip 207 ms, parse 768 ms, sort 102 ms, write 1437 ms, index 497 ms: 8 candidates, 74398 repo-hours, 42 releases; waiting 532 ms; commit 995 ms)
2026-11-07T05:47:45Z [load_day 2026-06-16] 2026-06-16 hour 21: 160592 events in 4 files, snapshot 6597453983834551731 (task 3787 ms: download 1457 ms overlapping gunzip 207 ms, parse 770 ms, sort 108 ms, write 1392 ms, index 524 ms: 6 candidates, 67112 repo-hours, 69 releases; waiting 473 ms; commit 969 ms)
2026-11-07T05:47:47Z [load_day 2026-06-16] 2026-06-16 hour 22: 158424 events in 4 files, snapshot 1038810419665366365 (task 4145 ms: download 1520 ms overlapping gunzip 223 ms, parse 806 ms, sort 119 ms, write 1605 ms, index 557 ms: 7 candidates, 68234 repo-hours, 125 releases; waiting 524 ms; commit 1122 ms)
2026-11-07T05:47:50Z [load_day 2026-06-16] 2026-06-16 hour 23: 159036 events in 4 files, snapshot 6923891485711656675 (task 4288 ms: download 1527 ms overlapping gunzip 244 ms, parse 863 ms, sort 107 ms, write 1753 ms, index 405 ms: 7 candidates, 65401 repo-hours, 283 releases; waiting 557 ms; commit 1015 ms)
2026-11-07T05:47:57Z [load_day 2026-06-16] 2026-06-16: repo_hour merged from 24 files to 1 (1827852 rows, 7423 ms)
2026-11-07T05:47:59Z [load_day 2026-06-16] 2026-06-16: index committed in 9381 ms (24 + 1 + 24 files)
2026-11-07T05:47:59Z [load_day 2026-06-16] 2026-06-16: 3832122 events in 24 hours
2026-11-07T05:47:59Z [load_day 2026-06-16] attempt 1 succeeded