orcaLog in

Runs · run 284

load_day 2026-08-15, attempt 1 succeeded

Host
4e84322b8c45:47705
Started
2026-11-07T04:33:07Z
Ended
2026-11-07T04:34:09Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/284/load_day/2026-08-15/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:33:07Z [load_day 2026-08-15] attempt 1 started
2026-11-07T04:33:15Z [load_day 2026-08-15] 2026-08-15 hour 0: 167974 events in 4 files, snapshot 1338881068886663057 (task 3821 ms: download 1746 ms overlapping gunzip 208 ms, parse 840 ms, sort 115 ms, write 1588 ms, index 229 ms: 2 candidates, 34582 repo-hours, 12 releases; waiting 517 ms; commit 869 ms)
2026-11-07T04:33:15Z [load_day 2026-08-15] 2026-08-15 hour 1: 163187 events in 4 files, snapshot 6304691166783120347 (task 3784 ms: download 1092 ms overlapping gunzip 186 ms, parse 754 ms, sort 119 ms, write 1646 ms, index 249 ms: 2 candidates, 37899 repo-hours, 17 releases; waiting 502 ms; commit 846 ms)
2026-11-07T04:33:19Z [load_day 2026-08-15] 2026-08-15 hour 2: 164790 events in 4 files, snapshot 7631723113591029704 (task 3606 ms: download 1416 ms overlapping gunzip 190 ms, parse 733 ms, sort 106 ms, write 1507 ms, index 256 ms: 1 candidates, 36761 repo-hours, 10 releases; waiting 529 ms; commit 875 ms)
2026-11-07T04:33:20Z [load_day 2026-08-15] 2026-08-15 hour 3: 167090 events in 4 files, snapshot 2011461503648362754 (task 3498 ms: download 1253 ms overlapping gunzip 188 ms, parse 735 ms, sort 101 ms, write 1499 ms, index 201 ms: 1 candidates, 29736 repo-hours, 13 releases; waiting 491 ms; commit 885 ms)
2026-11-07T04:33:24Z [load_day 2026-08-15] 2026-08-15 hour 4: 168677 events in 4 files, snapshot 7210838119909525397 (task 3930 ms: download 1372 ms overlapping gunzip 213 ms, parse 841 ms, sort 131 ms, write 1647 ms, index 239 ms: 1 candidates, 35196 repo-hours, 15 releases; waiting 539 ms; commit 974 ms)
2026-11-07T04:33:24Z [load_day 2026-08-15] 2026-08-15 hour 5: 169982 events in 4 files, snapshot 5170549642648073504 (task 3672 ms: download 1278 ms overlapping gunzip 194 ms, parse 760 ms, sort 100 ms, write 1570 ms, index 241 ms: 1 candidates, 36462 repo-hours, 17 releases; waiting 501 ms; commit 901 ms)
2026-11-07T04:33:27Z [load_day 2026-08-15] 2026-08-15 hour 6: 169192 events in 4 files, snapshot 6892494344685922810 (task 3685 ms: download 1726 ms overlapping gunzip 210 ms, parse 796 ms, sort 113 ms, write 1532 ms, index 214 ms: 1 candidates, 32618 repo-hours, 15 releases; waiting 517 ms; commit 723 ms)
2026-11-07T04:33:29Z [load_day 2026-08-15] 2026-08-15 hour 7: 167295 events in 4 files, snapshot 160053598955657913 (task 3456 ms: download 1489 ms overlapping gunzip 193 ms, parse 782 ms, sort 101 ms, write 1413 ms, index 167 ms: 2 candidates, 24353 repo-hours, 6 releases; waiting 490 ms; commit 895 ms)
2026-11-07T04:33:32Z [load_day 2026-08-15] 2026-08-15 hour 8: 170188 events in 4 files, snapshot 5522716818813807332 (task 3823 ms: download 1205 ms overlapping gunzip 196 ms, parse 761 ms, sort 102 ms, write 1538 ms, index 179 ms: 0 candidates, 26665 repo-hours, 11 releases; waiting 521 ms; commit 812 ms)
2026-11-07T04:33:33Z [load_day 2026-08-15] 2026-08-15 hour 9: 165395 events in 4 files, snapshot 1821521855358138013 (task 3520 ms: download 1228 ms overlapping gunzip 195 ms, parse 771 ms, sort 111 ms, write 1411 ms, index 209 ms: 1 candidates, 27149 repo-hours, 11 releases; waiting 515 ms; commit 955 ms)
2026-11-07T04:33:36Z [load_day 2026-08-15] 2026-08-15 hour 10: 166786 events in 4 files, snapshot 8491647992792185421 (task 3537 ms: download 1280 ms overlapping gunzip 184 ms, parse 757 ms, sort 104 ms, write 1444 ms, index 195 ms: 0 candidates, 28804 repo-hours, 7 releases; waiting 528 ms; commit 799 ms)
2026-11-07T04:33:37Z [load_day 2026-08-15] 2026-08-15 hour 11: 168192 events in 4 files, snapshot 4533929639635783751 (task 3602 ms: download 1287 ms overlapping gunzip 187 ms, parse 749 ms, sort 106 ms, write 1555 ms, index 173 ms: 0 candidates, 27966 repo-hours, 12 releases; waiting 522 ms; commit 805 ms)
2026-11-07T04:33:41Z [load_day 2026-08-15] 2026-08-15 hour 12: 170586 events in 4 files, snapshot 7869411796013571939 (task 3739 ms: download 1227 ms overlapping gunzip 197 ms, parse 778 ms, sort 107 ms, write 1628 ms, index 189 ms: 0 candidates, 31458 repo-hours, 9 releases; waiting 529 ms; commit 924 ms)
2026-11-07T04:33:42Z [load_day 2026-08-15] 2026-08-15 hour 13: 171037 events in 4 files, snapshot 5166546393529495871 (task 3760 ms: download 1280 ms overlapping gunzip 193 ms, parse 774 ms, sort 106 ms, write 1538 ms, index 297 ms: 2 candidates, 34633 repo-hours, 9 releases; waiting 518 ms; commit 925 ms)
2026-11-07T04:33:45Z [load_day 2026-08-15] 2026-08-15 hour 14: 165688 events in 4 files, snapshot 2870840007158438713 (task 3743 ms: download 1464 ms overlapping gunzip 188 ms, parse 760 ms, sort 118 ms, write 1613 ms, index 210 ms: 5 candidates, 32166 repo-hours, 13 releases; waiting 516 ms; commit 911 ms)
2026-11-07T04:33:46Z [load_day 2026-08-15] 2026-08-15 hour 15: 168484 events in 4 files, snapshot 6787947949166430709 (task 3699 ms: download 1489 ms overlapping gunzip 189 ms, parse 760 ms, sort 110 ms, write 1553 ms, index 203 ms: 2 candidates, 31122 repo-hours, 8 releases; waiting 533 ms; commit 879 ms)
2026-11-07T04:33:50Z [load_day 2026-08-15] 2026-08-15 hour 16: 164888 events in 4 files, snapshot 6807063816410328304 (task 3847 ms: download 2529 ms overlapping gunzip 191 ms, parse 777 ms, sort 126 ms, write 1574 ms, index 207 ms: 1 candidates, 30332 repo-hours, 5 releases; waiting 705 ms; commit 842 ms)
2026-11-07T04:33:51Z [load_day 2026-08-15] 2026-08-15 hour 17: 167684 events in 4 files, snapshot 9042071405237312709 (task 3684 ms: download 1302 ms overlapping gunzip 190 ms, parse 749 ms, sort 103 ms, write 1512 ms, index 229 ms: 1 candidates, 30937 repo-hours, 10 releases; waiting 532 ms; commit 928 ms)
2026-11-07T04:33:54Z [load_day 2026-08-15] 2026-08-15 hour 18: 166359 events in 4 files, snapshot 6747639735585729525 (task 3518 ms: download 1296 ms overlapping gunzip 194 ms, parse 779 ms, sort 98 ms, write 1420 ms, index 207 ms: 3 candidates, 30866 repo-hours, 8 releases; waiting 538 ms; commit 801 ms)
2026-11-07T04:33:55Z [load_day 2026-08-15] 2026-08-15 hour 19: 166987 events in 4 files, snapshot 8193158660747215526 (task 3634 ms: download 1257 ms overlapping gunzip 198 ms, parse 791 ms, sort 105 ms, write 1453 ms, index 185 ms: 4 candidates, 28450 repo-hours, 15 releases; waiting 441 ms; commit 882 ms)
2026-11-07T04:33:58Z [load_day 2026-08-15] 2026-08-15 hour 20: 167159 events in 4 files, snapshot 5559269216929843341 (task 3606 ms: download 1119 ms overlapping gunzip 201 ms, parse 800 ms, sort 113 ms, write 1483 ms, index 191 ms: 1 candidates, 30654 repo-hours, 9 releases; waiting 516 ms; commit 814 ms)
2026-11-07T04:33:59Z [load_day 2026-08-15] 2026-08-15 hour 21: 165992 events in 4 files, snapshot 4338006554681398928 (task 3573 ms: download 1164 ms overlapping gunzip 189 ms, parse 747 ms, sort 101 ms, write 1461 ms, index 217 ms: 1 candidates, 31557 repo-hours, 8 releases; waiting 522 ms; commit 941 ms)
2026-11-07T04:34:02Z [load_day 2026-08-15] 2026-08-15 hour 22: 169513 events in 4 files, snapshot 3800524347877787768 (task 3867 ms: download 1288 ms overlapping gunzip 191 ms, parse 768 ms, sort 111 ms, write 1557 ms, index 265 ms: 2 candidates, 33129 repo-hours, 6 releases; waiting 606 ms; commit 902 ms)
2026-11-07T04:34:04Z [load_day 2026-08-15] 2026-08-15 hour 23: 170084 events in 4 files, snapshot 1810318668804643100 (task 3865 ms: download 1249 ms overlapping gunzip 196 ms, parse 776 ms, sort 111 ms, write 1627 ms, index 228 ms: 0 candidates, 32930 repo-hours, 11 releases; waiting 545 ms; commit 982 ms)
2026-11-07T04:34:07Z [load_day 2026-08-15] 2026-08-15: repo_hour merged from 24 files to 1 (756425 rows, 3522 ms)
2026-11-07T04:34:09Z [load_day 2026-08-15] 2026-08-15: index committed in 5445 ms (19 + 1 + 24 files)
2026-11-07T04:34:09Z [load_day 2026-08-15] 2026-08-15: 4023209 events in 24 hours
2026-11-07T04:34:09Z [load_day 2026-08-15] attempt 1 succeeded