orcaLog in

Runs · run 530

load_day 2026-05-25, attempt 1 succeeded

Host
4e84322b8c45:116673
Started
2026-11-07T06:15:21Z
Ended
2026-11-07T06:16:41Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/530/load_day/2026-05-25/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:15:22Z [load_day 2026-05-25] attempt 1 started
2026-11-07T06:15:31Z [load_day 2026-05-25] 2026-05-25 hour 0: 152307 events in 4 files, snapshot 3882609659607527622 (task 6034 ms: download 2070 ms overlapping gunzip 387 ms, parse 1298 ms, sort 180 ms, write 2895 ms, index 454 ms: 9 candidates, 69599 repo-hours, 740 releases; waiting 512 ms; commit 967 ms)
2026-11-07T06:15:32Z [load_day 2026-05-25] 2026-05-25 hour 1: 146657 events in 3 files, snapshot 1064995168084910419 (task 5755 ms: download 2014 ms overlapping gunzip 345 ms, parse 1154 ms, sort 151 ms, write 2866 ms, index 473 ms: 6 candidates, 69754 repo-hours, 613 releases; waiting 518 ms; commit 1016 ms)
2026-11-07T06:15:37Z [load_day 2026-05-25] 2026-05-25 hour 2: 157284 events in 4 files, snapshot 7316296107510702179 (task 4906 ms: download 1744 ms overlapping gunzip 287 ms, parse 965 ms, sort 131 ms, write 2192 ms, index 521 ms: 7 candidates, 83087 repo-hours, 357 releases; waiting 521 ms; commit 1081 ms)
2026-11-07T06:15:38Z [load_day 2026-05-25] 2026-05-25 hour 3: 154772 events in 4 files, snapshot 2241990045558085306 (task 4959 ms: download 1712 ms overlapping gunzip 280 ms, parse 940 ms, sort 119 ms, write 2223 ms, index 511 ms: 4 candidates, 79919 repo-hours, 366 releases; waiting 553 ms; commit 1208 ms)
2026-11-07T06:15:42Z [load_day 2026-05-25] 2026-05-25 hour 4: 156779 events in 4 files, snapshot 4144305089153045137 (task 4621 ms: download 1364 ms overlapping gunzip 276 ms, parse 926 ms, sort 125 ms, write 1966 ms, index 521 ms: 5 candidates, 83234 repo-hours, 357 releases; waiting 530 ms; commit 1064 ms)
2026-11-07T06:15:43Z [load_day 2026-05-25] 2026-05-25 hour 5: 151454 events in 4 files, snapshot 5135640962963839766 (task 4625 ms: download 1893 ms overlapping gunzip 288 ms, parse 986 ms, sort 136 ms, write 1890 ms, index 470 ms: 5 candidates, 70687 repo-hours, 359 releases; waiting 531 ms; commit 1058 ms)
2026-11-07T06:15:48Z [load_day 2026-05-25] 2026-05-25 hour 6: 151387 events in 4 files, snapshot 5134630488406604786 (task 5091 ms: download 1640 ms overlapping gunzip 250 ms, parse 858 ms, sort 104 ms, write 1854 ms, index 516 ms: 7 candidates, 75615 repo-hours, 283 releases; waiting 1019 ms; commit 1169 ms)
2026-11-07T06:15:49Z [load_day 2026-05-25] 2026-05-25 hour 7: 153574 events in 4 files, snapshot 5034146984324592718 (task 4183 ms: download 1499 ms overlapping gunzip 246 ms, parse 888 ms, sort 115 ms, write 1563 ms, index 504 ms: 4 candidates, 76418 repo-hours, 253 releases; waiting 544 ms; commit 1055 ms)
2026-11-07T06:15:53Z [load_day 2026-05-25] 2026-05-25 hour 8: 152133 events in 4 files, snapshot 8010634428514661634 (task 4233 ms: download 1399 ms overlapping gunzip 243 ms, parse 837 ms, sort 124 ms, write 1709 ms, index 556 ms: 13 candidates, 77469 repo-hours, 221 releases; waiting 524 ms; commit 1034 ms)
2026-11-07T06:15:55Z [load_day 2026-05-25] 2026-05-25 hour 9: 150649 events in 4 files, snapshot 8481849435262522106 (task 4621 ms: download 1824 ms overlapping gunzip 273 ms, parse 918 ms, sort 118 ms, write 1874 ms, index 526 ms: 5 candidates, 79630 repo-hours, 276 releases; waiting 591 ms; commit 1001 ms)
2026-11-07T06:16:00Z [load_day 2026-05-25] 2026-05-25 hour 10: 162277 events in 4 files, snapshot 1882845920608197281 (task 4279 ms: download 1557 ms overlapping gunzip 229 ms, parse 817 ms, sort 111 ms, write 1753 ms, index 534 ms: 10 candidates, 81611 repo-hours, 74 releases; waiting 557 ms; commit 2850 ms)
2026-11-07T06:16:01Z [load_day 2026-05-25] 2026-05-25 hour 11: 157713 events in 4 files, snapshot 5108788934950914270 (task 3633 ms: download 873 ms overlapping gunzip 220 ms, parse 779 ms, sort 121 ms, write 1554 ms, index 538 ms: 11 candidates, 82049 repo-hours, 123 releases; waiting 212 ms; commit 1155 ms)
2026-11-07T06:16:03Z [load_day 2026-05-25] 2026-05-25 hour 12: 163009 events in 4 files, snapshot 3760177968417786193 (task 4103 ms: download 1309 ms overlapping gunzip 223 ms, parse 827 ms, sort 107 ms, write 1694 ms, index 582 ms: 8 candidates, 83671 repo-hours, 90 releases; waiting 360 ms; commit 1089 ms)
2026-11-07T06:16:06Z [load_day 2026-05-25] 2026-05-25 hour 13: 164797 events in 4 files, snapshot 8773357129474386700 (task 4329 ms: download 1713 ms overlapping gunzip 214 ms, parse 814 ms, sort 135 ms, write 1715 ms, index 613 ms: 10 candidates, 88386 repo-hours, 67 releases; waiting 539 ms; commit 1120 ms)
2026-11-07T06:16:08Z [load_day 2026-05-25] 2026-05-25 hour 14: 160848 events in 4 files, snapshot 6901048350796835973 (task 4284 ms: download 1201 ms overlapping gunzip 228 ms, parse 805 ms, sort 124 ms, write 1575 ms, index 653 ms: 10 candidates, 93023 repo-hours, 21 releases; waiting 536 ms; commit 1081 ms)
2026-11-07T06:16:11Z [load_day 2026-05-25] 2026-05-25 hour 15: 162570 events in 4 files, snapshot 6186546096757196322 (task 4173 ms: download 1220 ms overlapping gunzip 215 ms, parse 812 ms, sort 112 ms, write 1642 ms, index 604 ms: 9 candidates, 86534 repo-hours, 38 releases; waiting 525 ms; commit 1099 ms)
2026-11-07T06:16:12Z [load_day 2026-05-25] 2026-05-25 hour 16: 161903 events in 4 files, snapshot 4847953436387688018 (task 3811 ms: download 841 ms overlapping gunzip 213 ms, parse 777 ms, sort 120 ms, write 1667 ms, index 540 ms: 7 candidates, 82050 repo-hours, 59 releases; waiting 181 ms; commit 981 ms)
2026-11-07T06:16:16Z [load_day 2026-05-25] 2026-05-25 hour 17: 161188 events in 4 files, snapshot 3520082952903311642 (task 4231 ms: download 1394 ms overlapping gunzip 214 ms, parse 807 ms, sort 119 ms, write 1618 ms, index 601 ms: 12 candidates, 85230 repo-hours, 71 releases; waiting 533 ms; commit 1149 ms)
2026-11-07T06:16:17Z [load_day 2026-05-25] 2026-05-25 hour 18: 160836 events in 4 files, snapshot 2061739604246396690 (task 4219 ms: download 1264 ms overlapping gunzip 216 ms, parse 781 ms, sort 101 ms, write 1773 ms, index 563 ms: 9 candidates, 83095 repo-hours, 81 releases; waiting 558 ms; commit 1211 ms)
2026-11-07T06:16:21Z [load_day 2026-05-25] 2026-05-25 hour 19: 159770 events in 4 files, snapshot 4335594510236696088 (task 4212 ms: download 1317 ms overlapping gunzip 221 ms, parse 799 ms, sort 107 ms, write 1675 ms, index 573 ms: 9 candidates, 85631 repo-hours, 98 releases; waiting 547 ms; commit 1073 ms)
2026-11-07T06:16:23Z [load_day 2026-05-25] 2026-05-25 hour 20: 158555 events in 4 files, snapshot 8390574645769580650 (task 4605 ms: download 1280 ms overlapping gunzip 249 ms, parse 853 ms, sort 131 ms, write 1975 ms, index 560 ms: 6 candidates, 79156 repo-hours, 171 releases; waiting 492 ms; commit 1207 ms)
2026-11-07T06:16:26Z [load_day 2026-05-25] 2026-05-25 hour 21: 157704 events in 4 files, snapshot 4248478238471120812 (task 4739 ms: download 1906 ms overlapping gunzip 294 ms, parse 994 ms, sort 115 ms, write 1973 ms, index 513 ms: 7 candidates, 75934 repo-hours, 365 releases; waiting 530 ms; commit 1048 ms)
2026-11-07T06:16:28Z [load_day 2026-05-25] 2026-05-25 hour 22: 157093 events in 4 files, snapshot 3966592826964215893 (task 4729 ms: download 1510 ms overlapping gunzip 287 ms, parse 991 ms, sort 132 ms, write 2069 ms, index 488 ms: 4 candidates, 74430 repo-hours, 400 releases; waiting 537 ms; commit 1267 ms)
2026-11-07T06:16:32Z [load_day 2026-05-25] 2026-05-25 hour 23: 154623 events in 4 files, snapshot 7916682619496112717 (task 4908 ms: download 1512 ms overlapping gunzip 315 ms, parse 1070 ms, sort 144 ms, write 2100 ms, index 449 ms: 4 candidates, 71830 repo-hours, 512 releases; waiting 535 ms; commit 1094 ms)
2026-11-07T06:16:40Z [load_day 2026-05-25] 2026-05-25: repo_hour merged from 24 files to 1 (1918042 rows, 7691 ms)
2026-11-07T06:16:41Z [load_day 2026-05-25] 2026-05-25: index committed in 9667 ms (24 + 1 + 24 files)
2026-11-07T06:16:41Z [load_day 2026-05-25] 2026-05-25: 3769882 events in 24 hours
2026-11-07T06:16:41Z [load_day 2026-05-25] attempt 1 succeeded