orcaLog in

Runs · run 584

load_day 2026-05-07, attempt 1 succeeded

Host
4e84322b8c45:130825
Started
2026-11-07T06:38:55Z
Ended
2026-11-07T06:40:09Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/584/load_day/2026-05-07/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:38:55Z [load_day 2026-05-07] attempt 1 started
2026-11-07T06:39:04Z [load_day 2026-05-07] 2026-05-07 hour 0: 140927 events in 3 files, snapshot 7664270519681567490 (task 5850 ms: download 2179 ms overlapping gunzip 385 ms, parse 1272 ms, sort 162 ms, write 2651 ms, index 475 ms: 2 candidates, 69925 repo-hours, 569 releases; waiting 541 ms; commit 1085 ms)
2026-11-07T06:39:05Z [load_day 2026-05-07] 2026-05-07 hour 1: 151179 events in 4 files, snapshot 5788606314300195663 (task 5581 ms: download 1951 ms overlapping gunzip 314 ms, parse 1089 ms, sort 207 ms, write 2499 ms, index 510 ms: 9 candidates, 78318 repo-hours, 379 releases; waiting 637 ms; commit 1192 ms)
2026-11-07T06:39:09Z [load_day 2026-05-07] 2026-05-07 hour 2: 159828 events in 4 files, snapshot 870957131130948779 (task 4390 ms: download 1736 ms overlapping gunzip 239 ms, parse 844 ms, sort 103 ms, write 1730 ms, index 601 ms: 6 candidates, 90796 repo-hours, 157 releases; waiting 537 ms; commit 1128 ms)
2026-11-07T06:39:11Z [load_day 2026-05-07] 2026-05-07 hour 3: 158606 events in 4 files, snapshot 3350204163086576687 (task 4631 ms: download 1934 ms overlapping gunzip 280 ms, parse 981 ms, sort 107 ms, write 1860 ms, index 532 ms: 3 candidates, 84567 repo-hours, 318 releases; waiting 546 ms; commit 1090 ms)
2026-11-07T06:39:15Z [load_day 2026-05-07] 2026-05-07 hour 4: 149815 events in 3 files, snapshot 1249966356249429780 (task 4846 ms: download 1957 ms overlapping gunzip 275 ms, parse 983 ms, sort 113 ms, write 1916 ms, index 529 ms: 4 candidates, 71461 repo-hours, 683 releases; waiting 696 ms; commit 1124 ms)
2026-11-07T06:39:16Z [load_day 2026-05-07] 2026-05-07 hour 5: 150096 events in 4 files, snapshot 1230604615227202917 (task 4372 ms: download 1611 ms overlapping gunzip 253 ms, parse 887 ms, sort 107 ms, write 1764 ms, index 484 ms: 9 candidates, 75002 repo-hours, 675 releases; waiting 535 ms; commit 1105 ms)
2026-11-07T06:39:19Z [load_day 2026-05-07] 2026-05-07 hour 6: 151296 events in 4 files, snapshot 2117098951767151213 (task 4045 ms: download 1689 ms overlapping gunzip 245 ms, parse 796 ms, sort 108 ms, write 1617 ms, index 579 ms: 6 candidates, 79066 repo-hours, 196 releases; waiting 402 ms; commit 1047 ms)
2026-11-07T06:39:21Z [load_day 2026-05-07] 2026-05-07 hour 7: 151655 events in 4 files, snapshot 5694663384019435233 (task 4229 ms: download 1690 ms overlapping gunzip 292 ms, parse 918 ms, sort 102 ms, write 1589 ms, index 497 ms: 6 candidates, 78493 repo-hours, 191 releases; waiting 540 ms; commit 1013 ms)
2026-11-07T06:39:24Z [load_day 2026-05-07] 2026-05-07 hour 8: 152225 events in 4 files, snapshot 7842056482903430606 (task 4099 ms: download 1606 ms overlapping gunzip 219 ms, parse 777 ms, sort 110 ms, write 1557 ms, index 578 ms: 13 candidates, 83553 repo-hours, 109 releases; waiting 532 ms; commit 1157 ms)
2026-11-07T06:39:26Z [load_day 2026-05-07] 2026-05-07 hour 9: 152657 events in 4 files, snapshot 1527139226827980104 (task 4056 ms: download 1677 ms overlapping gunzip 228 ms, parse 800 ms, sort 106 ms, write 1485 ms, index 555 ms: 6 candidates, 83513 repo-hours, 141 releases; waiting 538 ms; commit 1071 ms)
2026-11-07T06:39:29Z [load_day 2026-05-07] 2026-05-07 hour 10: 153743 events in 4 files, snapshot 3954881249469333899 (task 4273 ms: download 1625 ms overlapping gunzip 224 ms, parse 790 ms, sort 104 ms, write 1766 ms, index 553 ms: 7 candidates, 84374 repo-hours, 152 releases; waiting 527 ms; commit 1039 ms)
2026-11-07T06:39:31Z [load_day 2026-05-07] 2026-05-07 hour 11: 151288 events in 4 files, snapshot 6204007481928763670 (task 4172 ms: download 1384 ms overlapping gunzip 225 ms, parse 795 ms, sort 160 ms, write 1637 ms, index 572 ms: 6 candidates, 84823 repo-hours, 144 releases; waiting 527 ms; commit 1131 ms)
2026-11-07T06:39:34Z [load_day 2026-05-07] 2026-05-07 hour 12: 150729 events in 4 files, snapshot 4494153241955313039 (task 3741 ms: download 1601 ms overlapping gunzip 209 ms, parse 759 ms, sort 108 ms, write 1368 ms, index 545 ms: 5 candidates, 82834 repo-hours, 101 releases; waiting 524 ms; commit 1167 ms)
2026-11-07T06:39:35Z [load_day 2026-05-07] 2026-05-07 hour 13: 150435 events in 4 files, snapshot 5196621361116201127 (task 3894 ms: download 1517 ms overlapping gunzip 210 ms, parse 757 ms, sort 99 ms, write 1403 ms, index 604 ms: 5 candidates, 88264 repo-hours, 77 releases; waiting 498 ms; commit 1150 ms)
2026-11-07T06:39:38Z [load_day 2026-05-07] 2026-05-07 hour 14: 144582 events in 3 files, snapshot 990151781814272496 (task 3950 ms: download 1477 ms overlapping gunzip 210 ms, parse 756 ms, sort 100 ms, write 1479 ms, index 578 ms: 7 candidates, 87869 repo-hours, 65 releases; waiting 531 ms; commit 1134 ms)
2026-11-07T06:39:39Z [load_day 2026-05-07] 2026-05-07 hour 15: 148709 events in 3 files, snapshot 3729477387496107501 (task 3650 ms: download 1232 ms overlapping gunzip 207 ms, parse 734 ms, sort 106 ms, write 1475 ms, index 594 ms: 11 candidates, 84806 repo-hours, 136 releases; waiting 184 ms; commit 1062 ms)
2026-11-07T06:39:43Z [load_day 2026-05-07] 2026-05-07 hour 16: 149746 events in 3 files, snapshot 4651052117527501355 (task 3953 ms: download 1346 ms overlapping gunzip 217 ms, parse 751 ms, sort 107 ms, write 1456 ms, index 616 ms: 12 candidates, 83833 repo-hours, 116 releases; waiting 527 ms; commit 1013 ms)
2026-11-07T06:39:44Z [load_day 2026-05-07] 2026-05-07 hour 17: 146226 events in 3 files, snapshot 4292594999787399642 (task 3931 ms: download 1260 ms overlapping gunzip 225 ms, parse 787 ms, sort 95 ms, write 1397 ms, index 551 ms: 6 candidates, 80790 repo-hours, 125 releases; waiting 518 ms; commit 1001 ms)
2026-11-07T06:39:48Z [load_day 2026-05-07] 2026-05-07 hour 18: 153765 events in 4 files, snapshot 3693642029581323022 (task 4423 ms: download 1590 ms overlapping gunzip 233 ms, parse 823 ms, sort 109 ms, write 1874 ms, index 534 ms: 11 candidates, 81147 repo-hours, 167 releases; waiting 540 ms; commit 1042 ms)
2026-11-07T06:39:49Z [load_day 2026-05-07] 2026-05-07 hour 19: 157851 events in 4 files, snapshot 3961805650125455796 (task 4157 ms: download 1380 ms overlapping gunzip 229 ms, parse 825 ms, sort 119 ms, write 1633 ms, index 535 ms: 6 candidates, 83466 repo-hours, 106 releases; waiting 508 ms; commit 997 ms)
2026-11-07T06:39:52Z [load_day 2026-05-07] 2026-05-07 hour 20: 152433 events in 4 files, snapshot 7696839760176556442 (task 3754 ms: download 861 ms overlapping gunzip 229 ms, parse 814 ms, sort 131 ms, write 1575 ms, index 523 ms: 9 candidates, 77377 repo-hours, 147 releases; waiting 180 ms; commit 985 ms)
2026-11-07T06:39:54Z [load_day 2026-05-07] 2026-05-07 hour 21: 146785 events in 3 files, snapshot 3719266748475969405 (task 4609 ms: download 1696 ms overlapping gunzip 258 ms, parse 874 ms, sort 102 ms, write 1818 ms, index 603 ms: 8 candidates, 73799 repo-hours, 323 releases; waiting 560 ms; commit 1153 ms)
2026-11-07T06:39:57Z [load_day 2026-05-07] 2026-05-07 hour 22: 148082 events in 3 files, snapshot 249416504458579944 (task 4303 ms: download 719 ms overlapping gunzip 311 ms, parse 1020 ms, sort 117 ms, write 2168 ms, index 477 ms: 5 candidates, 70847 repo-hours, 466 releases; waiting 16 ms; commit 1047 ms)
2026-11-07T06:40:00Z [load_day 2026-05-07] 2026-05-07 hour 23: 148574 events in 3 files, snapshot 6238604303144468875 (task 4909 ms: download 1742 ms overlapping gunzip 328 ms, parse 1107 ms, sort 123 ms, write 2074 ms, index 466 ms: 3 candidates, 70933 repo-hours, 588 releases; waiting 513 ms; commit 1238 ms)
2026-11-07T06:40:08Z [load_day 2026-05-07] 2026-05-07: repo_hour merged from 24 files to 1 (1929856 rows, 7586 ms)
2026-11-07T06:40:09Z [load_day 2026-05-07] 2026-05-07: index committed in 9127 ms (24 + 1 + 24 files)
2026-11-07T06:40:09Z [load_day 2026-05-07] 2026-05-07: 3621232 events in 24 hours
2026-11-07T06:40:09Z [load_day 2026-05-07] attempt 1 succeeded