orcaLog in

Runs · run 299

load_day 2026-08-10, attempt 1 succeeded

Host
4e84322b8c45:51981
Started
2026-11-07T04:38:45Z
Ended
2026-11-07T04:39:44Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/299/load_day/2026-08-10/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:38:45Z [load_day 2026-08-10] attempt 1 started
2026-11-07T04:38:52Z [load_day 2026-08-10] 2026-08-10 hour 0: 170689 events in 4 files, snapshot 8254355278070257932 (task 3727 ms: download 1322 ms overlapping gunzip 199 ms, parse 828 ms, sort 113 ms, write 1492 ms, index 239 ms: 1 candidates, 36390 repo-hours, 7 releases; waiting 545 ms; commit 702 ms)
2026-11-07T04:38:53Z [load_day 2026-08-10] 2026-08-10 hour 1: 170484 events in 4 files, snapshot 1755047165083941324 (task 3745 ms: download 1470 ms overlapping gunzip 200 ms, parse 821 ms, sort 109 ms, write 1554 ms, index 278 ms: 3 candidates, 44147 repo-hours, 4 releases; waiting 506 ms; commit 841 ms)
2026-11-07T04:38:57Z [load_day 2026-08-10] 2026-08-10 hour 2: 167286 events in 4 files, snapshot 5356111170582248274 (task 3657 ms: download 1151 ms overlapping gunzip 208 ms, parse 810 ms, sort 109 ms, write 1532 ms, index 230 ms: 2 candidates, 34993 repo-hours, 5 releases; waiting 524 ms; commit 994 ms)
2026-11-07T04:38:57Z [load_day 2026-08-10] 2026-08-10 hour 3: 168790 events in 4 files, snapshot 2080784704678928780 (task 3519 ms: download 1229 ms overlapping gunzip 190 ms, parse 751 ms, sort 110 ms, write 1443 ms, index 196 ms: 5 candidates, 30412 repo-hours, 8 releases; waiting 517 ms; commit 818 ms)
2026-11-07T04:39:01Z [load_day 2026-08-10] 2026-08-10 hour 4: 168394 events in 4 files, snapshot 8100708298389055841 (task 3594 ms: download 1305 ms overlapping gunzip 203 ms, parse 809 ms, sort 121 ms, write 1470 ms, index 209 ms: 4 candidates, 29594 repo-hours, 7 releases; waiting 386 ms; commit 742 ms)
2026-11-07T04:39:02Z [load_day 2026-08-10] 2026-08-10 hour 5: 165985 events in 4 files, snapshot 7307805038910088075 (task 3734 ms: download 1488 ms overlapping gunzip 206 ms, parse 786 ms, sort 107 ms, write 1502 ms, index 221 ms: 1 candidates, 32420 repo-hours, 7 releases; waiting 569 ms; commit 852 ms)
2026-11-07T04:39:05Z [load_day 2026-08-10] 2026-08-10 hour 6: 170330 events in 4 files, snapshot 5652887440988709070 (task 4021 ms: download 1237 ms overlapping gunzip 224 ms, parse 862 ms, sort 128 ms, write 1805 ms, index 195 ms: 1 candidates, 29435 repo-hours, 24 releases; waiting 513 ms; commit 828 ms)
2026-11-07T04:39:06Z [load_day 2026-08-10] 2026-08-10 hour 7: 163763 events in 4 files, snapshot 6280244430150987638 (task 3687 ms: download 1292 ms overlapping gunzip 188 ms, parse 737 ms, sort 105 ms, write 1649 ms, index 190 ms: 3 candidates, 29165 repo-hours, 8 releases; waiting 532 ms; commit 679 ms)
2026-11-07T04:39:10Z [load_day 2026-08-10] 2026-08-10 hour 8: 164801 events in 4 files, snapshot 2365740049373918261 (task 3615 ms: download 1429 ms overlapping gunzip 201 ms, parse 792 ms, sort 106 ms, write 1533 ms, index 190 ms: 0 candidates, 28966 repo-hours, 5 releases; waiting 518 ms; commit 781 ms)
2026-11-07T04:39:10Z [load_day 2026-08-10] 2026-08-10 hour 9: 161183 events in 4 files, snapshot 3114799750319370181 (task 3642 ms: download 1219 ms overlapping gunzip 184 ms, parse 723 ms, sort 111 ms, write 1590 ms, index 206 ms: 1 candidates, 31807 repo-hours, 12 releases; waiting 536 ms; commit 829 ms)
2026-11-07T04:39:14Z [load_day 2026-08-10] 2026-08-10 hour 10: 156258 events in 4 files, snapshot 3436917176704150764 (task 3525 ms: download 1227 ms overlapping gunzip 193 ms, parse 738 ms, sort 114 ms, write 1445 ms, index 208 ms: 1 candidates, 31745 repo-hours, 15 releases; waiting 520 ms; commit 830 ms)
2026-11-07T04:39:15Z [load_day 2026-08-10] 2026-08-10 hour 11: 154768 events in 4 files, snapshot 3175501517751279473 (task 3655 ms: download 1290 ms overlapping gunzip 189 ms, parse 727 ms, sort 108 ms, write 1548 ms, index 290 ms: 1 candidates, 37615 repo-hours, 9 releases; waiting 508 ms; commit 660 ms)
2026-11-07T04:39:18Z [load_day 2026-08-10] 2026-08-10 hour 12: 157445 events in 4 files, snapshot 2098580345483601637 (task 3647 ms: download 1521 ms overlapping gunzip 185 ms, parse 719 ms, sort 109 ms, write 1508 ms, index 285 ms: 3 candidates, 32381 repo-hours, 10 releases; waiting 532 ms; commit 971 ms)
2026-11-07T04:39:19Z [load_day 2026-08-10] 2026-08-10 hour 13: 148396 events in 3 files, snapshot 3405262484440369561 (task 3333 ms: download 1447 ms overlapping gunzip 171 ms, parse 676 ms, sort 100 ms, write 1398 ms, index 211 ms: 1 candidates, 28492 repo-hours, 8 releases; waiting 516 ms; commit 835 ms)
2026-11-07T04:39:22Z [load_day 2026-08-10] 2026-08-10 hour 14: 132940 events in 3 files, snapshot 3913322931898717668 (task 3181 ms: download 1158 ms overlapping gunzip 161 ms, parse 626 ms, sort 94 ms, write 1309 ms, index 191 ms: 3 candidates, 27870 repo-hours, 7 releases; waiting 485 ms; commit 794 ms)
2026-11-07T04:39:23Z [load_day 2026-08-10] 2026-08-10 hour 15: 115195 events in 3 files, snapshot 1650749834946323964 (task 2833 ms: download 1086 ms overlapping gunzip 136 ms, parse 545 ms, sort 77 ms, write 1092 ms, index 189 ms: 1 candidates, 25690 repo-hours, 8 releases; waiting 516 ms; commit 679 ms)
2026-11-07T04:39:25Z [load_day 2026-08-10] 2026-08-10 hour 16: 96513 events in 2 files, snapshot 6760554959255471882 (task 2614 ms: download 1043 ms overlapping gunzip 119 ms, parse 467 ms, sort 84 ms, write 931 ms, index 181 ms: 1 candidates, 25297 repo-hours, 20 releases; waiting 530 ms; commit 859 ms)
2026-11-07T04:39:26Z [load_day 2026-08-10] 2026-08-10 hour 17: 94278 events in 2 files, snapshot 5628570257981863447 (task 2553 ms: download 967 ms overlapping gunzip 127 ms, parse 480 ms, sort 73 ms, write 880 ms, index 174 ms: 2 candidates, 24200 repo-hours, 20 releases; waiting 526 ms; commit 773 ms)
2026-11-07T04:39:28Z [load_day 2026-08-10] 2026-08-10 hour 18: 83380 events in 2 files, snapshot 5907978263182857675 (task 2347 ms: download 895 ms overlapping gunzip 117 ms, parse 444 ms, sort 55 ms, write 756 ms, index 167 ms: 3 candidates, 24443 repo-hours, 19 releases; waiting 519 ms; commit 815 ms)
2026-11-07T04:39:29Z [load_day 2026-08-10] 2026-08-10 hour 19: 87131 events in 2 files, snapshot 7069495777736994186 (task 2375 ms: download 982 ms overlapping gunzip 112 ms, parse 436 ms, sort 61 ms, write 783 ms, index 169 ms: 4 candidates, 25436 repo-hours, 17 releases; waiting 536 ms; commit 769 ms)
2026-11-07T04:39:31Z [load_day 2026-08-10] 2026-08-10 hour 20: 96944 events in 2 files, snapshot 593224747772696780 (task 2590 ms: download 1079 ms overlapping gunzip 119 ms, parse 460 ms, sort 67 ms, write 864 ms, index 206 ms: 1 candidates, 25638 repo-hours, 15 releases; waiting 554 ms; commit 845 ms)
2026-11-07T04:39:32Z [load_day 2026-08-10] 2026-08-10 hour 21: 105765 events in 3 files, snapshot 5603879066718504615 (task 2666 ms: download 1181 ms overlapping gunzip 126 ms, parse 501 ms, sort 75 ms, write 957 ms, index 181 ms: 3 candidates, 27870 repo-hours, 22 releases; waiting 532 ms; commit 796 ms)
2026-11-07T04:39:35Z [load_day 2026-08-10] 2026-08-10 hour 22: 123962 events in 3 files, snapshot 607841954636935326 (task 3213 ms: download 1056 ms overlapping gunzip 178 ms, parse 699 ms, sort 124 ms, write 1214 ms, index 210 ms: 2 candidates, 30634 repo-hours, 14 releases; waiting 511 ms; commit 833 ms)
2026-11-07T04:39:36Z [load_day 2026-08-10] 2026-08-10 hour 23: 139141 events in 3 files, snapshot 7896019869504172331 (task 3397 ms: download 1573 ms overlapping gunzip 178 ms, parse 686 ms, sort 96 ms, write 1329 ms, index 285 ms: 3 candidates, 34556 repo-hours, 46 releases; waiting 523 ms; commit 803 ms)
2026-11-07T04:39:40Z [load_day 2026-08-10] 2026-08-10: repo_hour merged from 24 files to 1 (729196 rows, 3750 ms)
2026-11-07T04:39:44Z [load_day 2026-08-10] 2026-08-10: index committed in 7483 ms (23 + 1 + 24 files)
2026-11-07T04:39:44Z [load_day 2026-08-10] 2026-08-10: 3363821 events in 24 hours
2026-11-07T04:39:44Z [load_day 2026-08-10] attempt 1 succeeded