orcaLog in

Runs · run 68

load_day 2026-10-26, attempt 1 succeeded

Host
4e84322b8c45:15703
Started
2026-11-07T03:27:22Z
Ended
2026-11-07T03:27:56Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/68/load_day/2026-10-26/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:27:22Z [load_day 2026-10-26] attempt 1 started
2026-11-07T03:27:27Z [load_day 2026-10-26] 2026-10-26 hour 0: 83118 events in 2 files, snapshot 5296225866296847986 (task 2236 ms: download 251 ms overlapping gunzip 133 ms, parse 460 ms, sort 65 ms, write 1050 ms, index 309 ms: 8 candidates, 48193 repo-hours, 70 releases; waiting 15 ms; commit 658 ms)
2026-11-07T03:27:28Z [load_day 2026-10-26] 2026-10-26 hour 1: 80077 events in 2 files, snapshot 8756071872249301379 (task 2207 ms: download 239 ms overlapping gunzip 117 ms, parse 420 ms, sort 57 ms, write 1090 ms, index 321 ms: 11 candidates, 47031 repo-hours, 87 releases; waiting 15 ms; commit 705 ms)
2026-11-07T03:27:30Z [load_day 2026-10-26] 2026-10-26 hour 2: 87793 events in 2 files, snapshot 1884882163019613675 (task 2105 ms: download 232 ms overlapping gunzip 134 ms, parse 449 ms, sort 56 ms, write 875 ms, index 385 ms: 8 candidates, 54913 repo-hours, 61 releases; waiting 13 ms; commit 653 ms)
2026-11-07T03:27:31Z [load_day 2026-10-26] 2026-10-26 hour 3: 87463 events in 2 files, snapshot 2690854833283194521 (task 2193 ms: download 250 ms overlapping gunzip 125 ms, parse 433 ms, sort 60 ms, write 1030 ms, index 330 ms: 6 candidates, 54512 repo-hours, 66 releases; waiting 13 ms; commit 520 ms)
2026-11-07T03:27:33Z [load_day 2026-10-26] 2026-10-26 hour 4: 90235 events in 2 files, snapshot 5485161063971422020 (task 2190 ms: download 250 ms overlapping gunzip 125 ms, parse 430 ms, sort 62 ms, write 1018 ms, index 348 ms: 8 candidates, 52777 repo-hours, 72 releases; waiting 15 ms; commit 536 ms)
2026-11-07T03:27:33Z [load_day 2026-10-26] 2026-10-26 hour 5: 89038 events in 2 files, snapshot 5095291022776473798 (task 2221 ms: download 261 ms overlapping gunzip 129 ms, parse 423 ms, sort 64 ms, write 1070 ms, index 334 ms: 6 candidates, 52295 repo-hours, 83 releases; waiting 19 ms; commit 435 ms)
2026-11-07T03:27:36Z [load_day 2026-10-26] 2026-10-26 hour 6: 85759 events in 2 files, snapshot 260945822942852323 (task 2829 ms: download 1113 ms overlapping gunzip 139 ms, parse 456 ms, sort 56 ms, write 1002 ms, index 334 ms: 5 candidates, 50052 repo-hours, 70 releases; waiting 544 ms; commit 618 ms)
2026-11-07T03:27:37Z [load_day 2026-10-26] 2026-10-26 hour 7: 77818 events in 2 files, snapshot 43283074536649736 (task 2294 ms: download 638 ms overlapping gunzip 120 ms, parse 392 ms, sort 59 ms, write 954 ms, index 291 ms: 5 candidates, 46406 repo-hours, 104 releases; waiting 199 ms; commit 575 ms)
2026-11-07T03:27:40Z [load_day 2026-10-26] 2026-10-26 hour 8: 60557 events in 2 files, snapshot 1726045252728997579 (task 2679 ms: download 1074 ms overlapping gunzip 115 ms, parse 371 ms, sort 39 ms, write 880 ms, index 290 ms: 4 candidates, 38803 repo-hours, 144 releases; waiting 671 ms; commit 780 ms)
2026-11-07T03:27:40Z [load_day 2026-10-26] 2026-10-26 hour 9: 32255 events in 1 files, snapshot 8666902530857875693 (task 1970 ms: download 862 ms overlapping gunzip 99 ms, parse 293 ms, sort 21 ms, write 537 ms, index 165 ms: 1 candidates, 23055 repo-hours, 130 releases; waiting 555 ms; commit 626 ms)
2026-11-07T03:27:41Z [load_day 2026-10-26] 2026-10-26 hour 10: 7214 events in 1 files, snapshot 2312110793134163835 (task 1385 ms: download 729 ms overlapping gunzip 42 ms, parse 121 ms, sort 4 ms, write 302 ms, index 56 ms: 0 candidates, 6356 repo-hours, 109 releases; waiting 578 ms; commit 584 ms)
2026-11-07T03:27:42Z [load_day 2026-10-26] 2026-10-26 hour 11: 2728 events in 1 files, snapshot 6222701675761874416 (task 1291 ms: download 690 ms overlapping gunzip 35 ms, parse 99 ms, sort 2 ms, write 274 ms, index 32 ms: 0 candidates, 2557 repo-hours, 137 releases; waiting 564 ms; commit 621 ms)
2026-11-07T03:27:43Z [load_day 2026-10-26] 2026-10-26 hour 12: 2598 events in 1 files, snapshot 1217907023274972701 (task 1236 ms: download 671 ms overlapping gunzip 36 ms, parse 97 ms, sort 2 ms, write 238 ms, index 32 ms: 0 candidates, 2407 repo-hours, 137 releases; waiting 547 ms; commit 746 ms)
2026-11-07T03:27:44Z [load_day 2026-10-26] 2026-10-26 hour 13: 2917 events in 1 files, snapshot 7093787864291938427 (task 1290 ms: download 686 ms overlapping gunzip 37 ms, parse 107 ms, sort 3 ms, write 269 ms, index 41 ms: 1 candidates, 2754 repo-hours, 187 releases; waiting 557 ms; commit 686 ms)
2026-11-07T03:27:45Z [load_day 2026-10-26] 2026-10-26 hour 14: 3345 events in 1 files, snapshot 6073312557123406091 (task 1325 ms: download 692 ms overlapping gunzip 42 ms, parse 113 ms, sort 3 ms, write 288 ms, index 37 ms: 0 candidates, 3111 repo-hours, 163 releases; waiting 548 ms; commit 421 ms)
2026-11-07T03:27:46Z [load_day 2026-10-26] 2026-10-26 hour 15: 2780 events in 1 files, snapshot 3567791831882255758 (task 1268 ms: download 666 ms overlapping gunzip 35 ms, parse 108 ms, sort 6 ms, write 258 ms, index 46 ms: 1 candidates, 2608 repo-hours, 125 releases; waiting 543 ms; commit 547 ms)
2026-11-07T03:27:46Z [load_day 2026-10-26] 2026-10-26 hour 16: 3331 events in 1 files, snapshot 7879696785046370952 (task 630 ms: download 80 ms overlapping gunzip 28 ms, parse 71 ms, sort 3 ms, write 282 ms, index 36 ms: 0 candidates, 3061 repo-hours, 104 releases; waiting 21 ms; commit 531 ms)
2026-11-07T03:27:47Z [load_day 2026-10-26] 2026-10-26 hour 17: 2953 events in 1 files, snapshot 5769790921800180205 (task 605 ms: download 64 ms overlapping gunzip 25 ms, parse 67 ms, sort 2 ms, write 258 ms, index 42 ms: 1 candidates, 2757 repo-hours, 144 releases; waiting 19 ms; commit 625 ms)
2026-11-07T03:27:48Z [load_day 2026-10-26] 2026-10-26 hour 18: 3979 events in 1 files, snapshot 4632870559983652524 (task 964 ms: download 81 ms overlapping gunzip 36 ms, parse 119 ms, sort 4 ms, write 361 ms, index 83 ms: 1 candidates, 3597 repo-hours, 353 releases; waiting 18 ms; commit 652 ms)
2026-11-07T03:27:49Z [load_day 2026-10-26] 2026-10-26 hour 19: 3446 events in 1 files, snapshot 820226623095949593 (task 674 ms: download 70 ms overlapping gunzip 31 ms, parse 87 ms, sort 3 ms, write 306 ms, index 34 ms: 0 candidates, 3101 repo-hours, 156 releases; waiting 16 ms; commit 591 ms)
2026-11-07T03:27:49Z [load_day 2026-10-26] 2026-10-26 hour 20: 4505 events in 1 files, snapshot 5626432824831554289 (task 771 ms: download 78 ms overlapping gunzip 37 ms, parse 103 ms, sort 4 ms, write 387 ms, index 38 ms: 0 candidates, 3942 repo-hours, 200 releases; waiting 16 ms; commit 480 ms)
2026-11-07T03:27:50Z [load_day 2026-10-26] 2026-10-26 hour 21: 3601 events in 1 files, snapshot 2019062903902639217 (task 773 ms: download 82 ms overlapping gunzip 33 ms, parse 91 ms, sort 3 ms, write 368 ms, index 63 ms: 0 candidates, 3188 repo-hours, 145 releases; waiting 16 ms; commit 680 ms)
2026-11-07T03:27:51Z [load_day 2026-10-26] 2026-10-26 hour 22: 3438 events in 1 files, snapshot 7905024966990131068 (task 654 ms: download 70 ms overlapping gunzip 34 ms, parse 88 ms, sort 4 ms, write 290 ms, index 41 ms: 0 candidates, 3061 repo-hours, 132 releases; waiting 14 ms; commit 672 ms)
2026-11-07T03:27:51Z [load_day 2026-10-26] 2026-10-26 hour 23: 3405 events in 1 files, snapshot 3064601661299115246 (task 692 ms: download 77 ms overlapping gunzip 30 ms, parse 85 ms, sort 3 ms, write 322 ms, index 37 ms: 0 candidates, 3028 repo-hours, 138 releases; waiting 17 ms; commit 512 ms)
2026-11-07T03:27:54Z [load_day 2026-10-26] 2026-10-26: repo_hour merged from 24 files to 1 (513565 rows, 2965 ms)
2026-11-07T03:27:56Z [load_day 2026-10-26] 2026-10-26: index committed in 4554 ms (14 + 1 + 24 files)
2026-11-07T03:27:56Z [load_day 2026-10-26] 2026-10-26: 824353 events in 24 hours
2026-11-07T03:27:56Z [load_day 2026-10-26] attempt 1 succeeded