orcaLog in

Runs · run 41

load_day 2026-11-04, attempt 1 succeeded

Host
4e84322b8c45:13353
Started
2026-11-07T03:23:25Z
Ended
2026-11-07T03:23:47Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/41/load_day/2026-11-04/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:23:25Z [load_day 2026-11-04] attempt 1 started
2026-11-07T03:23:28Z [load_day 2026-11-04] 2026-11-04 hour 0: 5268 events in 1 files, snapshot 4781116637438231944 (task 1053 ms: download 129 ms overlapping gunzip 50 ms, parse 164 ms, sort 15 ms, write 585 ms, index 44 ms: 0 candidates, 4300 repo-hours, 202 releases; waiting 11 ms; commit 525 ms)
2026-11-07T03:23:28Z [load_day 2026-11-04] 2026-11-04 hour 1: 3884 events in 1 files, snapshot 8752946277699594787 (task 912 ms: download 87 ms overlapping gunzip 42 ms, parse 125 ms, sort 5 ms, write 506 ms, index 38 ms: 0 candidates, 3368 repo-hours, 130 releases; waiting 10 ms; commit 393 ms)
2026-11-07T03:23:29Z [load_day 2026-11-04] 2026-11-04 hour 2: 4198 events in 1 files, snapshot 6615682621400018837 (task 866 ms: download 95 ms overlapping gunzip 44 ms, parse 120 ms, sort 4 ms, write 432 ms, index 61 ms: 3 candidates, 3703 repo-hours, 174 releases; waiting 18 ms; commit 490 ms)
2026-11-07T03:23:30Z [load_day 2026-11-04] 2026-11-04 hour 3: 4093 events in 1 files, snapshot 1164693004915995716 (task 839 ms: download 83 ms overlapping gunzip 45 ms, parse 130 ms, sort 6 ms, write 400 ms, index 46 ms: 2 candidates, 3544 repo-hours, 172 releases; waiting 10 ms; commit 446 ms)
2026-11-07T03:23:31Z [load_day 2026-11-04] 2026-11-04 hour 4: 4091 events in 1 files, snapshot 1253520951824040704 (task 834 ms: download 112 ms overlapping gunzip 42 ms, parse 102 ms, sort 4 ms, write 442 ms, index 38 ms: 0 candidates, 3533 repo-hours, 161 releases; waiting 20 ms; commit 396 ms)
2026-11-07T03:23:31Z [load_day 2026-11-04] 2026-11-04 hour 5: 4227 events in 1 files, snapshot 675237156169679758 (task 867 ms: download 97 ms overlapping gunzip 48 ms, parse 122 ms, sort 4 ms, write 436 ms, index 42 ms: 0 candidates, 3672 repo-hours, 163 releases; waiting 14 ms; commit 503 ms)
2026-11-07T03:23:32Z [load_day 2026-11-04] 2026-11-04 hour 6: 4327 events in 1 files, snapshot 6539714323896608795 (task 866 ms: download 95 ms overlapping gunzip 48 ms, parse 115 ms, sort 4 ms, write 450 ms, index 50 ms: 1 candidates, 3793 repo-hours, 168 releases; waiting 17 ms; commit 558 ms)
2026-11-07T03:23:33Z [load_day 2026-11-04] 2026-11-04 hour 7: 4580 events in 1 files, snapshot 4523120339529391187 (task 902 ms: download 119 ms overlapping gunzip 51 ms, parse 126 ms, sort 5 ms, write 459 ms, index 43 ms: 0 candidates, 4053 repo-hours, 251 releases; waiting 20 ms; commit 388 ms)
2026-11-07T03:23:33Z [load_day 2026-11-04] 2026-11-04 hour 8: 4477 events in 1 files, snapshot 1602245309215945697 (task 899 ms: download 96 ms overlapping gunzip 44 ms, parse 116 ms, sort 5 ms, write 471 ms, index 57 ms: 0 candidates, 4033 repo-hours, 239 releases; waiting 15 ms; commit 488 ms)
2026-11-07T03:23:34Z [load_day 2026-11-04] 2026-11-04 hour 9: 4456 events in 1 files, snapshot 5638253988145164007 (task 872 ms: download 104 ms overlapping gunzip 45 ms, parse 111 ms, sort 5 ms, write 454 ms, index 44 ms: 0 candidates, 4010 repo-hours, 191 releases; waiting 15 ms; commit 429 ms)
2026-11-07T03:23:35Z [load_day 2026-11-04] 2026-11-04 hour 10: 4526 events in 1 files, snapshot 8548442263837757162 (task 896 ms: download 98 ms overlapping gunzip 45 ms, parse 124 ms, sort 5 ms, write 442 ms, index 65 ms: 1 candidates, 4045 repo-hours, 184 releases; waiting 15 ms; commit 540 ms)
2026-11-07T03:23:35Z [load_day 2026-11-04] 2026-11-04 hour 11: 4457 events in 1 files, snapshot 9070023540201730593 (task 878 ms: download 102 ms overlapping gunzip 45 ms, parse 110 ms, sort 5 ms, write 450 ms, index 48 ms: 0 candidates, 4033 repo-hours, 210 releases; waiting 19 ms; commit 321 ms)
2026-11-07T03:23:36Z [load_day 2026-11-04] 2026-11-04 hour 12: 4460 events in 1 files, snapshot 1936918626970434398 (task 822 ms: download 88 ms overlapping gunzip 44 ms, parse 114 ms, sort 5 ms, write 410 ms, index 43 ms: 0 candidates, 4007 repo-hours, 241 releases; waiting 17 ms; commit 451 ms)
2026-11-07T03:23:37Z [load_day 2026-11-04] 2026-11-04 hour 13: 5160 events in 1 files, snapshot 3486713711501866277 (task 972 ms: download 111 ms overlapping gunzip 56 ms, parse 149 ms, sort 6 ms, write 475 ms, index 83 ms: 3 candidates, 4617 repo-hours, 297 releases; waiting 19 ms; commit 473 ms)
2026-11-07T03:23:37Z [load_day 2026-11-04] 2026-11-04 hour 14: 4488 events in 1 files, snapshot 3661394757953906655 (task 784 ms: download 77 ms overlapping gunzip 43 ms, parse 111 ms, sort 4 ms, write 364 ms, index 42 ms: 0 candidates, 4034 repo-hours, 245 releases; waiting 14 ms; commit 402 ms)
2026-11-07T03:23:38Z [load_day 2026-11-04] 2026-11-04 hour 15: 4297 events in 1 files, snapshot 7089542061534244881 (task 786 ms: download 76 ms overlapping gunzip 37 ms, parse 102 ms, sort 4 ms, write 367 ms, index 77 ms: 2 candidates, 3900 repo-hours, 229 releases; waiting 15 ms; commit 379 ms)
2026-11-07T03:23:39Z [load_day 2026-11-04] 2026-11-04 hour 16: 4046 events in 1 files, snapshot 757212102355863464 (task 707 ms: download 78 ms overlapping gunzip 39 ms, parse 94 ms, sort 4 ms, write 306 ms, index 52 ms: 2 candidates, 3647 repo-hours, 180 releases; waiting 17 ms; commit 575 ms)
2026-11-07T03:23:40Z [load_day 2026-11-04] 2026-11-04 hour 17: 3909 events in 1 files, snapshot 7425022272081675962 (task 739 ms: download 71 ms overlapping gunzip 36 ms, parse 95 ms, sort 5 ms, write 363 ms, index 44 ms: 0 candidates, 3491 repo-hours, 128 releases; waiting 15 ms; commit 594 ms)
2026-11-07T03:23:40Z [load_day 2026-11-04] 2026-11-04 hour 18: 3903 events in 1 files, snapshot 2837823927384337913 (task 753 ms: download 81 ms overlapping gunzip 35 ms, parse 92 ms, sort 4 ms, write 352 ms, index 52 ms: 3 candidates, 3473 repo-hours, 158 releases; waiting 17 ms; commit 537 ms)
2026-11-07T03:23:41Z [load_day 2026-11-04] 2026-11-04 hour 19: 3803 events in 1 files, snapshot 4651262690806237250 (task 720 ms: download 74 ms overlapping gunzip 33 ms, parse 85 ms, sort 3 ms, write 309 ms, index 62 ms: 1 candidates, 3432 repo-hours, 149 releases; waiting 16 ms; commit 508 ms)
2026-11-07T03:23:42Z [load_day 2026-11-04] 2026-11-04 hour 20: 3946 events in 1 files, snapshot 5329736423036969591 (task 725 ms: download 76 ms overlapping gunzip 38 ms, parse 93 ms, sort 4 ms, write 340 ms, index 49 ms: 1 candidates, 3497 repo-hours, 154 releases; waiting 14 ms; commit 542 ms)
2026-11-07T03:23:42Z [load_day 2026-11-04] 2026-11-04 hour 21: 3795 events in 1 files, snapshot 7819523537329973567 (task 686 ms: download 78 ms overlapping gunzip 33 ms, parse 84 ms, sort 3 ms, write 313 ms, index 39 ms: 0 candidates, 3377 repo-hours, 161 releases; waiting 16 ms; commit 385 ms)
2026-11-07T03:23:43Z [load_day 2026-11-04] 2026-11-04 hour 22: 12078 events in 1 files, snapshot 5565458739828612252 (task 993 ms: download 91 ms overlapping gunzip 48 ms, parse 132 ms, sort 7 ms, write 506 ms, index 90 ms: 2 candidates, 10031 repo-hours, 166 releases; waiting 15 ms; commit 583 ms)
2026-11-07T03:23:44Z [load_day 2026-11-04] 2026-11-04 hour 23: 15418 events in 1 files, snapshot 7746161053465197917 (task 1003 ms: download 126 ms overlapping gunzip 53 ms, parse 147 ms, sort 16 ms, write 481 ms, index 89 ms: 0 candidates, 12538 repo-hours, 152 releases; waiting 28 ms; commit 590 ms)
2026-11-07T03:23:45Z [load_day 2026-11-04] 2026-11-04: repo_hour merged from 24 files to 1 (106131 rows, 1529 ms)
2026-11-07T03:23:47Z [load_day 2026-11-04] 2026-11-04: index committed in 2973 ms (11 + 1 + 24 files)
2026-11-07T03:23:47Z [load_day 2026-11-04] 2026-11-04: 121887 events in 24 hours
2026-11-07T03:23:47Z [load_day 2026-11-04] attempt 1 succeeded