orcaLog in

Runs · run 1761

load_day 2026-11-07, attempt 1 succeeded

Host
3c2b29713ce8:577557
Started
2026-11-08T03:00:00Z
Ended
2026-11-08T03:02:27Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1761/load_day/2026-11-07/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T03:00:00Z [load_day 2026-11-07] attempt 1 started
2026-11-08T03:00:02Z [load_day 2026-11-07] 2026-11-07: 2 hours in flight, about 1200 MB
2026-11-08T03:00:11Z [load_day 2026-11-07] 2026-11-07 hour 0: 4388 events in 1 files, snapshot 1978643681454843552 (task 2061 ms: download 320 ms overlapping gunzip 177 ms, parse 452 ms, sort 1 ms, write 1209 ms, index 121 ms: 0 candidates, 3720 repo-hours, 156 releases; waiting 30 ms; commit 5298 ms)
2026-11-08T03:00:18Z [load_day 2026-11-07] 2026-11-07 hour 1: 4533 events in 1 files, snapshot 1326657041236818453 (task 2017 ms: download 388 ms overlapping gunzip 133 ms, parse 378 ms, sort 1 ms, write 1326 ms, index 58 ms: 0 candidates, 3814 repo-hours, 171 releases; waiting 23 ms; commit 6470 ms)
2026-11-08T03:00:23Z [load_day 2026-11-07] 2026-11-07 hour 2: 4213 events in 1 files, snapshot 7121291865037305909 (task 1832 ms: download 346 ms overlapping gunzip 120 ms, parse 267 ms, sort 3 ms, write 1250 ms, index 88 ms: 0 candidates, 3584 repo-hours, 164 releases; waiting 31 ms; commit 5290 ms)
2026-11-08T03:00:36Z [load_day 2026-11-07] 2026-11-07 hour 3: 4244 events in 1 files, snapshot 3126380397932583264 (task 1506 ms: download 268 ms overlapping gunzip 118 ms, parse 292 ms, sort 0 ms, write 945 ms, index 64 ms: 1 candidates, 3594 repo-hours, 200 releases; waiting 18 ms; commit 13349 ms)
2026-11-08T03:00:39Z [load_day 2026-11-07] 2026-11-07 hour 4: 4249 events in 1 files, snapshot 6355193374220655904 (task 2003 ms: download 274 ms overlapping gunzip 96 ms, parse 226 ms, sort 1 ms, write 1477 ms, index 102 ms: 1 candidates, 3596 repo-hours, 186 releases; waiting 45 ms; commit 2830 ms)
2026-11-08T03:00:42Z [load_day 2026-11-07] 2026-11-07 hour 5: 4218 events in 1 files, snapshot 4510056411251672325 (task 1466 ms: download 307 ms overlapping gunzip 102 ms, parse 239 ms, sort 0 ms, write 956 ms, index 73 ms: 2 candidates, 3611 repo-hours, 179 releases; waiting 25 ms; commit 3259 ms)
2026-11-08T03:00:48Z [load_day 2026-11-07] 2026-11-07 hour 6: 3932 events in 1 files, snapshot 5394587330843997648 (task 1299 ms: download 162 ms overlapping gunzip 61 ms, parse 132 ms, sort 0 ms, write 962 ms, index 57 ms: 0 candidates, 3356 repo-hours, 196 releases; waiting 19 ms; commit 5621 ms)
2026-11-08T03:00:53Z [load_day 2026-11-07] 2026-11-07 hour 7: 3859 events in 1 files, snapshot 505894026528466384 (task 1534 ms: download 175 ms overlapping gunzip 70 ms, parse 167 ms, sort 0 ms, write 1051 ms, index 145 ms: 1 candidates, 3325 repo-hours, 173 releases; waiting 23 ms; commit 5099 ms)
2026-11-08T03:00:58Z [load_day 2026-11-07] 2026-11-07 hour 8: 3963 events in 1 files, snapshot 7354953586826535003 (task 1431 ms: download 148 ms overlapping gunzip 81 ms, parse 200 ms, sort 5 ms, write 1004 ms, index 60 ms: 0 candidates, 3479 repo-hours, 186 releases; waiting 18 ms; commit 5133 ms)
2026-11-08T03:01:05Z [load_day 2026-11-07] 2026-11-07 hour 9: 4203 events in 1 files, snapshot 5626641874929948099 (task 1681 ms: download 202 ms overlapping gunzip 96 ms, parse 272 ms, sort 1 ms, write 1129 ms, index 79 ms: 0 candidates, 3630 repo-hours, 208 releases; waiting 17 ms; commit 6412 ms)
2026-11-08T03:01:26Z [load_day 2026-11-07] 2026-11-07 hour 10: 4147 events in 1 files, snapshot 8381006267382827749 (task 1549 ms: download 157 ms overlapping gunzip 125 ms, parse 268 ms, sort 0 ms, write 967 ms, index 94 ms: 2 candidates, 3605 repo-hours, 175 releases; waiting 20 ms; commit 21159 ms)
2026-11-08T03:01:33Z [load_day 2026-11-07] 2026-11-07 hour 11: 4053 events in 1 files, snapshot 8755002474556462156 (task 1499 ms: download 267 ms overlapping gunzip 94 ms, parse 227 ms, sort 3 ms, write 977 ms, index 65 ms: 0 candidates, 3498 repo-hours, 189 releases; waiting 54 ms; commit 7374 ms)
2026-11-08T03:01:36Z [load_day 2026-11-07] 2026-11-07 hour 12: 4105 events in 1 files, snapshot 4368328064824465878 (task 1746 ms: download 236 ms overlapping gunzip 153 ms, parse 242 ms, sort 0 ms, write 1162 ms, index 83 ms: 0 candidates, 3521 repo-hours, 217 releases; waiting 34 ms; commit 2851 ms)
2026-11-08T03:01:39Z [load_day 2026-11-07] 2026-11-07 hour 13: 3770 events in 1 files, snapshot 1317354617537998210 (task 1215 ms: download 113 ms overlapping gunzip 39 ms, parse 98 ms, sort 0 ms, write 891 ms, index 58 ms: 0 candidates, 3328 repo-hours, 189 releases; waiting 18 ms; commit 2735 ms)
2026-11-08T03:01:41Z [load_day 2026-11-07] 2026-11-07 hour 14: 3690 events in 1 files, snapshot 1398879526025855616 (task 841 ms: download 89 ms overlapping gunzip 48 ms, parse 109 ms, sort 0 ms, write 548 ms, index 46 ms: 0 candidates, 3225 repo-hours, 185 releases; waiting 16 ms; commit 2471 ms)
2026-11-08T03:01:44Z [load_day 2026-11-07] 2026-11-07 hour 15: 3655 events in 1 files, snapshot 2864510070083970700 (task 1089 ms: download 145 ms overlapping gunzip 48 ms, parse 118 ms, sort 0 ms, write 789 ms, index 52 ms: 0 candidates, 3180 repo-hours, 167 releases; waiting 21 ms; commit 3086 ms)
2026-11-08T03:01:48Z [load_day 2026-11-07] 2026-11-07 hour 16: 3482 events in 1 files, snapshot 1817743874396332404 (task 723 ms: download 108 ms overlapping gunzip 32 ms, parse 82 ms, sort 0 ms, write 479 ms, index 61 ms: 0 candidates, 3119 repo-hours, 138 releases; waiting 18 ms; commit 3364 ms)
2026-11-08T03:01:52Z [load_day 2026-11-07] 2026-11-07 hour 17: 3631 events in 1 files, snapshot 3972950333070903588 (task 783 ms: download 95 ms overlapping gunzip 41 ms, parse 111 ms, sort 0 ms, write 483 ms, index 71 ms: 0 candidates, 3239 repo-hours, 153 releases; waiting 19 ms; commit 3861 ms)
2026-11-08T03:01:57Z [load_day 2026-11-07] 2026-11-07 hour 18: 3741 events in 1 files, snapshot 5560853444220508844 (task 1526 ms: download 163 ms overlapping gunzip 76 ms, parse 209 ms, sort 1 ms, write 1058 ms, index 65 ms: 0 candidates, 3252 repo-hours, 148 releases; waiting 20 ms; commit 5809 ms)
2026-11-08T03:02:03Z [load_day 2026-11-07] 2026-11-07 hour 19: 3768 events in 1 files, snapshot 5862804412871829795 (task 1516 ms: download 204 ms overlapping gunzip 114 ms, parse 216 ms, sort 0 ms, write 978 ms, index 95 ms: 1 candidates, 3247 repo-hours, 142 releases; waiting 21 ms; commit 5953 ms)
2026-11-08T03:02:06Z [load_day 2026-11-07] 2026-11-07 hour 20: 3633 events in 1 files, snapshot 4121324895536914746 (task 1255 ms: download 93 ms overlapping gunzip 52 ms, parse 112 ms, sort 0 ms, write 875 ms, index 77 ms: 2 candidates, 3143 repo-hours, 153 releases; waiting 16 ms; commit 2904 ms)
2026-11-08T03:02:12Z [load_day 2026-11-07] 2026-11-07 hour 21: 3617 events in 1 files, snapshot 1087220149474693738 (task 1451 ms: download 190 ms overlapping gunzip 95 ms, parse 209 ms, sort 0 ms, write 953 ms, index 98 ms: 0 candidates, 3173 repo-hours, 151 releases; waiting 25 ms; commit 5699 ms)
2026-11-08T03:02:17Z [load_day 2026-11-07] 2026-11-07 hour 22: 3648 events in 1 files, snapshot 9152512121341130718 (task 1167 ms: download 216 ms overlapping gunzip 87 ms, parse 195 ms, sort 0 ms, write 735 ms, index 36 ms: 0 candidates, 3154 repo-hours, 159 releases; waiting 26 ms; commit 5468 ms)
2026-11-08T03:02:23Z [load_day 2026-11-07] 2026-11-07 hour 23: 3615 events in 1 files, snapshot 8655450187204792388 (task 1269 ms: download 100 ms overlapping gunzip 68 ms, parse 157 ms, sort 0 ms, write 875 ms, index 91 ms: 3 candidates, 3133 repo-hours, 149 releases; waiting 20 ms; commit 5480 ms)
2026-11-08T03:02:25Z [load_day 2026-11-07] 2026-11-07: repo_hour merged from 24 files to 1 (81526 rows, 1592 ms)
2026-11-08T03:02:27Z [load_day 2026-11-07] 2026-11-07: index committed in 4035 ms (8 + 1 + 24 files)
2026-11-08T03:02:27Z [load_day 2026-11-07] 2026-11-07: 94357 events in 24 hours
2026-11-08T03:02:27Z [load_day 2026-11-07] attempt 1 succeeded