load_day 2026-11-08, attempt 10 succeeded

Rerun from here

Log in to rerun from here

Host

9a1fd9064689:3403

Started

2026-11-09T00:08:49Z

Ended

2026-11-09T00:09:04Z

Peak memory?The most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗

244 MB

CPU used?The CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗

10.7 s, up to 1.2 cores at once

Log file

s3://census-mlake-dev/logs/gharchive/5172/load_day/2026-11-08/10.log

Code

pipelines/gharchive.mojo:151↗

Attempts

1 failed 211 MB · 2 failed 215 MB · 3 failed 220 MB · 4 failed 226 MB · 5 failed 216 MB · 6 failed 219 MB · 7 failed 226 MB · 8 failed 216 MB · 9 failed 217 MB · 10 succeeded 244 MB

2026-11-09T00:08:49Z [load_day 2026-11-08] attempt 10 started
2026-11-09T00:08:50Z [load_day 2026-11-08] 2026-11-08: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-09T00:08:51Z [load_day 2026-11-08] 2026-11-08 hour 0: 3609 events in 0 files, snapshot none (task 296 ms: download 99 ms overlapping gunzip 39 ms, parse 98 ms, sort 0 ms, write 0 ms, index 83 ms: 0 candidates, 3092 repo-hours, 124 releases; waiting 11 ms; commit 0 ms)
2026-11-09T00:08:51Z [load_day 2026-11-08] 2026-11-08 hour 1: 3338 events in 0 files, snapshot none (task 280 ms: download 74 ms overlapping gunzip 35 ms, parse 89 ms, sort 0 ms, write 0 ms, index 57 ms: 1 candidates, 2878 repo-hours, 126 releases; waiting 10 ms; commit 0 ms)
2026-11-09T00:08:52Z [load_day 2026-11-08] 2026-11-08 hour 2: 3358 events in 0 files, snapshot none (task 237 ms: download 84 ms overlapping gunzip 36 ms, parse 94 ms, sort 0 ms, write 0 ms, index 36 ms: 0 candidates, 2886 repo-hours, 130 releases; waiting 11 ms; commit 0 ms)
2026-11-09T00:08:52Z [load_day 2026-11-08] 2026-11-08 hour 3: 3546 events in 0 files, snapshot none (task 275 ms: download 87 ms overlapping gunzip 54 ms, parse 109 ms, sort 0 ms, write 0 ms, index 42 ms: 0 candidates, 3042 repo-hours, 164 releases; waiting 16 ms; commit 0 ms)
2026-11-09T00:08:53Z [load_day 2026-11-08] 2026-11-08 hour 4: 3531 events in 0 files, snapshot none (task 236 ms: download 82 ms overlapping gunzip 37 ms, parse 85 ms, sort 0 ms, write 0 ms, index 42 ms: 0 candidates, 3005 repo-hours, 154 releases; waiting 16 ms; commit 0 ms)
2026-11-09T00:08:53Z [load_day 2026-11-08] 2026-11-08 hour 5: 3548 events in 0 files, snapshot none (task 305 ms: download 100 ms overlapping gunzip 42 ms, parse 94 ms, sort 0 ms, write 0 ms, index 96 ms: 1 candidates, 2983 repo-hours, 147 releases; waiting 19 ms; commit 0 ms)
2026-11-09T00:08:54Z [load_day 2026-11-08] 2026-11-08 hour 6: 3449 events in 0 files, snapshot none (task 252 ms: download 89 ms overlapping gunzip 37 ms, parse 88 ms, sort 0 ms, write 0 ms, index 47 ms: 0 candidates, 2928 repo-hours, 153 releases; waiting 17 ms; commit 0 ms)
2026-11-09T00:08:54Z [load_day 2026-11-08] 2026-11-08 hour 7: 3351 events in 0 files, snapshot none (task 328 ms: download 82 ms overlapping gunzip 40 ms, parse 94 ms, sort 0 ms, write 0 ms, index 117 ms: 1 candidates, 2894 repo-hours, 144 releases; waiting 19 ms; commit 0 ms)
2026-11-09T00:08:54Z [load_day 2026-11-08] 2026-11-08 hour 8: 3013 events in 0 files, snapshot none (task 297 ms: download 65 ms overlapping gunzip 35 ms, parse 85 ms, sort 0 ms, write 0 ms, index 102 ms: 0 candidates, 2590 repo-hours, 114 releases; waiting 17 ms; commit 0 ms)
2026-11-09T00:08:54Z [load_day 2026-11-08] 2026-11-08 hour 9: 3027 events in 0 files, snapshot none (task 245 ms: download 72 ms overlapping gunzip 35 ms, parse 77 ms, sort 0 ms, write 0 ms, index 53 ms: 1 candidates, 2611 repo-hours, 112 releases; waiting 20 ms; commit 0 ms)
2026-11-09T00:08:55Z [load_day 2026-11-08] 2026-11-08 hour 10: 3016 events in 0 files, snapshot none (task 285 ms: download 99 ms overlapping gunzip 33 ms, parse 74 ms, sort 0 ms, write 0 ms, index 98 ms: 1 candidates, 2676 repo-hours, 132 releases; waiting 16 ms; commit 0 ms)
2026-11-09T00:08:55Z [load_day 2026-11-08] 2026-11-08 hour 11: 4260 events in 0 files, snapshot none (task 263 ms: download 79 ms overlapping gunzip 45 ms, parse 87 ms, sort 0 ms, write 0 ms, index 60 ms: 2 candidates, 3813 repo-hours, 141 releases; waiting 15 ms; commit 0 ms)
2026-11-09T00:08:56Z [load_day 2026-11-08] 2026-11-08 hour 12: 5756 events in 0 files, snapshot none (task 292 ms: download 111 ms overlapping gunzip 50 ms, parse 117 ms, sort 0 ms, write 0 ms, index 57 ms: 0 candidates, 5058 repo-hours, 185 releases; waiting 7 ms; commit 0 ms)
2026-11-09T00:08:56Z [load_day 2026-11-08] 2026-11-08 hour 13: 6402 events in 0 files, snapshot none (task 290 ms: download 75 ms overlapping gunzip 42 ms, parse 97 ms, sort 0 ms, write 0 ms, index 83 ms: 3 candidates, 5603 repo-hours, 155 releases; waiting 11 ms; commit 0 ms)
2026-11-09T00:08:57Z [load_day 2026-11-08] 2026-11-08 hour 14: 7881 events in 0 files, snapshot none (task 311 ms: download 75 ms overlapping gunzip 41 ms, parse 100 ms, sort 0 ms, write 0 ms, index 81 ms: 6 candidates, 6812 repo-hours, 140 releases; waiting 16 ms; commit 0 ms)
2026-11-09T00:08:57Z [load_day 2026-11-08] 2026-11-08 hour 15: 7899 events in 0 files, snapshot none (task 316 ms: download 82 ms overlapping gunzip 44 ms, parse 105 ms, sort 0 ms, write 0 ms, index 86 ms: 0 candidates, 6860 repo-hours, 144 releases; waiting 19 ms; commit 0 ms)
2026-11-09T00:08:58Z [load_day 2026-11-08] 2026-11-08 hour 16: 7450 events in 0 files, snapshot none (task 452 ms: download 80 ms overlapping gunzip 46 ms, parse 112 ms, sort 0 ms, write 0 ms, index 90 ms: 2 candidates, 6508 repo-hours, 120 releases; waiting 14 ms; commit 0 ms)
2026-11-09T00:08:58Z [load_day 2026-11-08] 2026-11-08 hour 17: 7651 events in 0 files, snapshot none (task 426 ms: download 88 ms overlapping gunzip 41 ms, parse 101 ms, sort 0 ms, write 0 ms, index 70 ms: 0 candidates, 6713 repo-hours, 127 releases; waiting 19 ms; commit 0 ms)
2026-11-09T00:08:58Z [load_day 2026-11-08] 2026-11-08 hour 18: 7589 events in 0 files, snapshot none (task 290 ms: download 81 ms overlapping gunzip 43 ms, parse 101 ms, sort 0 ms, write 0 ms, index 55 ms: 0 candidates, 6427 repo-hours, 132 releases; waiting 18 ms; commit 0 ms)
2026-11-09T00:08:58Z [load_day 2026-11-08] 2026-11-08 hour 19: 6179 events in 0 files, snapshot none (task 264 ms: download 96 ms overlapping gunzip 38 ms, parse 92 ms, sort 0 ms, write 0 ms, index 65 ms: 1 candidates, 5412 repo-hours, 116 releases; waiting 17 ms; commit 0 ms)
2026-11-09T00:08:59Z [load_day 2026-11-08] 2026-11-08 hour 20: 5592 events in 0 files, snapshot none (task 297 ms: download 105 ms overlapping gunzip 41 ms, parse 97 ms, sort 0 ms, write 0 ms, index 89 ms: 3 candidates, 4961 repo-hours, 135 releases; waiting 20 ms; commit 0 ms)
2026-11-09T00:08:59Z [load_day 2026-11-08] 2026-11-08 hour 21: 5532 events in 0 files, snapshot none (task 403 ms: download 75 ms overlapping gunzip 35 ms, parse 79 ms, sort 0 ms, write 0 ms, index 82 ms: 1 candidates, 4861 repo-hours, 120 releases; waiting 21 ms; commit 0 ms)
2026-11-09T00:09:00Z [load_day 2026-11-08] 2026-11-08 hour 22: 5895 events in 0 files, snapshot none (task 313 ms: download 91 ms overlapping gunzip 40 ms, parse 93 ms, sort 0 ms, write 0 ms, index 103 ms: 7 candidates, 5033 repo-hours, 117 releases; waiting 17 ms; commit 0 ms)
2026-11-09T00:09:00Z [load_day 2026-11-08] 2026-11-08 hour 23: 6480 events in 0 files, snapshot none (task 284 ms: download 88 ms overlapping gunzip 44 ms, parse 99 ms, sort 0 ms, write 0 ms, index 62 ms: 2 candidates, 5511 repo-hours, 116 releases; waiting 20 ms; commit 0 ms)
2026-11-09T00:09:02Z [load_day 2026-11-08] 2026-11-08: repo_hour merged from 24 files to 1 (105157 rows, 1721 ms)
2026-11-09T00:09:04Z [load_day 2026-11-08] 2026-11-08: index committed in 3946 ms (14 + 1 + 24 files)
2026-11-09T00:09:04Z [load_day 2026-11-08] 2026-11-08: 121352 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-09T00:09:04Z [load_day 2026-11-08] attempt 10 succeeded