load_day 2026-11-08, attempt 1 succeeded

Rerun from here

Log in to rerun from here

Host

65cb4f3217dd:3171

Started

2026-11-09T03:00:00Z

Ended

2026-11-09T03:00:21Z

Peak memory?The most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗

266 MB

CPU used?The CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗

11.5 s, up to 1.2 cores at once

Log file

s3://census-mlake-dev/logs/gharchive/5177/load_day/2026-11-08/1.log

Code

pipelines/gharchive.mojo:151↗

2026-11-09T03:00:00Z [load_day 2026-11-08] attempt 1 started
2026-11-09T03:00:02Z [load_day 2026-11-08] 2026-11-08: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-09T03:00:03Z [load_day 2026-11-08] 2026-11-08 hour 0: 3609 events in 0 files, snapshot none (task 318 ms: download 94 ms overlapping gunzip 46 ms, parse 111 ms, sort 0 ms, write 0 ms, index 45 ms: 0 candidates, 3092 repo-hours, 124 releases; waiting 11 ms; commit 0 ms)
2026-11-09T03:00:03Z [load_day 2026-11-08] 2026-11-08 hour 1: 3338 events in 0 files, snapshot none (task 294 ms: download 130 ms overlapping gunzip 36 ms, parse 98 ms, sort 0 ms, write 0 ms, index 73 ms: 1 candidates, 2878 repo-hours, 126 releases; waiting 24 ms; commit 0 ms)
2026-11-09T03:00:04Z [load_day 2026-11-08] 2026-11-08 hour 2: 3358 events in 0 files, snapshot none (task 267 ms: download 91 ms overlapping gunzip 36 ms, parse 101 ms, sort 0 ms, write 0 ms, index 60 ms: 0 candidates, 2886 repo-hours, 130 releases; waiting 13 ms; commit 0 ms)
2026-11-09T03:00:04Z [load_day 2026-11-08] 2026-11-08 hour 3: 3546 events in 0 files, snapshot none (task 296 ms: download 100 ms overlapping gunzip 37 ms, parse 112 ms, sort 0 ms, write 0 ms, index 63 ms: 0 candidates, 3042 repo-hours, 164 releases; waiting 16 ms; commit 0 ms)
2026-11-09T03:00:04Z [load_day 2026-11-08] 2026-11-08 hour 4: 3531 events in 0 files, snapshot none (task 284 ms: download 74 ms overlapping gunzip 41 ms, parse 96 ms, sort 0 ms, write 0 ms, index 77 ms: 0 candidates, 3005 repo-hours, 154 releases; waiting 9 ms; commit 0 ms)
2026-11-09T03:00:05Z [load_day 2026-11-08] 2026-11-08 hour 5: 3548 events in 0 files, snapshot none (task 300 ms: download 88 ms overlapping gunzip 37 ms, parse 90 ms, sort 0 ms, write 0 ms, index 79 ms: 1 candidates, 2983 repo-hours, 147 releases; waiting 21 ms; commit 0 ms)
2026-11-09T03:00:05Z [load_day 2026-11-08] 2026-11-08 hour 6: 3449 events in 0 files, snapshot none (task 315 ms: download 87 ms overlapping gunzip 40 ms, parse 100 ms, sort 0 ms, write 0 ms, index 87 ms: 0 candidates, 2928 repo-hours, 153 releases; waiting 18 ms; commit 0 ms)
2026-11-09T03:00:06Z [load_day 2026-11-08] 2026-11-08 hour 7: 3351 events in 0 files, snapshot none (task 292 ms: download 79 ms overlapping gunzip 48 ms, parse 99 ms, sort 0 ms, write 0 ms, index 67 ms: 1 candidates, 2894 repo-hours, 144 releases; waiting 20 ms; commit 0 ms)
2026-11-09T03:00:06Z [load_day 2026-11-08] 2026-11-08 hour 8: 3013 events in 0 files, snapshot none (task 205 ms: download 65 ms overlapping gunzip 32 ms, parse 73 ms, sort 0 ms, write 0 ms, index 39 ms: 0 candidates, 2590 repo-hours, 114 releases; waiting 15 ms; commit 0 ms)
2026-11-09T03:00:07Z [load_day 2026-11-08] 2026-11-08 hour 9: 3027 events in 0 files, snapshot none (task 231 ms: download 66 ms overlapping gunzip 32 ms, parse 75 ms, sort 0 ms, write 0 ms, index 43 ms: 1 candidates, 2611 repo-hours, 112 releases; waiting 17 ms; commit 0 ms)
2026-11-09T03:00:07Z [load_day 2026-11-08] 2026-11-08 hour 10: 3016 events in 0 files, snapshot none (task 306 ms: download 72 ms overlapping gunzip 44 ms, parse 92 ms, sort 0 ms, write 0 ms, index 77 ms: 1 candidates, 2676 repo-hours, 132 releases; waiting 20 ms; commit 0 ms)
2026-11-09T03:00:07Z [load_day 2026-11-08] 2026-11-08 hour 11: 4260 events in 0 files, snapshot none (task 318 ms: download 74 ms overlapping gunzip 42 ms, parse 80 ms, sort 0 ms, write 0 ms, index 110 ms: 2 candidates, 3813 repo-hours, 141 releases; waiting 18 ms; commit 0 ms)
2026-11-09T03:00:08Z [load_day 2026-11-08] 2026-11-08 hour 12: 5756 events in 0 files, snapshot none (task 275 ms: download 82 ms overlapping gunzip 35 ms, parse 88 ms, sort 0 ms, write 0 ms, index 61 ms: 0 candidates, 5058 repo-hours, 185 releases; waiting 21 ms; commit 0 ms)
2026-11-09T03:00:08Z [load_day 2026-11-08] 2026-11-08 hour 13: 6402 events in 0 files, snapshot none (task 331 ms: download 93 ms overlapping gunzip 46 ms, parse 117 ms, sort 0 ms, write 0 ms, index 93 ms: 3 candidates, 5603 repo-hours, 155 releases; waiting 12 ms; commit 0 ms)
2026-11-09T03:00:09Z [load_day 2026-11-08] 2026-11-08 hour 14: 7881 events in 0 files, snapshot none (task 321 ms: download 90 ms overlapping gunzip 42 ms, parse 98 ms, sort 0 ms, write 0 ms, index 91 ms: 6 candidates, 6812 repo-hours, 140 releases; waiting 26 ms; commit 0 ms)
2026-11-09T03:00:09Z [load_day 2026-11-08] 2026-11-08 hour 15: 7899 events in 0 files, snapshot none (task 291 ms: download 85 ms overlapping gunzip 43 ms, parse 99 ms, sort 0 ms, write 0 ms, index 68 ms: 0 candidates, 6860 repo-hours, 144 releases; waiting 19 ms; commit 0 ms)
2026-11-09T03:00:10Z [load_day 2026-11-08] 2026-11-08 hour 16: 7450 events in 0 files, snapshot none (task 311 ms: download 96 ms overlapping gunzip 38 ms, parse 103 ms, sort 0 ms, write 0 ms, index 94 ms: 2 candidates, 6508 repo-hours, 120 releases; waiting 17 ms; commit 0 ms)
2026-11-09T03:00:10Z [load_day 2026-11-08] 2026-11-08 hour 17: 7651 events in 0 files, snapshot none (task 329 ms: download 95 ms overlapping gunzip 41 ms, parse 101 ms, sort 0 ms, write 0 ms, index 98 ms: 0 candidates, 6713 repo-hours, 127 releases; waiting 22 ms; commit 0 ms)
2026-11-09T03:00:11Z [load_day 2026-11-08] 2026-11-08 hour 18: 7589 events in 0 files, snapshot none (task 291 ms: download 92 ms overlapping gunzip 47 ms, parse 115 ms, sort 0 ms, write 0 ms, index 58 ms: 0 candidates, 6427 repo-hours, 132 releases; waiting 16 ms; commit 0 ms)
2026-11-09T03:00:11Z [load_day 2026-11-08] 2026-11-08 hour 19: 6179 events in 0 files, snapshot none (task 273 ms: download 84 ms overlapping gunzip 38 ms, parse 92 ms, sort 0 ms, write 0 ms, index 70 ms: 1 candidates, 5412 repo-hours, 116 releases; waiting 16 ms; commit 0 ms)
2026-11-09T03:00:12Z [load_day 2026-11-08] 2026-11-08 hour 20: 5592 events in 0 files, snapshot none (task 337 ms: download 78 ms overlapping gunzip 39 ms, parse 94 ms, sort 0 ms, write 0 ms, index 123 ms: 3 candidates, 4961 repo-hours, 135 releases; waiting 18 ms; commit 0 ms)
2026-11-09T03:00:12Z [load_day 2026-11-08] 2026-11-08 hour 21: 5532 events in 0 files, snapshot none (task 264 ms: download 68 ms overlapping gunzip 33 ms, parse 79 ms, sort 0 ms, write 0 ms, index 75 ms: 1 candidates, 4861 repo-hours, 120 releases; waiting 16 ms; commit 0 ms)
2026-11-09T03:00:13Z [load_day 2026-11-08] 2026-11-08 hour 22: 5895 events in 0 files, snapshot none (task 275 ms: download 92 ms overlapping gunzip 39 ms, parse 94 ms, sort 0 ms, write 0 ms, index 61 ms: 7 candidates, 5033 repo-hours, 117 releases; waiting 19 ms; commit 0 ms)
2026-11-09T03:00:13Z [load_day 2026-11-08] 2026-11-08 hour 23: 6480 events in 0 files, snapshot none (task 267 ms: download 84 ms overlapping gunzip 38 ms, parse 93 ms, sort 0 ms, write 0 ms, index 62 ms: 2 candidates, 5511 repo-hours, 116 releases; waiting 19 ms; commit 0 ms)
2026-11-09T03:00:14Z [load_day 2026-11-08] 2026-11-08: repo_hour merged from 24 files to 1 (105157 rows, 1576 ms)
2026-11-09T03:00:21Z [load_day 2026-11-08] 2026-11-08: index committed in 8204 ms (14 + 1 + 24 files)
2026-11-09T03:00:21Z [load_day 2026-11-08] 2026-11-08: 121352 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-09T03:00:21Z [load_day 2026-11-08] attempt 1 succeeded