load_day 2026-11-12, attempt 1 succeeded

Rerun from here

Log in to rerun from here

Host

33123af042ba:37850

Started

2026-11-13T02:00:01Z

Ended

2026-11-13T02:00:17Z

Peak memory?The most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗

253 MB

CPU used?The CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗

10.1 s, up to 1.1 cores at once

Log file

s3://census-mlake-dev/logs/gharchive/5799/load_day/2026-11-12/1.log

Code

pipelines/gharchive.mojo:151↗

2026-11-13T02:00:01Z [load_day 2026-11-12] attempt 1 started
2026-11-13T02:00:02Z [load_day 2026-11-12] 2026-11-12: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-13T02:00:03Z [load_day 2026-11-12] 2026-11-12 hour 0: 4172 events in 0 files, snapshot none (task 450 ms: download 86 ms overlapping gunzip 43 ms, parse 110 ms, sort 0 ms, write 0 ms, index 56 ms: 0 candidates, 3607 repo-hours, 151 releases; waiting 10 ms; commit 0 ms)
2026-11-13T02:00:03Z [load_day 2026-11-12] 2026-11-12 hour 1: 4157 events in 0 files, snapshot none (task 300 ms: download 91 ms overlapping gunzip 42 ms, parse 109 ms, sort 0 ms, write 0 ms, index 57 ms: 0 candidates, 3629 repo-hours, 148 releases; waiting 12 ms; commit 0 ms)
2026-11-13T02:00:04Z [load_day 2026-11-12] 2026-11-12 hour 2: 14766 events in 0 files, snapshot none (task 387 ms: download 95 ms overlapping gunzip 51 ms, parse 143 ms, sort 0 ms, write 0 ms, index 128 ms: 2 candidates, 12048 repo-hours, 230 releases; waiting 6 ms; commit 0 ms)
2026-11-13T02:00:04Z [load_day 2026-11-12] 2026-11-12 hour 3: 14762 events in 0 files, snapshot none (task 433 ms: download 104 ms overlapping gunzip 53 ms, parse 146 ms, sort 0 ms, write 0 ms, index 136 ms: 2 candidates, 11897 repo-hours, 203 releases; waiting 11 ms; commit 0 ms)
2026-11-13T02:00:05Z [load_day 2026-11-12] 2026-11-12 hour 4: 9589 events in 0 files, snapshot none (task 333 ms: download 116 ms overlapping gunzip 50 ms, parse 134 ms, sort 0 ms, write 0 ms, index 71 ms: 0 candidates, 8152 repo-hours, 218 releases; waiting 12 ms; commit 0 ms)
2026-11-13T02:00:05Z [load_day 2026-11-12] 2026-11-12 hour 5: 5328 events in 0 files, snapshot none (task 302 ms: download 91 ms overlapping gunzip 45 ms, parse 124 ms, sort 0 ms, write 0 ms, index 56 ms: 0 candidates, 4734 repo-hours, 249 releases; waiting 14 ms; commit 0 ms)
2026-11-13T02:00:06Z [load_day 2026-11-12] 2026-11-12 hour 6: 3942 events in 0 files, snapshot none (task 279 ms: download 77 ms overlapping gunzip 36 ms, parse 92 ms, sort 0 ms, write 0 ms, index 76 ms: 2 candidates, 3504 repo-hours, 239 releases; waiting 18 ms; commit 0 ms)
2026-11-13T02:00:06Z [load_day 2026-11-12] 2026-11-12 hour 7: 3861 events in 0 files, snapshot none (task 262 ms: download 102 ms overlapping gunzip 34 ms, parse 87 ms, sort 0 ms, write 0 ms, index 46 ms: 0 candidates, 3490 repo-hours, 268 releases; waiting 15 ms; commit 0 ms)
2026-11-13T02:00:07Z [load_day 2026-11-12] 2026-11-12 hour 8: 3980 events in 0 files, snapshot none (task 313 ms: download 69 ms overlapping gunzip 38 ms, parse 99 ms, sort 0 ms, write 0 ms, index 72 ms: 1 candidates, 3598 repo-hours, 305 releases; waiting 16 ms; commit 0 ms)
2026-11-13T02:00:07Z [load_day 2026-11-12] 2026-11-12 hour 9: 3754 events in 0 files, snapshot none (task 271 ms: download 60 ms overlapping gunzip 35 ms, parse 91 ms, sort 0 ms, write 0 ms, index 71 ms: 3 candidates, 3413 repo-hours, 293 releases; waiting 16 ms; commit 0 ms)
2026-11-13T02:00:08Z [load_day 2026-11-12] 2026-11-12 hour 10: 3637 events in 0 files, snapshot none (task 219 ms: download 56 ms overlapping gunzip 29 ms, parse 77 ms, sort 0 ms, write 0 ms, index 52 ms: 1 candidates, 3317 repo-hours, 297 releases; waiting 15 ms; commit 0 ms)
2026-11-13T02:00:08Z [load_day 2026-11-12] 2026-11-12 hour 11: 3307 events in 0 files, snapshot none (task 213 ms: download 55 ms overlapping gunzip 23 ms, parse 66 ms, sort 0 ms, write 0 ms, index 40 ms: 0 candidates, 3041 repo-hours, 242 releases; waiting 18 ms; commit 0 ms)
2026-11-13T02:00:09Z [load_day 2026-11-12] 2026-11-12 hour 12: 3404 events in 0 files, snapshot none (task 230 ms: download 56 ms overlapping gunzip 24 ms, parse 68 ms, sort 0 ms, write 0 ms, index 62 ms: 0 candidates, 3113 repo-hours, 244 releases; waiting 17 ms; commit 0 ms)
2026-11-13T02:00:09Z [load_day 2026-11-12] 2026-11-12 hour 13: 3779 events in 0 files, snapshot none (task 218 ms: download 67 ms overlapping gunzip 26 ms, parse 77 ms, sort 0 ms, write 0 ms, index 38 ms: 0 candidates, 3458 repo-hours, 281 releases; waiting 19 ms; commit 0 ms)
2026-11-13T02:00:10Z [load_day 2026-11-12] 2026-11-12 hour 14: 3524 events in 0 files, snapshot none (task 240 ms: download 71 ms overlapping gunzip 25 ms, parse 72 ms, sort 0 ms, write 0 ms, index 61 ms: 0 candidates, 3211 repo-hours, 270 releases; waiting 18 ms; commit 0 ms)
2026-11-13T02:00:10Z [load_day 2026-11-12] 2026-11-12 hour 15: 3785 events in 0 files, snapshot none (task 224 ms: download 48 ms overlapping gunzip 26 ms, parse 71 ms, sort 0 ms, write 0 ms, index 50 ms: 1 candidates, 3490 repo-hours, 266 releases; waiting 16 ms; commit 0 ms)
2026-11-13T02:00:11Z [load_day 2026-11-12] 2026-11-12 hour 16: 2874 events in 0 files, snapshot none (task 221 ms: download 42 ms overlapping gunzip 19 ms, parse 50 ms, sort 0 ms, write 0 ms, index 67 ms: 0 candidates, 2647 repo-hours, 121 releases; waiting 16 ms; commit 0 ms)
2026-11-13T02:00:11Z [load_day 2026-11-12] 2026-11-12 hour 17: 3014 events in 0 files, snapshot none (task 193 ms: download 52 ms overlapping gunzip 23 ms, parse 60 ms, sort 0 ms, write 0 ms, index 31 ms: 0 candidates, 2792 repo-hours, 139 releases; waiting 19 ms; commit 0 ms)
2026-11-13T02:00:11Z [load_day 2026-11-12] 2026-11-12 hour 18: 3572 events in 0 files, snapshot none (task 215 ms: download 65 ms overlapping gunzip 30 ms, parse 73 ms, sort 0 ms, write 0 ms, index 36 ms: 0 candidates, 3230 repo-hours, 150 releases; waiting 19 ms; commit 0 ms)
2026-11-13T02:00:11Z [load_day 2026-11-12] 2026-11-12 hour 19: 3300 events in 0 files, snapshot none (task 209 ms: download 51 ms overlapping gunzip 25 ms, parse 65 ms, sort 0 ms, write 0 ms, index 49 ms: 1 candidates, 3004 repo-hours, 149 releases; waiting 15 ms; commit 0 ms)
2026-11-13T02:00:12Z [load_day 2026-11-12] 2026-11-12 hour 20: 3705 events in 0 files, snapshot none (task 281 ms: download 78 ms overlapping gunzip 33 ms, parse 87 ms, sort 0 ms, write 0 ms, index 71 ms: 1 candidates, 3356 repo-hours, 159 releases; waiting 17 ms; commit 0 ms)
2026-11-13T02:00:12Z [load_day 2026-11-12] 2026-11-12 hour 21: 3530 events in 0 files, snapshot none (task 251 ms: download 75 ms overlapping gunzip 35 ms, parse 86 ms, sort 0 ms, write 0 ms, index 55 ms: 1 candidates, 3171 repo-hours, 132 releases; waiting 16 ms; commit 0 ms)
2026-11-13T02:00:13Z [load_day 2026-11-12] 2026-11-12 hour 22: 3752 events in 0 files, snapshot none (task 261 ms: download 79 ms overlapping gunzip 37 ms, parse 87 ms, sort 0 ms, write 0 ms, index 64 ms: 1 candidates, 3339 repo-hours, 137 releases; waiting 18 ms; commit 0 ms)
2026-11-13T02:00:13Z [load_day 2026-11-12] 2026-11-12 hour 23: 10828 events in 0 files, snapshot none (task 313 ms: download 91 ms overlapping gunzip 49 ms, parse 116 ms, sort 0 ms, write 0 ms, index 72 ms: 0 candidates, 8897 repo-hours, 120 releases; waiting 21 ms; commit 0 ms)
2026-11-13T02:00:14Z [load_day 2026-11-12] 2026-11-12: repo_hour merged from 24 files to 1 (108138 rows, 1469 ms)
2026-11-13T02:00:16Z [load_day 2026-11-12] 2026-11-12: index committed in 3613 ms (11 + 1 + 24 files)
2026-11-13T02:00:16Z [load_day 2026-11-12] 2026-11-12: 124322 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-13T02:00:16Z [load_day 2026-11-12] attempt 1 succeeded