load_day 2026-11-12, attempt 1 succeeded

Rerun from here

Log in to rerun from here

Host

33123af042ba:40570

Started

2026-11-13T03:00:00Z

Ended

2026-11-13T03:00:24Z

Peak memory?The most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗

327 MB

CPU used?The CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗

11.1 s, up to 0.9 cores at once

Log file

s3://census-mlake-dev/logs/gharchive/5803/load_day/2026-11-12/1.log

Code

pipelines/gharchive.mojo:151↗

2026-11-13T03:00:00Z [load_day 2026-11-12] attempt 1 started
2026-11-13T03:00:01Z [load_day 2026-11-12] 2026-11-12: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-13T03:00:02Z [load_day 2026-11-12] 2026-11-12 hour 0: 4172 events in 0 files, snapshot none (task 307 ms: download 86 ms overlapping gunzip 45 ms, parse 121 ms, sort 0 ms, write 0 ms, index 70 ms: 0 candidates, 3607 repo-hours, 151 releases; waiting 4 ms; commit 0 ms)
2026-11-13T03:00:03Z [load_day 2026-11-12] 2026-11-12 hour 1: 4157 events in 0 files, snapshot none (task 454 ms: download 96 ms overlapping gunzip 57 ms, parse 117 ms, sort 0 ms, write 0 ms, index 58 ms: 0 candidates, 3629 repo-hours, 148 releases; waiting 13 ms; commit 0 ms)
2026-11-13T03:00:04Z [load_day 2026-11-12] 2026-11-12 hour 2: 14766 events in 0 files, snapshot none (task 594 ms: download 103 ms overlapping gunzip 58 ms, parse 156 ms, sort 0 ms, write 0 ms, index 150 ms: 2 candidates, 12048 repo-hours, 230 releases; waiting 18 ms; commit 0 ms)
2026-11-13T03:00:04Z [load_day 2026-11-12] 2026-11-12 hour 3: 14762 events in 0 files, snapshot none (task 610 ms: download 90 ms overlapping gunzip 49 ms, parse 146 ms, sort 0 ms, write 0 ms, index 116 ms: 2 candidates, 11897 repo-hours, 203 releases; waiting 9 ms; commit 0 ms)
2026-11-13T03:00:05Z [load_day 2026-11-12] 2026-11-12 hour 4: 9589 events in 0 files, snapshot none (task 454 ms: download 92 ms overlapping gunzip 44 ms, parse 120 ms, sort 0 ms, write 0 ms, index 71 ms: 0 candidates, 8152 repo-hours, 218 releases; waiting 11 ms; commit 0 ms)
2026-11-13T03:00:05Z [load_day 2026-11-12] 2026-11-12 hour 5: 5328 events in 0 files, snapshot none (task 438 ms: download 96 ms overlapping gunzip 41 ms, parse 118 ms, sort 0 ms, write 0 ms, index 59 ms: 0 candidates, 4734 repo-hours, 249 releases; waiting 10 ms; commit 0 ms)
2026-11-13T03:00:06Z [load_day 2026-11-12] 2026-11-12 hour 6: 3942 events in 0 files, snapshot none (task 457 ms: download 77 ms overlapping gunzip 41 ms, parse 109 ms, sort 0 ms, write 0 ms, index 58 ms: 2 candidates, 3504 repo-hours, 239 releases; waiting 13 ms; commit 0 ms)
2026-11-13T03:00:06Z [load_day 2026-11-12] 2026-11-12 hour 7: 3861 events in 0 files, snapshot none (task 404 ms: download 67 ms overlapping gunzip 33 ms, parse 86 ms, sort 0 ms, write 0 ms, index 61 ms: 0 candidates, 3490 repo-hours, 268 releases; waiting 17 ms; commit 0 ms)
2026-11-13T03:00:07Z [load_day 2026-11-12] 2026-11-12 hour 8: 3980 events in 0 files, snapshot none (task 411 ms: download 73 ms overlapping gunzip 35 ms, parse 96 ms, sort 0 ms, write 0 ms, index 71 ms: 1 candidates, 3598 repo-hours, 305 releases; waiting 16 ms; commit 0 ms)
2026-11-13T03:00:07Z [load_day 2026-11-12] 2026-11-12 hour 9: 3754 events in 0 files, snapshot none (task 429 ms: download 63 ms overlapping gunzip 33 ms, parse 87 ms, sort 0 ms, write 0 ms, index 88 ms: 3 candidates, 3413 repo-hours, 293 releases; waiting 18 ms; commit 0 ms)
2026-11-13T03:00:08Z [load_day 2026-11-12] 2026-11-12 hour 10: 3637 events in 0 files, snapshot none (task 389 ms: download 63 ms overlapping gunzip 32 ms, parse 83 ms, sort 0 ms, write 0 ms, index 54 ms: 1 candidates, 3317 repo-hours, 297 releases; waiting 20 ms; commit 0 ms)
2026-11-13T03:00:08Z [load_day 2026-11-12] 2026-11-12 hour 11: 3307 events in 0 files, snapshot none (task 360 ms: download 51 ms overlapping gunzip 24 ms, parse 67 ms, sort 0 ms, write 0 ms, index 43 ms: 0 candidates, 3041 repo-hours, 242 releases; waiting 15 ms; commit 0 ms)
2026-11-13T03:00:09Z [load_day 2026-11-12] 2026-11-12 hour 12: 3404 events in 0 files, snapshot none (task 396 ms: download 58 ms overlapping gunzip 25 ms, parse 69 ms, sort 0 ms, write 0 ms, index 71 ms: 0 candidates, 3113 repo-hours, 244 releases; waiting 21 ms; commit 0 ms)
2026-11-13T03:00:09Z [load_day 2026-11-12] 2026-11-12 hour 13: 3779 events in 0 files, snapshot none (task 216 ms: download 56 ms overlapping gunzip 26 ms, parse 78 ms, sort 0 ms, write 0 ms, index 39 ms: 0 candidates, 3458 repo-hours, 281 releases; waiting 16 ms; commit 0 ms)
2026-11-13T03:00:10Z [load_day 2026-11-12] 2026-11-12 hour 14: 3524 events in 0 files, snapshot none (task 247 ms: download 75 ms overlapping gunzip 26 ms, parse 74 ms, sort 0 ms, write 0 ms, index 38 ms: 0 candidates, 3211 repo-hours, 270 releases; waiting 32 ms; commit 0 ms)
2026-11-13T03:00:10Z [load_day 2026-11-12] 2026-11-12 hour 15: 3785 events in 0 files, snapshot none (task 266 ms: download 76 ms overlapping gunzip 30 ms, parse 86 ms, sort 0 ms, write 0 ms, index 69 ms: 1 candidates, 3490 repo-hours, 266 releases; waiting 22 ms; commit 0 ms)
2026-11-13T03:00:11Z [load_day 2026-11-12] 2026-11-12 hour 16: 2874 events in 0 files, snapshot none (task 323 ms: download 207 ms overlapping gunzip 29 ms, parse 83 ms, sort 0 ms, write 0 ms, index 48 ms: 0 candidates, 2647 repo-hours, 121 releases; waiting 108 ms; commit 0 ms)
2026-11-13T03:00:11Z [load_day 2026-11-12] 2026-11-12 hour 17: 3014 events in 0 files, snapshot none (task 221 ms: download 53 ms overlapping gunzip 24 ms, parse 62 ms, sort 0 ms, write 0 ms, index 49 ms: 0 candidates, 2792 repo-hours, 139 releases; waiting 22 ms; commit 0 ms)
2026-11-13T03:00:12Z [load_day 2026-11-12] 2026-11-12 hour 18: 3572 events in 0 files, snapshot none (task 356 ms: download 61 ms overlapping gunzip 29 ms, parse 74 ms, sort 0 ms, write 0 ms, index 44 ms: 0 candidates, 3230 repo-hours, 150 releases; waiting 17 ms; commit 0 ms)
2026-11-13T03:00:12Z [load_day 2026-11-12] 2026-11-12 hour 19: 3300 events in 0 files, snapshot none (task 231 ms: download 78 ms overlapping gunzip 25 ms, parse 67 ms, sort 0 ms, write 0 ms, index 49 ms: 1 candidates, 3004 repo-hours, 149 releases; waiting 17 ms; commit 0 ms)
2026-11-13T03:00:13Z [load_day 2026-11-12] 2026-11-12 hour 20: 3705 events in 0 files, snapshot none (task 263 ms: download 73 ms overlapping gunzip 35 ms, parse 86 ms, sort 0 ms, write 0 ms, index 66 ms: 1 candidates, 3356 repo-hours, 159 releases; waiting 17 ms; commit 0 ms)
2026-11-13T03:00:13Z [load_day 2026-11-12] 2026-11-12 hour 21: 3530 events in 0 files, snapshot none (task 280 ms: download 85 ms overlapping gunzip 36 ms, parse 85 ms, sort 0 ms, write 0 ms, index 68 ms: 1 candidates, 3171 repo-hours, 132 releases; waiting 21 ms; commit 0 ms)
2026-11-13T03:00:14Z [load_day 2026-11-12] 2026-11-12 hour 22: 3752 events in 0 files, snapshot none (task 389 ms: download 74 ms overlapping gunzip 39 ms, parse 90 ms, sort 0 ms, write 0 ms, index 56 ms: 1 candidates, 3339 repo-hours, 137 releases; waiting 16 ms; commit 0 ms)
2026-11-13T03:00:14Z [load_day 2026-11-12] 2026-11-12 hour 23: 10828 events in 0 files, snapshot none (task 328 ms: download 98 ms overlapping gunzip 45 ms, parse 110 ms, sort 0 ms, write 0 ms, index 90 ms: 0 candidates, 8897 repo-hours, 120 releases; waiting 17 ms; commit 0 ms)
2026-11-13T03:00:16Z [load_day 2026-11-12] 2026-11-12: repo_hour merged from 24 files to 1 (108138 rows, 1646 ms)
2026-11-13T03:00:24Z [load_day 2026-11-12] 2026-11-12: index committed in 9952 ms (11 + 1 + 24 files)
2026-11-13T03:00:24Z [load_day 2026-11-12] 2026-11-12: 124322 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-13T03:00:24Z [load_day 2026-11-12] attempt 1 succeeded