load_day 2025-09-01, attempt 1 succeeded

Rerun from here

Log in to rerun from here

Host

73ccef5e07c2:371209

Started

2026-11-08T13:38:33Z

Ended

2026-11-08T13:40:26Z

Peak memory?The most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗

713 MB

CPU used?The CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗

166.4 s, up to 3.0 cores at once

Log file

s3://census-mlake-dev/logs/gharchive/4340/load_day/2025-09-01/1.log

Code

pipelines/gharchive.mojo:135↗

2026-11-08T13:38:33Z [load_day 2025-09-01] attempt 1 started
2026-11-08T13:38:34Z [load_day 2025-09-01] 2025-09-01: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:38:42Z [load_day 2025-09-01] 2025-09-01 hour 0: 148059 events in 0 files, snapshot none (task 7188 ms: download 4674 ms overlapping gunzip 1232 ms, parse 4765 ms, sort 0 ms, write 0 ms, index 584 ms: 8 candidates, 69242 repo-hours, 1203 releases; waiting 385 ms; commit 0 ms)
2026-11-08T13:38:42Z [load_day 2025-09-01] 2025-09-01 hour 1: 151972 events in 0 files, snapshot none (task 6416 ms: download 3411 ms overlapping gunzip 1020 ms, parse 3734 ms, sort 0 ms, write 0 ms, index 859 ms: 4 candidates, 89462 repo-hours, 836 releases; waiting 582 ms; commit 0 ms)
2026-11-08T13:38:49Z [load_day 2025-09-01] 2025-09-01 hour 2: 148787 events in 0 files, snapshot none (task 6981 ms: download 4240 ms overlapping gunzip 1109 ms, parse 4242 ms, sort 0 ms, write 0 ms, index 744 ms: 7 candidates, 79533 repo-hours, 960 releases; waiting 618 ms; commit 0 ms)
2026-11-08T13:38:49Z [load_day 2025-09-01] 2025-09-01 hour 3: 142210 events in 0 files, snapshot none (task 6720 ms: download 3950 ms overlapping gunzip 936 ms, parse 3516 ms, sort 0 ms, write 0 ms, index 651 ms: 5 candidates, 67244 repo-hours, 1600 releases; waiting 1383 ms; commit 0 ms)
2026-11-08T13:38:55Z [load_day 2025-09-01] 2025-09-01 hour 4: 146033 events in 0 files, snapshot none (task 5412 ms: download 3200 ms overlapping gunzip 873 ms, parse 3274 ms, sort 0 ms, write 0 ms, index 434 ms: 6 candidates, 63469 repo-hours, 1074 releases; waiting 539 ms; commit 0 ms)
2026-11-08T13:38:56Z [load_day 2025-09-01] 2025-09-01 hour 5: 156310 events in 0 files, snapshot none (task 6366 ms: download 4216 ms overlapping gunzip 1093 ms, parse 4000 ms, sort 0 ms, write 0 ms, index 511 ms: 3 candidates, 71632 repo-hours, 612 releases; waiting 541 ms; commit 0 ms)
2026-11-08T13:39:03Z [load_day 2025-09-01] 2025-09-01 hour 6: 162273 events in 0 files, snapshot none (task 6740 ms: download 4389 ms overlapping gunzip 1073 ms, parse 4048 ms, sort 0 ms, write 0 ms, index 661 ms: 3 candidates, 85884 repo-hours, 750 releases; waiting 707 ms; commit 0 ms)
2026-11-08T13:39:03Z [load_day 2025-09-01] 2025-09-01 hour 7: 156684 events in 0 files, snapshot none (task 5840 ms: download 3452 ms overlapping gunzip 927 ms, parse 3512 ms, sort 0 ms, write 0 ms, index 612 ms: 3 candidates, 75292 repo-hours, 763 releases; waiting 513 ms; commit 0 ms)
2026-11-08T13:39:12Z [load_day 2025-09-01] 2025-09-01 hour 8: 162388 events in 0 files, snapshot none (task 8983 ms: download 6095 ms overlapping gunzip 1546 ms, parse 5796 ms, sort 0 ms, write 0 ms, index 853 ms: 5 candidates, 82453 repo-hours, 766 releases; waiting 548 ms; commit 0 ms)
2026-11-08T13:39:12Z [load_day 2025-09-01] 2025-09-01 hour 9: 161173 events in 0 files, snapshot none (task 9083 ms: download 6077 ms overlapping gunzip 1535 ms, parse 5964 ms, sort 0 ms, write 0 ms, index 779 ms: 5 candidates, 81220 repo-hours, 858 releases; waiting 526 ms; commit 0 ms)
2026-11-08T13:39:21Z [load_day 2025-09-01] 2025-09-01 hour 10: 158413 events in 0 files, snapshot none (task 7990 ms: download 5180 ms overlapping gunzip 1232 ms, parse 5250 ms, sort 0 ms, write 0 ms, index 697 ms: 5 candidates, 78077 repo-hours, 761 releases; waiting 476 ms; commit 0 ms)
2026-11-08T13:39:21Z [load_day 2025-09-01] 2025-09-01 hour 11: 164180 events in 0 files, snapshot none (task 8544 ms: download 6085 ms overlapping gunzip 1370 ms, parse 5612 ms, sort 0 ms, write 0 ms, index 580 ms: 8 candidates, 77987 repo-hours, 791 releases; waiting 653 ms; commit 0 ms)
2026-11-08T13:39:29Z [load_day 2025-09-01] 2025-09-01 hour 12: 166609 events in 0 files, snapshot none (task 7909 ms: download 5296 ms overlapping gunzip 1185 ms, parse 4858 ms, sort 0 ms, write 0 ms, index 873 ms: 8 candidates, 98220 repo-hours, 800 releases; waiting 656 ms; commit 0 ms)
2026-11-08T13:39:33Z [load_day 2025-09-01] 2025-09-01 hour 13: 165484 events in 0 files, snapshot none (task 10741 ms: download 7215 ms overlapping gunzip 1298 ms, parse 5453 ms, sort 0 ms, write 0 ms, index 1305 ms: 11 candidates, 92658 repo-hours, 704 releases; waiting 2451 ms; commit 0 ms)
2026-11-08T13:39:38Z [load_day 2025-09-01] 2025-09-01 hour 14: 165169 events in 0 files, snapshot none (task 8468 ms: download 5619 ms overlapping gunzip 1394 ms, parse 5484 ms, sort 0 ms, write 0 ms, index 692 ms: 13 candidates, 84203 repo-hours, 765 releases; waiting 507 ms; commit 0 ms)
2026-11-08T13:39:41Z [load_day 2025-09-01] 2025-09-01 hour 15: 162339 events in 0 files, snapshot none (task 7850 ms: download 4374 ms overlapping gunzip 1171 ms, parse 4487 ms, sort 0 ms, write 0 ms, index 1361 ms: 5 candidates, 82843 repo-hours, 913 releases; waiting 507 ms; commit 0 ms)
2026-11-08T13:39:46Z [load_day 2025-09-01] 2025-09-01 hour 16: 161395 events in 0 files, snapshot none (task 7745 ms: download 5095 ms overlapping gunzip 1302 ms, parse 4955 ms, sort 0 ms, write 0 ms, index 632 ms: 1 candidates, 79090 repo-hours, 765 releases; waiting 516 ms; commit 0 ms)
2026-11-08T13:39:49Z [load_day 2025-09-01] 2025-09-01 hour 17: 161331 events in 0 files, snapshot none (task 6965 ms: download 4176 ms overlapping gunzip 1074 ms, parse 4262 ms, sort 0 ms, write 0 ms, index 818 ms: 9 candidates, 73251 repo-hours, 801 releases; waiting 478 ms; commit 0 ms)
2026-11-08T13:39:54Z [load_day 2025-09-01] 2025-09-01 hour 18: 161114 events in 0 files, snapshot none (task 7104 ms: download 4574 ms overlapping gunzip 1159 ms, parse 4275 ms, sort 0 ms, write 0 ms, index 795 ms: 10 candidates, 78593 repo-hours, 914 releases; waiting 564 ms; commit 0 ms)
2026-11-08T13:39:56Z [load_day 2025-09-01] 2025-09-01 hour 19: 161285 events in 0 files, snapshot none (task 6651 ms: download 4323 ms overlapping gunzip 1125 ms, parse 4196 ms, sort 0 ms, write 0 ms, index 555 ms: 5 candidates, 70248 repo-hours, 705 releases; waiting 473 ms; commit 0 ms)
2026-11-08T13:40:00Z [load_day 2025-09-01] 2025-09-01 hour 20: 156455 events in 0 files, snapshot none (task 5930 ms: download 3747 ms overlapping gunzip 919 ms, parse 3421 ms, sort 0 ms, write 0 ms, index 644 ms: 4 candidates, 70085 repo-hours, 742 releases; waiting 205 ms; commit 0 ms)
2026-11-08T13:40:06Z [load_day 2025-09-01] 2025-09-01 hour 21: 153972 events in 0 files, snapshot none (task 7418 ms: download 4952 ms overlapping gunzip 1067 ms, parse 4075 ms, sort 0 ms, write 0 ms, index 680 ms: 3 candidates, 65796 repo-hours, 764 releases; waiting 1327 ms; commit 0 ms)
2026-11-08T13:40:12Z [load_day 2025-09-01] 2025-09-01 hour 22: 148614 events in 0 files, snapshot none (task 7686 ms: download 3982 ms overlapping gunzip 1226 ms, parse 4628 ms, sort 0 ms, write 0 ms, index 744 ms: 11 candidates, 61553 repo-hours, 874 releases; waiting 779 ms; commit 0 ms)
2026-11-08T13:40:15Z [load_day 2025-09-01] 2025-09-01 hour 23: 148278 events in 0 files, snapshot none (task 7434 ms: download 5119 ms overlapping gunzip 1281 ms, parse 4895 ms, sort 0 ms, write 0 ms, index 442 ms: 3 candidates, 60123 repo-hours, 831 releases; waiting 520 ms; commit 0 ms)
2026-11-08T13:40:23Z [load_day 2025-09-01] 2025-09-01: repo_hour merged from 24 files to 1 (1838158 rows, 8587 ms)
2026-11-08T13:40:26Z [load_day 2025-09-01] 2025-09-01: index committed in 11483 ms (24 + 1 + 24 files)
2026-11-08T13:40:26Z [load_day 2025-09-01] 2025-09-01: 3770527 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:40:26Z [load_day 2025-09-01] attempt 1 succeeded