load_day 2025-01-25, attempt 1 succeeded

Rerun from here

Log in to rerun from here

Host

73ccef5e07c2:243514

Started

2026-11-08T09:59:38Z

Ended

2026-11-08T10:01:07Z

Peak memory?The most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗

666 MB

CPU used?The CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗

128.9 s, up to 2.7 cores at once

Log file

s3://census-mlake-dev/logs/gharchive/3478/load_day/2025-01-25/1.log

Code

pipelines/gharchive.mojo:135↗

2026-11-08T09:59:38Z [load_day 2025-01-25] attempt 1 started
2026-11-08T09:59:39Z [load_day 2025-01-25] 2025-01-25: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:59:47Z [load_day 2025-01-25] 2025-01-25 hour 0: 191074 events in 0 files, snapshot none (task 7182 ms: download 3804 ms overlapping gunzip 1018 ms, parse 4503 ms, sort 0 ms, write 0 ms, index 940 ms: 12 candidates, 91256 repo-hours, 1312 releases; waiting 500 ms; commit 0 ms)
2026-11-08T09:59:47Z [load_day 2025-01-25] 2025-01-25 hour 1: 194058 events in 0 files, snapshot none (task 7415 ms: download 4296 ms overlapping gunzip 1021 ms, parse 4732 ms, sort 0 ms, write 0 ms, index 957 ms: 8 candidates, 101294 repo-hours, 913 releases; waiting 483 ms; commit 0 ms)
2026-11-08T09:59:53Z [load_day 2025-01-25] 2025-01-25 hour 2: 152611 events in 0 files, snapshot none (task 4979 ms: download 3455 ms overlapping gunzip 692 ms, parse 2978 ms, sort 0 ms, write 0 ms, index 499 ms: 6 candidates, 61466 repo-hours, 879 releases; waiting 544 ms; commit 0 ms)
2026-11-08T09:59:54Z [load_day 2025-01-25] 2025-01-25 hour 3: 167167 events in 0 files, snapshot none (task 6099 ms: download 3381 ms overlapping gunzip 661 ms, parse 3122 ms, sort 0 ms, write 0 ms, index 614 ms: 6 candidates, 64360 repo-hours, 3854 releases; waiting 1433 ms; commit 0 ms)
2026-11-08T09:59:59Z [load_day 2025-01-25] 2025-01-25 hour 4: 157246 events in 0 files, snapshot none (task 5634 ms: download 2073 ms overlapping gunzip 856 ms, parse 3618 ms, sort 0 ms, write 0 ms, index 647 ms: 11 candidates, 56432 repo-hours, 677 releases; waiting 204 ms; commit 0 ms)
2026-11-08T10:00:01Z [load_day 2025-01-25] 2025-01-25 hour 5: 167123 events in 0 files, snapshot none (task 6268 ms: download 3322 ms overlapping gunzip 931 ms, parse 4016 ms, sort 0 ms, write 0 ms, index 625 ms: 5 candidates, 58579 repo-hours, 729 releases; waiting 464 ms; commit 0 ms)
2026-11-08T10:00:05Z [load_day 2025-01-25] 2025-01-25 hour 6: 185938 events in 0 files, snapshot none (task 5316 ms: download 3053 ms overlapping gunzip 680 ms, parse 2998 ms, sort 0 ms, write 0 ms, index 790 ms: 6 candidates, 78323 repo-hours, 1073 releases; waiting 509 ms; commit 0 ms)
2026-11-08T10:00:07Z [load_day 2025-01-25] 2025-01-25 hour 7: 169823 events in 0 files, snapshot none (task 5766 ms: download 3167 ms overlapping gunzip 696 ms, parse 2998 ms, sort 0 ms, write 0 ms, index 752 ms: 4 candidates, 60883 repo-hours, 879 releases; waiting 922 ms; commit 0 ms)
2026-11-08T10:00:11Z [load_day 2025-01-25] 2025-01-25 hour 8: 174090 events in 0 files, snapshot none (task 5803 ms: download 2507 ms overlapping gunzip 844 ms, parse 3659 ms, sort 0 ms, write 0 ms, index 597 ms: 2 candidates, 65584 repo-hours, 882 releases; waiting 465 ms; commit 0 ms)
2026-11-08T10:00:13Z [load_day 2025-01-25] 2025-01-25 hour 9: 183391 events in 0 files, snapshot none (task 5378 ms: download 2816 ms overlapping gunzip 730 ms, parse 3264 ms, sort 0 ms, write 0 ms, index 574 ms: 3 candidates, 73190 repo-hours, 1177 releases; waiting 520 ms; commit 0 ms)
2026-11-08T10:00:17Z [load_day 2025-01-25] 2025-01-25 hour 10: 178559 events in 0 files, snapshot none (task 5241 ms: download 2592 ms overlapping gunzip 707 ms, parse 3041 ms, sort 0 ms, write 0 ms, index 901 ms: 5 candidates, 68319 repo-hours, 904 releases; waiting 321 ms; commit 0 ms)
2026-11-08T10:00:20Z [load_day 2025-01-25] 2025-01-25 hour 11: 177962 events in 0 files, snapshot none (task 5764 ms: download 3016 ms overlapping gunzip 831 ms, parse 3469 ms, sort 0 ms, write 0 ms, index 662 ms: 3 candidates, 65446 repo-hours, 664 releases; waiting 516 ms; commit 0 ms)
2026-11-08T10:00:24Z [load_day 2025-01-25] 2025-01-25 hour 12: 244049 events in 0 files, snapshot none (task 6557 ms: download 3253 ms overlapping gunzip 837 ms, parse 3952 ms, sort 0 ms, write 0 ms, index 890 ms: 7 candidates, 115215 repo-hours, 843 releases; waiting 479 ms; commit 0 ms)
2026-11-08T10:00:27Z [load_day 2025-01-25] 2025-01-25 hour 13: 212355 events in 0 files, snapshot none (task 6500 ms: download 2872 ms overlapping gunzip 848 ms, parse 3564 ms, sort 0 ms, write 0 ms, index 1406 ms: 12 candidates, 94731 repo-hours, 927 releases; waiting 472 ms; commit 0 ms)
2026-11-08T10:00:31Z [load_day 2025-01-25] 2025-01-25 hour 14: 201599 events in 0 files, snapshot none (task 6185 ms: download 3394 ms overlapping gunzip 835 ms, parse 3902 ms, sort 0 ms, write 0 ms, index 647 ms: 13 candidates, 77468 repo-hours, 986 releases; waiting 527 ms; commit 0 ms)
2026-11-08T10:00:33Z [load_day 2025-01-25] 2025-01-25 hour 15: 214928 events in 0 files, snapshot none (task 5807 ms: download 2718 ms overlapping gunzip 764 ms, parse 3470 ms, sort 0 ms, write 0 ms, index 1137 ms: 10 candidates, 87586 repo-hours, 1010 releases; waiting 184 ms; commit 0 ms)
2026-11-08T10:00:39Z [load_day 2025-01-25] 2025-01-25 hour 16: 206837 events in 0 files, snapshot none (task 7488 ms: download 4390 ms overlapping gunzip 1141 ms, parse 4867 ms, sort 0 ms, write 0 ms, index 666 ms: 9 candidates, 81988 repo-hours, 894 releases; waiting 534 ms; commit 0 ms)
2026-11-08T10:00:40Z [load_day 2025-01-25] 2025-01-25 hour 17: 203961 events in 0 files, snapshot none (task 6410 ms: download 3841 ms overlapping gunzip 881 ms, parse 4155 ms, sort 0 ms, write 0 ms, index 629 ms: 7 candidates, 77446 repo-hours, 880 releases; waiting 487 ms; commit 0 ms)
2026-11-08T10:00:45Z [load_day 2025-01-25] 2025-01-25 hour 18: 210959 events in 0 files, snapshot none (task 5192 ms: download 2658 ms overlapping gunzip 700 ms, parse 3069 ms, sort 0 ms, write 0 ms, index 641 ms: 7 candidates, 91207 repo-hours, 1163 releases; waiting 519 ms; commit 0 ms)
2026-11-08T10:00:46Z [load_day 2025-01-25] 2025-01-25 hour 19: 184087 events in 0 files, snapshot none (task 5010 ms: download 2916 ms overlapping gunzip 653 ms, parse 3007 ms, sort 0 ms, write 0 ms, index 527 ms: 9 candidates, 67796 repo-hours, 853 releases; waiting 591 ms; commit 0 ms)
2026-11-08T10:00:50Z [load_day 2025-01-25] 2025-01-25 hour 20: 183780 events in 0 files, snapshot none (task 4756 ms: download 2286 ms overlapping gunzip 638 ms, parse 2759 ms, sort 0 ms, write 0 ms, index 578 ms: 15 candidates, 68904 repo-hours, 773 releases; waiting 516 ms; commit 0 ms)
2026-11-08T10:00:51Z [load_day 2025-01-25] 2025-01-25 hour 21: 179092 events in 0 files, snapshot none (task 4657 ms: download 2339 ms overlapping gunzip 632 ms, parse 2746 ms, sort 0 ms, write 0 ms, index 506 ms: 2 candidates, 69280 repo-hours, 980 releases; waiting 503 ms; commit 0 ms)
2026-11-08T10:00:55Z [load_day 2025-01-25] 2025-01-25 hour 22: 162051 events in 0 files, snapshot none (task 4606 ms: download 2081 ms overlapping gunzip 572 ms, parse 2601 ms, sort 0 ms, write 0 ms, index 675 ms: 3 candidates, 59132 repo-hours, 933 releases; waiting 500 ms; commit 0 ms)
2026-11-08T10:00:56Z [load_day 2025-01-25] 2025-01-25 hour 23: 160513 events in 0 files, snapshot none (task 5025 ms: download 2344 ms overlapping gunzip 646 ms, parse 2873 ms, sort 0 ms, write 0 ms, index 702 ms: 9 candidates, 57697 repo-hours, 781 releases; waiting 524 ms; commit 0 ms)
2026-11-08T10:01:04Z [load_day 2025-01-25] 2025-01-25: repo_hour merged from 24 files to 1 (1793582 rows, 7705 ms)
2026-11-08T10:01:07Z [load_day 2025-01-25] 2025-01-25: index committed in 10680 ms (24 + 1 + 24 files)
2026-11-08T10:01:07Z [load_day 2025-01-25] 2025-01-25: 4463253 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:01:07Z [load_day 2025-01-25] attempt 1 succeeded