load_day 2025-09-12, attempt 1 succeeded

Rerun from here

Log in to rerun from here

Host

73ccef5e07c2:377789

Started

2026-11-08T13:48:35Z

Ended

2026-11-08T13:50:16Z

Peak memory?The most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗

668 MB

CPU used?The CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗

148.5 s, up to 3.0 cores at once

Log file

s3://census-mlake-dev/logs/gharchive/4382/load_day/2025-09-12/1.log

Code

pipelines/gharchive.mojo:135↗

2026-11-08T13:48:35Z [load_day 2025-09-12] attempt 1 started
2026-11-08T13:48:36Z [load_day 2025-09-12] 2025-09-12: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:48:42Z [load_day 2025-09-12] 2025-09-12 hour 0: 149371 events in 0 files, snapshot none (task 5633 ms: download 3208 ms overlapping gunzip 847 ms, parse 3346 ms, sort 0 ms, write 0 ms, index 567 ms: 14 candidates, 77818 repo-hours, 983 releases; waiting 524 ms; commit 0 ms)
2026-11-08T13:48:42Z [load_day 2025-09-12] 2025-09-12 hour 1: 155659 events in 0 files, snapshot none (task 5078 ms: download 3001 ms overlapping gunzip 710 ms, parse 2871 ms, sort 0 ms, write 0 ms, index 679 ms: 11 candidates, 91486 repo-hours, 892 releases; waiting 496 ms; commit 0 ms)
2026-11-08T13:48:48Z [load_day 2025-09-12] 2025-09-12 hour 2: 145579 events in 0 files, snapshot none (task 5171 ms: download 3231 ms overlapping gunzip 760 ms, parse 2963 ms, sort 0 ms, write 0 ms, index 521 ms: 5 candidates, 73226 repo-hours, 843 releases; waiting 636 ms; commit 0 ms)
2026-11-08T13:48:48Z [load_day 2025-09-12] 2025-09-12 hour 3: 148724 events in 0 files, snapshot none (task 4940 ms: download 3118 ms overlapping gunzip 711 ms, parse 2871 ms, sort 0 ms, write 0 ms, index 515 ms: 10 candidates, 67104 repo-hours, 2073 releases; waiting 535 ms; commit 0 ms)
2026-11-08T13:48:54Z [load_day 2025-09-12] 2025-09-12 hour 4: 147535 events in 0 files, snapshot none (task 6100 ms: download 3695 ms overlapping gunzip 807 ms, parse 3256 ms, sort 0 ms, write 0 ms, index 581 ms: 10 candidates, 64506 repo-hours, 622 releases; waiting 1028 ms; commit 0 ms)
2026-11-08T13:48:54Z [load_day 2025-09-12] 2025-09-12 hour 5: 151561 events in 0 files, snapshot none (task 5716 ms: download 2722 ms overlapping gunzip 794 ms, parse 3189 ms, sort 0 ms, write 0 ms, index 887 ms: 8 candidates, 67104 repo-hours, 577 releases; waiting 558 ms; commit 0 ms)
2026-11-08T13:49:02Z [load_day 2025-09-12] 2025-09-12 hour 6: 156042 events in 0 files, snapshot none (task 6912 ms: download 3927 ms overlapping gunzip 1045 ms, parse 4017 ms, sort 0 ms, write 0 ms, index 907 ms: 9 candidates, 79792 repo-hours, 697 releases; waiting 498 ms; commit 0 ms)
2026-11-08T13:49:02Z [load_day 2025-09-12] 2025-09-12 hour 7: 163240 events in 0 files, snapshot none (task 7398 ms: download 5082 ms overlapping gunzip 1176 ms, parse 4505 ms, sort 0 ms, write 0 ms, index 630 ms: 6 candidates, 75627 repo-hours, 760 releases; waiting 826 ms; commit 0 ms)
2026-11-08T13:49:09Z [load_day 2025-09-12] 2025-09-12 hour 8: 163099 events in 0 files, snapshot none (task 7103 ms: download 4337 ms overlapping gunzip 1148 ms, parse 4406 ms, sort 0 ms, write 0 ms, index 661 ms: 10 candidates, 78740 repo-hours, 786 releases; waiting 599 ms; commit 0 ms)
2026-11-08T13:49:10Z [load_day 2025-09-12] 2025-09-12 hour 9: 163287 events in 0 files, snapshot none (task 7422 ms: download 4855 ms overlapping gunzip 1124 ms, parse 4815 ms, sort 0 ms, write 0 ms, index 641 ms: 15 candidates, 79916 repo-hours, 902 releases; waiting 515 ms; commit 0 ms)
2026-11-08T13:49:19Z [load_day 2025-09-12] 2025-09-12 hour 10: 160859 events in 0 files, snapshot none (task 8882 ms: download 5528 ms overlapping gunzip 1484 ms, parse 5767 ms, sort 0 ms, write 0 ms, index 610 ms: 3 candidates, 76951 repo-hours, 723 releases; waiting 612 ms; commit 0 ms)
2026-11-08T13:49:20Z [load_day 2025-09-12] 2025-09-12 hour 11: 160799 events in 0 files, snapshot none (task 9737 ms: download 6480 ms overlapping gunzip 1569 ms, parse 6298 ms, sort 0 ms, write 0 ms, index 1037 ms: 7 candidates, 73518 repo-hours, 697 releases; waiting 472 ms; commit 0 ms)
2026-11-08T13:49:27Z [load_day 2025-09-12] 2025-09-12 hour 12: 167782 events in 0 files, snapshot none (task 7946 ms: download 4995 ms overlapping gunzip 1208 ms, parse 5190 ms, sort 0 ms, write 0 ms, index 663 ms: 14 candidates, 98383 repo-hours, 781 releases; waiting 523 ms; commit 0 ms)
2026-11-08T13:49:28Z [load_day 2025-09-12] 2025-09-12 hour 13: 164962 events in 0 files, snapshot none (task 7008 ms: download 4502 ms overlapping gunzip 1094 ms, parse 4411 ms, sort 0 ms, write 0 ms, index 722 ms: 5 candidates, 87307 repo-hours, 724 releases; waiting 491 ms; commit 0 ms)
2026-11-08T13:49:36Z [load_day 2025-09-12] 2025-09-12 hour 14: 167986 events in 0 files, snapshot none (task 8104 ms: download 4902 ms overlapping gunzip 1278 ms, parse 5098 ms, sort 0 ms, write 0 ms, index 897 ms: 8 candidates, 81943 repo-hours, 819 releases; waiting 516 ms; commit 0 ms)
2026-11-08T13:49:36Z [load_day 2025-09-12] 2025-09-12 hour 15: 164744 events in 0 files, snapshot none (task 7241 ms: download 3902 ms overlapping gunzip 1175 ms, parse 4535 ms, sort 0 ms, write 0 ms, index 900 ms: 11 candidates, 81819 repo-hours, 893 releases; waiting 354 ms; commit 0 ms)
2026-11-08T13:49:43Z [load_day 2025-09-12] 2025-09-12 hour 16: 161861 events in 0 files, snapshot none (task 7027 ms: download 3974 ms overlapping gunzip 1062 ms, parse 4336 ms, sort 0 ms, write 0 ms, index 833 ms: 17 candidates, 80325 repo-hours, 777 releases; waiting 489 ms; commit 0 ms)
2026-11-08T13:49:44Z [load_day 2025-09-12] 2025-09-12 hour 17: 163023 events in 0 files, snapshot none (task 6983 ms: download 4279 ms overlapping gunzip 1037 ms, parse 4501 ms, sort 0 ms, write 0 ms, index 693 ms: 8 candidates, 75356 repo-hours, 717 releases; waiting 554 ms; commit 0 ms)
2026-11-08T13:49:51Z [load_day 2025-09-12] 2025-09-12 hour 18: 163514 events in 0 files, snapshot none (task 6778 ms: download 3908 ms overlapping gunzip 1018 ms, parse 4215 ms, sort 0 ms, write 0 ms, index 769 ms: 6 candidates, 80211 repo-hours, 850 releases; waiting 538 ms; commit 0 ms)
2026-11-08T13:49:53Z [load_day 2025-09-12] 2025-09-12 hour 19: 155920 events in 0 files, snapshot none (task 8434 ms: download 6235 ms overlapping gunzip 1201 ms, parse 4652 ms, sort 0 ms, write 0 ms, index 508 ms: 4 candidates, 67321 repo-hours, 747 releases; waiting 1408 ms; commit 0 ms)
2026-11-08T13:49:58Z [load_day 2025-09-12] 2025-09-12 hour 20: 158415 events in 0 files, snapshot none (task 7120 ms: download 4207 ms overlapping gunzip 1096 ms, parse 4464 ms, sort 0 ms, write 0 ms, index 519 ms: 6 candidates, 66887 repo-hours, 842 releases; waiting 684 ms; commit 0 ms)
2026-11-08T13:49:59Z [load_day 2025-09-12] 2025-09-12 hour 21: 146847 events in 0 files, snapshot none (task 6021 ms: download 3782 ms overlapping gunzip 982 ms, parse 3907 ms, sort 0 ms, write 0 ms, index 445 ms: 8 candidates, 62341 repo-hours, 908 releases; waiting 464 ms; commit 0 ms)
2026-11-08T13:50:05Z [load_day 2025-09-12] 2025-09-12 hour 22: 146398 events in 0 files, snapshot none (task 5856 ms: download 3471 ms overlapping gunzip 929 ms, parse 3613 ms, sort 0 ms, write 0 ms, index 490 ms: 4 candidates, 58828 repo-hours, 956 releases; waiting 538 ms; commit 0 ms)
2026-11-08T13:50:06Z [load_day 2025-09-12] 2025-09-12 hour 23: 141682 events in 0 files, snapshot none (task 5864 ms: download 3877 ms overlapping gunzip 916 ms, parse 3593 ms, sort 0 ms, write 0 ms, index 452 ms: 3 candidates, 54290 repo-hours, 728 releases; waiting 547 ms; commit 0 ms)
2026-11-08T13:50:14Z [load_day 2025-09-12] 2025-09-12: repo_hour merged from 24 files to 1 (1800799 rows, 8205 ms)
2026-11-08T13:50:16Z [load_day 2025-09-12] 2025-09-12: index committed in 10944 ms (24 + 1 + 24 files)
2026-11-08T13:50:16Z [load_day 2025-09-12] 2025-09-12: 3768889 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:50:16Z [load_day 2025-09-12] attempt 1 succeeded