load_day 2024-01-13, attempt 1 succeeded

Rerun from here

Log in to rerun from here

Host

73ccef5e07c2:18411

Started

2026-11-08T04:07:48Z

Ended

2026-11-08T04:09:08Z

Peak memory?The most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗

580 MB

CPU used?The CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗

105.1 s, up to 2.7 cores at once

Log file

s3://census-mlake-dev/logs/gharchive/1965/load_day/2024-01-13/1.log

Code

pipelines/gharchive.mojo:135↗

2026-11-08T04:07:48Z [load_day 2024-01-13] attempt 1 started
2026-11-08T04:07:48Z [load_day 2024-01-13] 2024-01-13: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:07:55Z [load_day 2024-01-13] 2024-01-13 hour 0: 176013 events in 0 files, snapshot none (task 6308 ms: download 3446 ms overlapping gunzip 1022 ms, parse 4116 ms, sort 0 ms, write 0 ms, index 589 ms: 5 candidates, 76922 repo-hours, 1040 releases; waiting 246 ms; commit 0 ms)
2026-11-08T04:07:55Z [load_day 2024-01-13] 2024-01-13 hour 1: 169620 events in 0 files, snapshot none (task 6170 ms: download 3131 ms overlapping gunzip 858 ms, parse 3817 ms, sort 0 ms, write 0 ms, index 615 ms: 5 candidates, 79488 repo-hours, 762 releases; waiting 486 ms; commit 0 ms)
2026-11-08T04:08:01Z [load_day 2024-01-13] 2024-01-13 hour 2: 134761 events in 0 files, snapshot none (task 4897 ms: download 2390 ms overlapping gunzip 676 ms, parse 2920 ms, sort 0 ms, write 0 ms, index 537 ms: 1 candidates, 44827 repo-hours, 515 releases; waiting 495 ms; commit 0 ms)
2026-11-08T04:08:01Z [load_day 2024-01-13] 2024-01-13 hour 3: 132227 events in 0 files, snapshot none (task 4887 ms: download 2275 ms overlapping gunzip 601 ms, parse 2588 ms, sort 0 ms, write 0 ms, index 863 ms: 4 candidates, 42886 repo-hours, 614 releases; waiting 509 ms; commit 0 ms)
2026-11-08T04:08:06Z [load_day 2024-01-13] 2024-01-13 hour 4: 135151 events in 0 files, snapshot none (task 4651 ms: download 2167 ms overlapping gunzip 628 ms, parse 2820 ms, sort 0 ms, write 0 ms, index 427 ms: 3 candidates, 43739 repo-hours, 445 releases; waiting 505 ms; commit 0 ms)
2026-11-08T04:08:06Z [load_day 2024-01-13] 2024-01-13 hour 5: 143928 events in 0 files, snapshot none (task 4469 ms: download 2080 ms overlapping gunzip 647 ms, parse 2755 ms, sort 0 ms, write 0 ms, index 331 ms: 1 candidates, 47204 repo-hours, 551 releases; waiting 491 ms; commit 0 ms)
2026-11-08T04:08:11Z [load_day 2024-01-13] 2024-01-13 hour 6: 154583 events in 0 files, snapshot none (task 5100 ms: download 2374 ms overlapping gunzip 708 ms, parse 3097 ms, sort 0 ms, write 0 ms, index 640 ms: 4 candidates, 55979 repo-hours, 900 releases; waiting 446 ms; commit 0 ms)
2026-11-08T04:08:12Z [load_day 2024-01-13] 2024-01-13 hour 7: 149655 events in 0 files, snapshot none (task 5534 ms: download 2460 ms overlapping gunzip 801 ms, parse 3540 ms, sort 0 ms, write 0 ms, index 442 ms: 6 candidates, 48818 repo-hours, 800 releases; waiting 462 ms; commit 0 ms)
2026-11-08T04:08:16Z [load_day 2024-01-13] 2024-01-13 hour 8: 154281 events in 0 files, snapshot none (task 4556 ms: download 2245 ms overlapping gunzip 617 ms, parse 2694 ms, sort 0 ms, write 0 ms, index 416 ms: 7 candidates, 52418 repo-hours, 757 releases; waiting 518 ms; commit 0 ms)
2026-11-08T04:08:17Z [load_day 2024-01-13] 2024-01-13 hour 9: 157604 events in 0 files, snapshot none (task 4918 ms: download 2272 ms overlapping gunzip 710 ms, parse 3050 ms, sort 0 ms, write 0 ms, index 490 ms: 4 candidates, 54004 repo-hours, 833 releases; waiting 318 ms; commit 0 ms)
2026-11-08T04:08:23Z [load_day 2024-01-13] 2024-01-13 hour 10: 161788 events in 0 files, snapshot none (task 6368 ms: download 3174 ms overlapping gunzip 927 ms, parse 4045 ms, sort 0 ms, write 0 ms, index 593 ms: 3 candidates, 56605 repo-hours, 676 releases; waiting 501 ms; commit 0 ms)
2026-11-08T04:08:24Z [load_day 2024-01-13] 2024-01-13 hour 11: 164253 events in 0 files, snapshot none (task 6330 ms: download 2777 ms overlapping gunzip 953 ms, parse 4230 ms, sort 0 ms, write 0 ms, index 516 ms: 4 candidates, 55415 repo-hours, 613 releases; waiting 295 ms; commit 0 ms)
2026-11-08T04:08:30Z [load_day 2024-01-13] 2024-01-13 hour 12: 227700 events in 0 files, snapshot none (task 6072 ms: download 2788 ms overlapping gunzip 783 ms, parse 3759 ms, sort 0 ms, write 0 ms, index 725 ms: 6 candidates, 88503 repo-hours, 747 releases; waiting 516 ms; commit 0 ms)
2026-11-08T04:08:31Z [load_day 2024-01-13] 2024-01-13 hour 13: 190508 events in 0 files, snapshot none (task 6392 ms: download 2741 ms overlapping gunzip 921 ms, parse 3916 ms, sort 0 ms, write 0 ms, index 783 ms: 7 candidates, 79181 repo-hours, 696 releases; waiting 472 ms; commit 0 ms)
2026-11-08T04:08:36Z [load_day 2024-01-13] 2024-01-13 hour 14: 180995 events in 0 files, snapshot none (task 6108 ms: download 3360 ms overlapping gunzip 953 ms, parse 3919 ms, sort 0 ms, write 0 ms, index 467 ms: 7 candidates, 66598 repo-hours, 787 releases; waiting 494 ms; commit 0 ms)
2026-11-08T04:08:37Z [load_day 2024-01-13] 2024-01-13 hour 15: 182134 events in 0 files, snapshot none (task 5825 ms: download 2910 ms overlapping gunzip 841 ms, parse 3685 ms, sort 0 ms, write 0 ms, index 511 ms: 9 candidates, 67760 repo-hours, 899 releases; waiting 484 ms; commit 0 ms)
2026-11-08T04:08:43Z [load_day 2024-01-13] 2024-01-13 hour 16: 179919 events in 0 files, snapshot none (task 6428 ms: download 3685 ms overlapping gunzip 954 ms, parse 4079 ms, sort 0 ms, write 0 ms, index 625 ms: 4 candidates, 66398 repo-hours, 677 releases; waiting 520 ms; commit 0 ms)
2026-11-08T04:08:43Z [load_day 2024-01-13] 2024-01-13 hour 17: 176806 events in 0 files, snapshot none (task 5934 ms: download 3407 ms overlapping gunzip 877 ms, parse 3843 ms, sort 0 ms, write 0 ms, index 486 ms: 4 candidates, 62234 repo-hours, 670 releases; waiting 491 ms; commit 0 ms)
2026-11-08T04:08:50Z [load_day 2024-01-13] 2024-01-13 hour 18: 181937 events in 0 files, snapshot none (task 6110 ms: download 3548 ms overlapping gunzip 875 ms, parse 4004 ms, sort 0 ms, write 0 ms, index 540 ms: 4 candidates, 69023 repo-hours, 913 releases; waiting 474 ms; commit 0 ms)
2026-11-08T04:08:50Z [load_day 2024-01-13] 2024-01-13 hour 19: 165801 events in 0 files, snapshot none (task 6052 ms: download 2898 ms overlapping gunzip 860 ms, parse 3966 ms, sort 0 ms, write 0 ms, index 624 ms: 2 candidates, 56584 repo-hours, 746 releases; waiting 259 ms; commit 0 ms)
2026-11-08T04:08:55Z [load_day 2024-01-13] 2024-01-13 hour 20: 162965 events in 0 files, snapshot none (task 4292 ms: download 1966 ms overlapping gunzip 563 ms, parse 2640 ms, sort 0 ms, write 0 ms, index 448 ms: 1 candidates, 56591 repo-hours, 716 releases; waiting 350 ms; commit 0 ms)
2026-11-08T04:08:55Z [load_day 2024-01-13] 2024-01-13 hour 21: 146938 events in 0 files, snapshot none (task 3985 ms: download 2369 ms overlapping gunzip 518 ms, parse 2287 ms, sort 0 ms, write 0 ms, index 368 ms: 4 candidates, 50389 repo-hours, 780 releases; waiting 586 ms; commit 0 ms)
2026-11-08T04:08:59Z [load_day 2024-01-13] 2024-01-13 hour 22: 137557 events in 0 files, snapshot none (task 3920 ms: download 2460 ms overlapping gunzip 494 ms, parse 2184 ms, sort 0 ms, write 0 ms, index 431 ms: 5 candidates, 45953 repo-hours, 659 releases; waiting 524 ms; commit 0 ms)
2026-11-08T04:08:59Z [load_day 2024-01-13] 2024-01-13 hour 23: 132313 events in 0 files, snapshot none (task 3744 ms: download 1791 ms overlapping gunzip 476 ms, parse 2199 ms, sort 0 ms, write 0 ms, index 350 ms: 3 candidates, 44467 repo-hours, 567 releases; waiting 517 ms; commit 0 ms)
2026-11-08T04:09:05Z [load_day 2024-01-13] 2024-01-13: repo_hour merged from 24 files to 1 (1411986 rows, 6228 ms)
2026-11-08T04:09:08Z [load_day 2024-01-13] 2024-01-13: index committed in 8689 ms (24 + 1 + 24 files)
2026-11-08T04:09:08Z [load_day 2024-01-13] 2024-01-13: 3899437 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:09:08Z [load_day 2024-01-13] attempt 1 succeeded