orcaLog in

Runs · run 4316

load_day 2025-08-26, attempt 1 succeeded

Host
73ccef5e07c2:367685
Started
2026-11-08T13:33:30Z
Ended
2026-11-08T13:35:22Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
684 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
163.6 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4316/load_day/2025-08-26/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:33:30Z [load_day 2025-08-26] attempt 1 started
2026-11-08T13:33:31Z [load_day 2025-08-26] 2025-08-26: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:33:40Z [load_day 2025-08-26] 2025-08-26 hour 0: 148853 events in 0 files, snapshot none (task 7559 ms: download 4886 ms overlapping gunzip 1248 ms, parse 4830 ms, sort 0 ms, write 0 ms, index 621 ms: 5 candidates, 76503 repo-hours, 1051 releases; waiting 528 ms; commit 0 ms)
2026-11-08T13:33:40Z [load_day 2025-08-26] 2025-08-26 hour 1: 162766 events in 0 files, snapshot none (task 7580 ms: download 4324 ms overlapping gunzip 1213 ms, parse 4807 ms, sort 0 ms, write 0 ms, index 774 ms: 7 candidates, 89009 repo-hours, 719 releases; waiting 522 ms; commit 0 ms)
2026-11-08T13:33:46Z [load_day 2025-08-26] 2025-08-26 hour 2: 143891 events in 0 files, snapshot none (task 6406 ms: download 3869 ms overlapping gunzip 986 ms, parse 3961 ms, sort 0 ms, write 0 ms, index 687 ms: 7 candidates, 71147 repo-hours, 746 releases; waiting 521 ms; commit 0 ms)
2026-11-08T13:33:47Z [load_day 2025-08-26] 2025-08-26 hour 3: 149330 events in 0 files, snapshot none (task 6689 ms: download 3581 ms overlapping gunzip 1030 ms, parse 3987 ms, sort 0 ms, write 0 ms, index 834 ms: 6 candidates, 69852 repo-hours, 1919 releases; waiting 556 ms; commit 0 ms)
2026-11-08T13:33:52Z [load_day 2025-08-26] 2025-08-26 hour 4: 149585 events in 0 files, snapshot none (task 5226 ms: download 2955 ms overlapping gunzip 795 ms, parse 3047 ms, sort 0 ms, write 0 ms, index 506 ms: 9 candidates, 65806 repo-hours, 743 releases; waiting 529 ms; commit 0 ms)
2026-11-08T13:33:53Z [load_day 2025-08-26] 2025-08-26 hour 5: 148858 events in 0 files, snapshot none (task 5764 ms: download 3639 ms overlapping gunzip 939 ms, parse 3501 ms, sort 0 ms, write 0 ms, index 488 ms: 13 candidates, 66938 repo-hours, 631 releases; waiting 554 ms; commit 0 ms)
2026-11-08T13:33:59Z [load_day 2025-08-26] 2025-08-26 hour 6: 156812 events in 0 files, snapshot none (task 5990 ms: download 3749 ms overlapping gunzip 978 ms, parse 3645 ms, sort 0 ms, write 0 ms, index 592 ms: 6 candidates, 80885 repo-hours, 821 releases; waiting 547 ms; commit 0 ms)
2026-11-08T13:34:01Z [load_day 2025-08-26] 2025-08-26 hour 7: 157911 events in 0 files, snapshot none (task 6935 ms: download 4171 ms overlapping gunzip 1050 ms, parse 3837 ms, sort 0 ms, write 0 ms, index 598 ms: 2 candidates, 74495 repo-hours, 782 releases; waiting 724 ms; commit 0 ms)
2026-11-08T13:34:06Z [load_day 2025-08-26] 2025-08-26 hour 8: 157794 events in 0 files, snapshot none (task 6501 ms: download 4024 ms overlapping gunzip 1047 ms, parse 3796 ms, sort 0 ms, write 0 ms, index 747 ms: 6 candidates, 79134 repo-hours, 805 releases; waiting 679 ms; commit 0 ms)
2026-11-08T13:34:12Z [load_day 2025-08-26] 2025-08-26 hour 9: 159366 events in 0 files, snapshot none (task 11141 ms: download 8227 ms overlapping gunzip 1390 ms, parse 5778 ms, sort 0 ms, write 0 ms, index 661 ms: 6 candidates, 78883 repo-hours, 890 releases; waiting 3042 ms; commit 0 ms)
2026-11-08T13:34:13Z [load_day 2025-08-26] 2025-08-26 hour 10: 158762 events in 0 files, snapshot none (task 7031 ms: download 4449 ms overlapping gunzip 1224 ms, parse 4737 ms, sort 0 ms, write 0 ms, index 609 ms: 9 candidates, 76869 repo-hours, 778 releases; waiting 186 ms; commit 0 ms)
2026-11-08T13:34:22Z [load_day 2025-08-26] 2025-08-26 hour 11: 163653 events in 0 files, snapshot none (task 8954 ms: download 6084 ms overlapping gunzip 1544 ms, parse 5989 ms, sort 0 ms, write 0 ms, index 629 ms: 4 candidates, 76702 repo-hours, 718 releases; waiting 512 ms; commit 0 ms)
2026-11-08T13:34:23Z [load_day 2025-08-26] 2025-08-26 hour 12: 161982 events in 0 files, snapshot none (task 9163 ms: download 6598 ms overlapping gunzip 1313 ms, parse 5550 ms, sort 0 ms, write 0 ms, index 660 ms: 13 candidates, 94453 repo-hours, 812 releases; waiting 1329 ms; commit 0 ms)
2026-11-08T13:34:30Z [load_day 2025-08-26] 2025-08-26 hour 13: 166445 events in 0 files, snapshot none (task 7722 ms: download 4934 ms overlapping gunzip 1256 ms, parse 4810 ms, sort 0 ms, write 0 ms, index 835 ms: 7 candidates, 91839 repo-hours, 750 releases; waiting 577 ms; commit 0 ms)
2026-11-08T13:34:31Z [load_day 2025-08-26] 2025-08-26 hour 14: 156647 events in 0 files, snapshot none (task 7093 ms: download 4625 ms overlapping gunzip 1199 ms, parse 4575 ms, sort 0 ms, write 0 ms, index 623 ms: 7 candidates, 81069 repo-hours, 835 releases; waiting 429 ms; commit 0 ms)
2026-11-08T13:34:39Z [load_day 2025-08-26] 2025-08-26 hour 15: 161782 events in 0 files, snapshot none (task 8308 ms: download 5391 ms overlapping gunzip 1386 ms, parse 5359 ms, sort 0 ms, write 0 ms, index 681 ms: 6 candidates, 81886 repo-hours, 971 releases; waiting 546 ms; commit 0 ms)
2026-11-08T13:34:39Z [load_day 2025-08-26] 2025-08-26 hour 16: 160136 events in 0 files, snapshot none (task 7706 ms: download 4828 ms overlapping gunzip 1235 ms, parse 4926 ms, sort 0 ms, write 0 ms, index 762 ms: 7 candidates, 80541 repo-hours, 868 releases; waiting 506 ms; commit 0 ms)
2026-11-08T13:34:48Z [load_day 2025-08-26] 2025-08-26 hour 17: 165782 events in 0 files, snapshot none (task 8299 ms: download 5262 ms overlapping gunzip 1360 ms, parse 5520 ms, sort 0 ms, write 0 ms, index 622 ms: 13 candidates, 78922 repo-hours, 780 releases; waiting 522 ms; commit 0 ms)
2026-11-08T13:34:48Z [load_day 2025-08-26] 2025-08-26 hour 18: 165109 events in 0 files, snapshot none (task 7613 ms: download 5044 ms overlapping gunzip 1256 ms, parse 4976 ms, sort 0 ms, write 0 ms, index 646 ms: 9 candidates, 83585 repo-hours, 853 releases; waiting 475 ms; commit 0 ms)
2026-11-08T13:34:56Z [load_day 2025-08-26] 2025-08-26 hour 19: 156393 events in 0 files, snapshot none (task 7279 ms: download 4611 ms overlapping gunzip 1115 ms, parse 4677 ms, sort 0 ms, write 0 ms, index 673 ms: 6 candidates, 70881 repo-hours, 748 releases; waiting 528 ms; commit 0 ms)
2026-11-08T13:34:56Z [load_day 2025-08-26] 2025-08-26 hour 20: 153810 events in 0 files, snapshot none (task 7067 ms: download 4597 ms overlapping gunzip 1119 ms, parse 4345 ms, sort 0 ms, write 0 ms, index 590 ms: 14 candidates, 69400 repo-hours, 768 releases; waiting 758 ms; commit 0 ms)
2026-11-08T13:35:03Z [load_day 2025-08-26] 2025-08-26 hour 21: 151807 events in 0 files, snapshot none (task 7189 ms: download 4477 ms overlapping gunzip 1199 ms, parse 4584 ms, sort 0 ms, write 0 ms, index 647 ms: 13 candidates, 66319 repo-hours, 875 releases; waiting 521 ms; commit 0 ms)
2026-11-08T13:35:03Z [load_day 2025-08-26] 2025-08-26 hour 22: 143485 events in 0 files, snapshot none (task 6774 ms: download 4123 ms overlapping gunzip 1117 ms, parse 4230 ms, sort 0 ms, write 0 ms, index 657 ms: 6 candidates, 61392 repo-hours, 865 releases; waiting 526 ms; commit 0 ms)
2026-11-08T13:35:10Z [load_day 2025-08-26] 2025-08-26 hour 23: 143025 events in 0 files, snapshot none (task 6443 ms: download 4043 ms overlapping gunzip 889 ms, parse 3528 ms, sort 0 ms, write 0 ms, index 562 ms: 6 candidates, 59424 repo-hours, 939 releases; waiting 1191 ms; commit 0 ms)
2026-11-08T13:35:19Z [load_day 2025-08-26] 2025-08-26: repo_hour merged from 24 files to 1 (1825934 rows, 8696 ms)
2026-11-08T13:35:22Z [load_day 2025-08-26] 2025-08-26: index committed in 11928 ms (24 + 1 + 24 files)
2026-11-08T13:35:22Z [load_day 2025-08-26] 2025-08-26: 3743984 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:35:22Z [load_day 2025-08-26] attempt 1 succeeded