orcaLog in

Runs · run 4190

load_day 2025-07-25, attempt 1 succeeded

Host
73ccef5e07c2:348761
Started
2026-11-08T13:05:02Z
Ended
2026-11-08T13:07:13Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
673 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
146.1 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4190/load_day/2025-07-25/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:05:02Z [load_day 2025-07-25] attempt 1 started
2026-11-08T13:05:03Z [load_day 2025-07-25] 2025-07-25: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:05:10Z [load_day 2025-07-25] 2025-07-25 hour 0: 145029 events in 0 files, snapshot none (task 6186 ms: download 3569 ms overlapping gunzip 914 ms, parse 3680 ms, sort 0 ms, write 0 ms, index 797 ms: 10 candidates, 65883 repo-hours, 1117 releases; waiting 438 ms; commit 0 ms)
2026-11-08T13:05:10Z [load_day 2025-07-25] 2025-07-25 hour 1: 151813 events in 0 files, snapshot none (task 6486 ms: download 3886 ms overlapping gunzip 900 ms, parse 3681 ms, sort 0 ms, write 0 ms, index 950 ms: 3 candidates, 84863 repo-hours, 829 releases; waiting 717 ms; commit 0 ms)
2026-11-08T13:05:17Z [load_day 2025-07-25] 2025-07-25 hour 2: 150970 events in 0 files, snapshot none (task 6558 ms: download 3113 ms overlapping gunzip 876 ms, parse 3647 ms, sort 0 ms, write 0 ms, index 1046 ms: 3 candidates, 74131 repo-hours, 947 releases; waiting 488 ms; commit 0 ms)
2026-11-08T13:05:17Z [load_day 2025-07-25] 2025-07-25 hour 3: 146513 events in 0 files, snapshot none (task 6083 ms: download 3890 ms overlapping gunzip 916 ms, parse 3598 ms, sort 0 ms, write 0 ms, index 784 ms: 9 candidates, 64798 repo-hours, 918 releases; waiting 488 ms; commit 0 ms)
2026-11-08T13:05:54Z [load_day 2025-07-25] 2025-07-25 hour 4: 147116 events in 0 files, snapshot none (task 36125 ms: download 2948 ms overlapping gunzip 724 ms, parse 2943 ms, sort 0 ms, write 0 ms, index 524 ms: 1 candidates, 66448 repo-hours, 1868 releases; waiting 606 ms; commit 0 ms)
2026-11-08T13:05:54Z [load_day 2025-07-25] 2025-07-25 hour 5: 151718 events in 0 files, snapshot none (task 4978 ms: download 2527 ms overlapping gunzip 776 ms, parse 3133 ms, sort 0 ms, write 0 ms, index 540 ms: 5 candidates, 66185 repo-hours, 750 releases; waiting 207 ms; commit 0 ms)
2026-11-08T13:06:00Z [load_day 2025-07-25] 2025-07-25 hour 6: 158999 events in 0 files, snapshot none (task 5862 ms: download 3583 ms overlapping gunzip 769 ms, parse 3185 ms, sort 0 ms, write 0 ms, index 591 ms: 4 candidates, 78159 repo-hours, 894 releases; waiting 991 ms; commit 0 ms)
2026-11-08T13:06:00Z [load_day 2025-07-25] 2025-07-25 hour 7: 154215 events in 0 files, snapshot none (task 5836 ms: download 3500 ms overlapping gunzip 805 ms, parse 3245 ms, sort 0 ms, write 0 ms, index 583 ms: 3 candidates, 72387 repo-hours, 849 releases; waiting 575 ms; commit 0 ms)
2026-11-08T13:06:07Z [load_day 2025-07-25] 2025-07-25 hour 8: 157347 events in 0 files, snapshot none (task 6736 ms: download 3691 ms overlapping gunzip 1019 ms, parse 4200 ms, sort 0 ms, write 0 ms, index 706 ms: 5 candidates, 76524 repo-hours, 892 releases; waiting 519 ms; commit 0 ms)
2026-11-08T13:06:07Z [load_day 2025-07-25] 2025-07-25 hour 9: 160739 events in 0 files, snapshot none (task 7011 ms: download 4027 ms overlapping gunzip 1030 ms, parse 4485 ms, sort 0 ms, write 0 ms, index 690 ms: 8 candidates, 77995 repo-hours, 1080 releases; waiting 495 ms; commit 0 ms)
2026-11-08T13:06:15Z [load_day 2025-07-25] 2025-07-25 hour 10: 157046 events in 0 files, snapshot none (task 7703 ms: download 4933 ms overlapping gunzip 1090 ms, parse 4477 ms, sort 0 ms, write 0 ms, index 572 ms: 8 candidates, 74339 repo-hours, 953 releases; waiting 1213 ms; commit 0 ms)
2026-11-08T13:06:16Z [load_day 2025-07-25] 2025-07-25 hour 11: 159094 events in 0 files, snapshot none (task 7618 ms: download 4842 ms overlapping gunzip 1168 ms, parse 4928 ms, sort 0 ms, write 0 ms, index 554 ms: 8 candidates, 72012 repo-hours, 838 releases; waiting 673 ms; commit 0 ms)
2026-11-08T13:06:24Z [load_day 2025-07-25] 2025-07-25 hour 12: 163109 events in 0 files, snapshot none (task 7775 ms: download 4562 ms overlapping gunzip 1149 ms, parse 4735 ms, sort 0 ms, write 0 ms, index 1044 ms: 7 candidates, 93344 repo-hours, 909 releases; waiting 505 ms; commit 0 ms)
2026-11-08T13:06:25Z [load_day 2025-07-25] 2025-07-25 hour 13: 167483 events in 0 files, snapshot none (task 8760 ms: download 5107 ms overlapping gunzip 1283 ms, parse 5654 ms, sort 0 ms, write 0 ms, index 1067 ms: 5 candidates, 90887 repo-hours, 914 releases; waiting 445 ms; commit 0 ms)
2026-11-08T13:06:32Z [load_day 2025-07-25] 2025-07-25 hour 14: 168705 events in 0 files, snapshot none (task 7414 ms: download 3928 ms overlapping gunzip 1176 ms, parse 4809 ms, sort 0 ms, write 0 ms, index 836 ms: 5 candidates, 81491 repo-hours, 953 releases; waiting 256 ms; commit 0 ms)
2026-11-08T13:06:32Z [load_day 2025-07-25] 2025-07-25 hour 15: 162943 events in 0 files, snapshot none (task 6851 ms: download 4100 ms overlapping gunzip 1052 ms, parse 4390 ms, sort 0 ms, write 0 ms, index 699 ms: 6 candidates, 80457 repo-hours, 1011 releases; waiting 432 ms; commit 0 ms)
2026-11-08T13:06:40Z [load_day 2025-07-25] 2025-07-25 hour 16: 159451 events in 0 files, snapshot none (task 7427 ms: download 4459 ms overlapping gunzip 1115 ms, parse 4507 ms, sort 0 ms, write 0 ms, index 807 ms: 4 candidates, 77515 repo-hours, 933 releases; waiting 704 ms; commit 0 ms)
2026-11-08T13:06:40Z [load_day 2025-07-25] 2025-07-25 hour 17: 157386 events in 0 files, snapshot none (task 7270 ms: download 4720 ms overlapping gunzip 1076 ms, parse 4368 ms, sort 0 ms, write 0 ms, index 590 ms: 5 candidates, 72668 repo-hours, 909 releases; waiting 932 ms; commit 0 ms)
2026-11-08T13:06:48Z [load_day 2025-07-25] 2025-07-25 hour 18: 160342 events in 0 files, snapshot none (task 7815 ms: download 4936 ms overlapping gunzip 1194 ms, parse 4997 ms, sort 0 ms, write 0 ms, index 703 ms: 9 candidates, 78434 repo-hours, 882 releases; waiting 605 ms; commit 0 ms)
2026-11-08T13:06:48Z [load_day 2025-07-25] 2025-07-25 hour 19: 152261 events in 0 files, snapshot none (task 7445 ms: download 4611 ms overlapping gunzip 1185 ms, parse 4947 ms, sort 0 ms, write 0 ms, index 558 ms: 9 candidates, 66115 repo-hours, 923 releases; waiting 490 ms; commit 0 ms)
2026-11-08T13:06:56Z [load_day 2025-07-25] 2025-07-25 hour 20: 150385 events in 0 files, snapshot none (task 6971 ms: download 4500 ms overlapping gunzip 1091 ms, parse 4481 ms, sort 0 ms, write 0 ms, index 521 ms: 9 candidates, 64910 repo-hours, 890 releases; waiting 505 ms; commit 0 ms)
2026-11-08T13:06:56Z [load_day 2025-07-25] 2025-07-25 hour 21: 146444 events in 0 files, snapshot none (task 6420 ms: download 3974 ms overlapping gunzip 1024 ms, parse 4211 ms, sort 0 ms, write 0 ms, index 465 ms: 7 candidates, 59483 repo-hours, 895 releases; waiting 366 ms; commit 0 ms)
2026-11-08T13:07:02Z [load_day 2025-07-25] 2025-07-25 hour 22: 140710 events in 0 files, snapshot none (task 6175 ms: download 3538 ms overlapping gunzip 923 ms, parse 3648 ms, sort 0 ms, write 0 ms, index 593 ms: 7 candidates, 55385 repo-hours, 1004 releases; waiting 529 ms; commit 0 ms)
2026-11-08T13:07:02Z [load_day 2025-07-25] 2025-07-25 hour 23: 134627 events in 0 files, snapshot none (task 5322 ms: download 2976 ms overlapping gunzip 830 ms, parse 3235 ms, sort 0 ms, write 0 ms, index 446 ms: 3 candidates, 52119 repo-hours, 1060 releases; waiting 511 ms; commit 0 ms)
2026-11-08T13:07:11Z [load_day 2025-07-25] 2025-07-25: repo_hour merged from 24 files to 1 (1746532 rows, 8408 ms)
2026-11-08T13:07:13Z [load_day 2025-07-25] 2025-07-25: index committed in 11161 ms (24 + 1 + 24 files)
2026-11-08T13:07:13Z [load_day 2025-07-25] 2025-07-25: 3704445 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:07:13Z [load_day 2025-07-25] attempt 1 succeeded