orcaLog in

Runs · run 4378

load_day 2025-09-11, attempt 1 succeeded

Host
73ccef5e07c2:376927
Started
2026-11-08T13:47:01Z
Ended
2026-11-08T13:48:49Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
700 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
151.0 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4378/load_day/2025-09-11/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:47:01Z [load_day 2025-09-11] attempt 1 started
2026-11-08T13:47:02Z [load_day 2025-09-11] 2025-09-11: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:47:11Z [load_day 2025-09-11] 2025-09-11 hour 0: 150628 events in 0 files, snapshot none (task 7467 ms: download 3962 ms overlapping gunzip 1210 ms, parse 4563 ms, sort 0 ms, write 0 ms, index 950 ms: 9 candidates, 79917 repo-hours, 1068 releases; waiting 502 ms; commit 0 ms)
2026-11-08T13:47:11Z [load_day 2025-09-11] 2025-09-11 hour 1: 157065 events in 0 files, snapshot none (task 7312 ms: download 3328 ms overlapping gunzip 1067 ms, parse 4156 ms, sort 0 ms, write 0 ms, index 1392 ms: 6 candidates, 93714 repo-hours, 820 releases; waiting 415 ms; commit 0 ms)
2026-11-08T13:47:19Z [load_day 2025-09-11] 2025-09-11 hour 2: 148710 events in 0 files, snapshot none (task 7915 ms: download 4632 ms overlapping gunzip 1237 ms, parse 4939 ms, sort 0 ms, write 0 ms, index 859 ms: 9 candidates, 74761 repo-hours, 790 releases; waiting 494 ms; commit 0 ms)
2026-11-08T13:47:19Z [load_day 2025-09-11] 2025-09-11 hour 3: 154469 events in 0 files, snapshot none (task 7455 ms: download 4035 ms overlapping gunzip 1159 ms, parse 4528 ms, sort 0 ms, write 0 ms, index 989 ms: 6 candidates, 71658 repo-hours, 1988 releases; waiting 493 ms; commit 0 ms)
2026-11-08T13:47:26Z [load_day 2025-09-11] 2025-09-11 hour 4: 148923 events in 0 files, snapshot none (task 6334 ms: download 3701 ms overlapping gunzip 976 ms, parse 3931 ms, sort 0 ms, write 0 ms, index 733 ms: 1 candidates, 64432 repo-hours, 611 releases; waiting 434 ms; commit 0 ms)
2026-11-08T13:47:26Z [load_day 2025-09-11] 2025-09-11 hour 5: 155356 events in 0 files, snapshot none (task 6241 ms: download 3329 ms overlapping gunzip 924 ms, parse 3937 ms, sort 0 ms, write 0 ms, index 653 ms: 13 candidates, 71110 repo-hours, 635 releases; waiting 105 ms; commit 0 ms)
2026-11-08T13:47:34Z [load_day 2025-09-11] 2025-09-11 hour 6: 157989 events in 0 files, snapshot none (task 7330 ms: download 4825 ms overlapping gunzip 1207 ms, parse 4629 ms, sort 0 ms, write 0 ms, index 640 ms: 5 candidates, 82370 repo-hours, 687 releases; waiting 568 ms; commit 0 ms)
2026-11-08T13:47:34Z [load_day 2025-09-11] 2025-09-11 hour 7: 163707 events in 0 files, snapshot none (task 7582 ms: download 5007 ms overlapping gunzip 1245 ms, parse 4857 ms, sort 0 ms, write 0 ms, index 624 ms: 10 candidates, 78776 repo-hours, 731 releases; waiting 531 ms; commit 0 ms)
2026-11-08T13:47:44Z [load_day 2025-09-11] 2025-09-11 hour 8: 163124 events in 0 files, snapshot none (task 9208 ms: download 6767 ms overlapping gunzip 1271 ms, parse 5262 ms, sort 0 ms, write 0 ms, index 578 ms: 7 candidates, 81935 repo-hours, 851 releases; waiting 1727 ms; commit 0 ms)
2026-11-08T13:47:44Z [load_day 2025-09-11] 2025-09-11 hour 9: 161863 events in 0 files, snapshot none (task 7326 ms: download 4255 ms overlapping gunzip 1208 ms, parse 4933 ms, sort 0 ms, write 0 ms, index 667 ms: 5 candidates, 80091 repo-hours, 885 releases; waiting 195 ms; commit 0 ms)
2026-11-08T13:47:52Z [load_day 2025-09-11] 2025-09-11 hour 10: 163824 events in 0 files, snapshot none (task 7494 ms: download 4974 ms overlapping gunzip 1178 ms, parse 4891 ms, sort 0 ms, write 0 ms, index 588 ms: 5 candidates, 80486 repo-hours, 820 releases; waiting 471 ms; commit 0 ms)
2026-11-08T13:47:52Z [load_day 2025-09-11] 2025-09-11 hour 11: 161699 events in 0 files, snapshot none (task 7223 ms: download 4668 ms overlapping gunzip 1186 ms, parse 4607 ms, sort 0 ms, write 0 ms, index 592 ms: 9 candidates, 75688 repo-hours, 810 releases; waiting 528 ms; commit 0 ms)
2026-11-08T13:48:00Z [load_day 2025-09-11] 2025-09-11 hour 12: 168173 events in 0 files, snapshot none (task 7740 ms: download 4832 ms overlapping gunzip 1173 ms, parse 5142 ms, sort 0 ms, write 0 ms, index 697 ms: 9 candidates, 99138 repo-hours, 812 releases; waiting 505 ms; commit 0 ms)
2026-11-08T13:48:00Z [load_day 2025-09-11] 2025-09-11 hour 13: 163655 events in 0 files, snapshot none (task 7571 ms: download 4843 ms overlapping gunzip 1204 ms, parse 5173 ms, sort 0 ms, write 0 ms, index 685 ms: 11 candidates, 91048 repo-hours, 915 releases; waiting 270 ms; commit 0 ms)
2026-11-08T13:48:08Z [load_day 2025-09-11] 2025-09-11 hour 14: 162044 events in 0 files, snapshot none (task 7888 ms: download 4118 ms overlapping gunzip 1226 ms, parse 4856 ms, sort 0 ms, write 0 ms, index 896 ms: 2 candidates, 83533 repo-hours, 1050 releases; waiting 575 ms; commit 0 ms)
2026-11-08T13:48:11Z [load_day 2025-09-11] 2025-09-11 hour 15: 170079 events in 0 files, snapshot none (task 10316 ms: download 7585 ms overlapping gunzip 1296 ms, parse 5503 ms, sort 0 ms, write 0 ms, index 688 ms: 4 candidates, 85187 repo-hours, 890 releases; waiting 2487 ms; commit 0 ms)
2026-11-08T13:48:13Z [load_day 2025-09-11] 2025-09-11 hour 16: 83286 events in 0 files, snapshot none (task 3807 ms: download 2417 ms overlapping gunzip 488 ms, parse 1888 ms, sort 0 ms, write 0 ms, index 556 ms: 4 candidates, 48309 repo-hours, 489 releases; waiting 479 ms; commit 0 ms)
2026-11-08T13:48:19Z [load_day 2025-09-11] 2025-09-11 hour 17: 156414 events in 0 files, snapshot none (task 7758 ms: download 4593 ms overlapping gunzip 1236 ms, parse 5050 ms, sort 0 ms, write 0 ms, index 627 ms: 7 candidates, 74335 repo-hours, 763 releases; waiting 539 ms; commit 0 ms)
2026-11-08T13:48:21Z [load_day 2025-09-11] 2025-09-11 hour 18: 157966 events in 0 files, snapshot none (task 7483 ms: download 4897 ms overlapping gunzip 1115 ms, parse 4867 ms, sort 0 ms, write 0 ms, index 670 ms: 8 candidates, 80635 repo-hours, 773 releases; waiting 541 ms; commit 0 ms)
2026-11-08T13:48:26Z [load_day 2025-09-11] 2025-09-11 hour 19: 158969 events in 0 files, snapshot none (task 5868 ms: download 3647 ms overlapping gunzip 886 ms, parse 3582 ms, sort 0 ms, write 0 ms, index 566 ms: 10 candidates, 72074 repo-hours, 694 releases; waiting 532 ms; commit 0 ms)
2026-11-08T13:48:27Z [load_day 2025-09-11] 2025-09-11 hour 20: 151470 events in 0 files, snapshot none (task 5603 ms: download 3262 ms overlapping gunzip 829 ms, parse 3429 ms, sort 0 ms, write 0 ms, index 551 ms: 11 candidates, 68692 repo-hours, 752 releases; waiting 494 ms; commit 0 ms)
2026-11-08T13:48:32Z [load_day 2025-09-11] 2025-09-11 hour 21: 152674 events in 0 files, snapshot none (task 5638 ms: download 3539 ms overlapping gunzip 846 ms, parse 3388 ms, sort 0 ms, write 0 ms, index 615 ms: 10 candidates, 67432 repo-hours, 900 releases; waiting 558 ms; commit 0 ms)
2026-11-08T13:48:33Z [load_day 2025-09-11] 2025-09-11 hour 22: 149990 events in 0 files, snapshot none (task 5177 ms: download 3259 ms overlapping gunzip 807 ms, parse 3151 ms, sort 0 ms, write 0 ms, index 449 ms: 8 candidates, 64412 repo-hours, 845 releases; waiting 519 ms; commit 0 ms)
2026-11-08T13:48:38Z [load_day 2025-09-11] 2025-09-11 hour 23: 144610 events in 0 files, snapshot none (task 5202 ms: download 3290 ms overlapping gunzip 786 ms, parse 3066 ms, sort 0 ms, write 0 ms, index 493 ms: 4 candidates, 59855 repo-hours, 787 releases; waiting 549 ms; commit 0 ms)
2026-11-08T13:48:46Z [load_day 2025-09-11] 2025-09-11: repo_hour merged from 24 files to 1 (1829588 rows, 8671 ms)
2026-11-08T13:48:49Z [load_day 2025-09-11] 2025-09-11: index committed in 11342 ms (24 + 1 + 24 files)
2026-11-08T13:48:49Z [load_day 2025-09-11] 2025-09-11: 3706687 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:48:49Z [load_day 2025-09-11] attempt 1 succeeded