orcaLog in

Runs · run 4021

load_day 2025-06-14, attempt 1 succeeded

Host
73ccef5e07c2:322555
Started
2026-11-08T12:26:04Z
Ended
2026-11-08T12:27:37Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
605 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
120.7 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4021/load_day/2025-06-14/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:26:04Z [load_day 2025-06-14] attempt 1 started
2026-11-08T12:26:05Z [load_day 2025-06-14] 2025-06-14: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:26:12Z [load_day 2025-06-14] 2025-06-14 hour 0: 134705 events in 0 files, snapshot none (task 6422 ms: download 3424 ms overlapping gunzip 1033 ms, parse 4234 ms, sort 0 ms, write 0 ms, index 619 ms: 3 candidates, 65125 repo-hours, 1044 releases; waiting 199 ms; commit 0 ms)
2026-11-08T12:26:12Z [load_day 2025-06-14] 2025-06-14 hour 1: 146114 events in 0 files, snapshot none (task 6337 ms: download 3347 ms overlapping gunzip 886 ms, parse 4045 ms, sort 0 ms, write 0 ms, index 648 ms: 7 candidates, 85414 repo-hours, 775 releases; waiting 471 ms; commit 0 ms)
2026-11-08T12:26:19Z [load_day 2025-06-14] 2025-06-14 hour 2: 130905 events in 0 files, snapshot none (task 6515 ms: download 4316 ms overlapping gunzip 644 ms, parse 2937 ms, sort 0 ms, write 0 ms, index 504 ms: 4 candidates, 57724 repo-hours, 773 releases; waiting 2210 ms; commit 0 ms)
2026-11-08T12:26:19Z [load_day 2025-06-14] 2025-06-14 hour 3: 134236 events in 0 files, snapshot none (task 5102 ms: download 2495 ms overlapping gunzip 737 ms, parse 3070 ms, sort 0 ms, write 0 ms, index 459 ms: 6 candidates, 58846 repo-hours, 2182 releases; waiting 502 ms; commit 0 ms)
2026-11-08T12:26:24Z [load_day 2025-06-14] 2025-06-14 hour 4: 130174 events in 0 files, snapshot none (task 5066 ms: download 2480 ms overlapping gunzip 725 ms, parse 3090 ms, sort 0 ms, write 0 ms, index 437 ms: 12 candidates, 54620 repo-hours, 626 releases; waiting 494 ms; commit 0 ms)
2026-11-08T12:26:25Z [load_day 2025-06-14] 2025-06-14 hour 5: 133511 events in 0 files, snapshot none (task 5220 ms: download 3006 ms overlapping gunzip 751 ms, parse 3184 ms, sort 0 ms, write 0 ms, index 526 ms: 11 candidates, 54526 repo-hours, 599 releases; waiting 476 ms; commit 0 ms)
2026-11-08T12:26:31Z [load_day 2025-06-14] 2025-06-14 hour 6: 142348 events in 0 files, snapshot none (task 5940 ms: download 2879 ms overlapping gunzip 903 ms, parse 3593 ms, sort 0 ms, write 0 ms, index 538 ms: 8 candidates, 66509 repo-hours, 844 releases; waiting 548 ms; commit 0 ms)
2026-11-08T12:26:31Z [load_day 2025-06-14] 2025-06-14 hour 7: 140701 events in 0 files, snapshot none (task 5121 ms: download 2671 ms overlapping gunzip 730 ms, parse 3046 ms, sort 0 ms, write 0 ms, index 486 ms: 8 candidates, 58151 repo-hours, 737 releases; waiting 501 ms; commit 0 ms)
2026-11-08T12:26:38Z [load_day 2025-06-14] 2025-06-14 hour 8: 143724 events in 0 files, snapshot none (task 6118 ms: download 3622 ms overlapping gunzip 990 ms, parse 3808 ms, sort 0 ms, write 0 ms, index 579 ms: 13 candidates, 62764 repo-hours, 661 releases; waiting 420 ms; commit 0 ms)
2026-11-08T12:26:38Z [load_day 2025-06-14] 2025-06-14 hour 9: 144879 events in 0 files, snapshot none (task 6285 ms: download 3381 ms overlapping gunzip 944 ms, parse 4072 ms, sort 0 ms, write 0 ms, index 532 ms: 8 candidates, 63115 repo-hours, 826 releases; waiting 499 ms; commit 0 ms)
2026-11-08T12:26:44Z [load_day 2025-06-14] 2025-06-14 hour 10: 145852 events in 0 files, snapshot none (task 6055 ms: download 3503 ms overlapping gunzip 907 ms, parse 3759 ms, sort 0 ms, write 0 ms, index 613 ms: 10 candidates, 64250 repo-hours, 720 releases; waiting 457 ms; commit 0 ms)
2026-11-08T12:26:45Z [load_day 2025-06-14] 2025-06-14 hour 11: 147435 events in 0 files, snapshot none (task 6601 ms: download 3419 ms overlapping gunzip 967 ms, parse 4463 ms, sort 0 ms, write 0 ms, index 522 ms: 3 candidates, 61588 repo-hours, 667 releases; waiting 368 ms; commit 0 ms)
2026-11-08T12:26:51Z [load_day 2025-06-14] 2025-06-14 hour 12: 163134 events in 0 files, snapshot none (task 5594 ms: download 2543 ms overlapping gunzip 717 ms, parse 3167 ms, sort 0 ms, write 0 ms, index 901 ms: 10 candidates, 89993 repo-hours, 647 releases; waiting 481 ms; commit 0 ms)
2026-11-08T12:26:52Z [load_day 2025-06-14] 2025-06-14 hour 13: 151279 events in 0 files, snapshot none (task 6766 ms: download 3451 ms overlapping gunzip 949 ms, parse 4067 ms, sort 0 ms, write 0 ms, index 835 ms: 16 candidates, 77290 repo-hours, 684 releases; waiting 577 ms; commit 0 ms)
2026-11-08T12:26:58Z [load_day 2025-06-14] 2025-06-14 hour 14: 148167 events in 0 files, snapshot none (task 6736 ms: download 3140 ms overlapping gunzip 977 ms, parse 3943 ms, sort 0 ms, write 0 ms, index 847 ms: 4 candidates, 65921 repo-hours, 698 releases; waiting 582 ms; commit 0 ms)
2026-11-08T12:27:00Z [load_day 2025-06-14] 2025-06-14 hour 15: 151305 events in 0 files, snapshot none (task 7288 ms: download 3510 ms overlapping gunzip 987 ms, parse 4176 ms, sort 0 ms, write 0 ms, index 954 ms: 6 candidates, 70268 repo-hours, 720 releases; waiting 475 ms; commit 0 ms)
2026-11-08T12:27:04Z [load_day 2025-06-14] 2025-06-14 hour 16: 148998 events in 0 files, snapshot none (task 5982 ms: download 2537 ms overlapping gunzip 816 ms, parse 3516 ms, sort 0 ms, write 0 ms, index 795 ms: 8 candidates, 67383 repo-hours, 633 releases; waiting 496 ms; commit 0 ms)
2026-11-08T12:27:06Z [load_day 2025-06-14] 2025-06-14 hour 17: 146357 events in 0 files, snapshot none (task 5060 ms: download 3022 ms overlapping gunzip 749 ms, parse 3036 ms, sort 0 ms, write 0 ms, index 492 ms: 7 candidates, 63657 repo-hours, 627 releases; waiting 350 ms; commit 0 ms)
2026-11-08T12:27:10Z [load_day 2025-06-14] 2025-06-14 hour 18: 147951 events in 0 files, snapshot none (task 5087 ms: download 3370 ms overlapping gunzip 763 ms, parse 2820 ms, sort 0 ms, write 0 ms, index 565 ms: 9 candidates, 70225 repo-hours, 775 releases; waiting 653 ms; commit 0 ms)
2026-11-08T12:27:12Z [load_day 2025-06-14] 2025-06-14 hour 19: 144097 events in 0 files, snapshot none (task 5896 ms: download 4305 ms overlapping gunzip 980 ms, parse 3158 ms, sort 0 ms, write 0 ms, index 697 ms: 5 candidates, 55454 repo-hours, 647 releases; waiting 704 ms; commit 0 ms)
2026-11-08T12:27:18Z [load_day 2025-06-14] 2025-06-14 hour 20: 143174 events in 0 files, snapshot none (task 7361 ms: download 5695 ms overlapping gunzip 1430 ms, parse 4610 ms, sort 0 ms, write 0 ms, index 400 ms: 4 candidates, 56533 repo-hours, 637 releases; waiting 627 ms; commit 0 ms)
2026-11-08T12:27:19Z [load_day 2025-06-14] 2025-06-14 hour 21: 141603 events in 0 files, snapshot none (task 6174 ms: download 4426 ms overlapping gunzip 1227 ms, parse 3819 ms, sort 0 ms, write 0 ms, index 434 ms: 10 candidates, 52785 repo-hours, 631 releases; waiting 322 ms; commit 0 ms)
2026-11-08T12:27:26Z [load_day 2025-06-14] 2025-06-14 hour 22: 136724 events in 0 files, snapshot none (task 7181 ms: download 5020 ms overlapping gunzip 1060 ms, parse 3600 ms, sort 0 ms, write 0 ms, index 648 ms: 7 candidates, 50196 repo-hours, 720 releases; waiting 1481 ms; commit 0 ms)
2026-11-08T12:27:26Z [load_day 2025-06-14] 2025-06-14 hour 23: 130455 events in 0 files, snapshot none (task 6824 ms: download 4356 ms overlapping gunzip 1096 ms, parse 3987 ms, sort 0 ms, write 0 ms, index 442 ms: 10 candidates, 49196 repo-hours, 793 releases; waiting 932 ms; commit 0 ms)
2026-11-08T12:27:34Z [load_day 2025-06-14] 2025-06-14: repo_hour merged from 24 files to 1 (1521533 rows, 7387 ms)
2026-11-08T12:27:37Z [load_day 2025-06-14] 2025-06-14: index committed in 10397 ms (24 + 1 + 24 files)
2026-11-08T12:27:37Z [load_day 2025-06-14] 2025-06-14: 3427828 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:27:37Z [load_day 2025-06-14] attempt 1 succeeded