orcaLog in

Runs · run 4357

load_day 2025-09-06, attempt 1 succeeded

Host
73ccef5e07c2:373811
Started
2026-11-08T13:42:53Z
Ended
2026-11-08T13:44:23Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
641 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
119.5 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4357/load_day/2025-09-06/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:42:53Z [load_day 2025-09-06] attempt 1 started
2026-11-08T13:42:54Z [load_day 2025-09-06] 2025-09-06: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:43:01Z [load_day 2025-09-06] 2025-09-06 hour 0: 139298 events in 0 files, snapshot none (task 6311 ms: download 3692 ms overlapping gunzip 981 ms, parse 3945 ms, sort 0 ms, write 0 ms, index 568 ms: 5 candidates, 69608 repo-hours, 1211 releases; waiting 524 ms; commit 0 ms)
2026-11-08T13:43:01Z [load_day 2025-09-06] 2025-09-06 hour 1: 148977 events in 0 files, snapshot none (task 6476 ms: download 3602 ms overlapping gunzip 964 ms, parse 4109 ms, sort 0 ms, write 0 ms, index 648 ms: 4 candidates, 85309 repo-hours, 785 releases; waiting 514 ms; commit 0 ms)
2026-11-08T13:43:08Z [load_day 2025-09-06] 2025-09-06 hour 2: 133937 events in 0 files, snapshot none (task 7112 ms: download 3817 ms overlapping gunzip 1082 ms, parse 4478 ms, sort 0 ms, write 0 ms, index 466 ms: 7 candidates, 60297 repo-hours, 917 releases; waiting 689 ms; commit 0 ms)
2026-11-08T13:43:08Z [load_day 2025-09-06] 2025-09-06 hour 3: 140937 events in 0 files, snapshot none (task 6116 ms: download 2662 ms overlapping gunzip 832 ms, parse 3805 ms, sort 0 ms, write 0 ms, index 646 ms: 4 candidates, 56715 repo-hours, 1971 releases; waiting 532 ms; commit 0 ms)
2026-11-08T13:43:15Z [load_day 2025-09-06] 2025-09-06 hour 4: 140001 events in 0 files, snapshot none (task 6495 ms: download 2887 ms overlapping gunzip 1039 ms, parse 3995 ms, sort 0 ms, write 0 ms, index 697 ms: 7 candidates, 55184 repo-hours, 653 releases; waiting 501 ms; commit 0 ms)
2026-11-08T13:43:16Z [load_day 2025-09-06] 2025-09-06 hour 5: 144235 events in 0 files, snapshot none (task 6916 ms: download 2828 ms overlapping gunzip 1083 ms, parse 4203 ms, sort 0 ms, write 0 ms, index 856 ms: 10 candidates, 56300 repo-hours, 581 releases; waiting 478 ms; commit 0 ms)
2026-11-08T13:43:21Z [load_day 2025-09-06] 2025-09-06 hour 6: 149398 events in 0 files, snapshot none (task 5194 ms: download 2958 ms overlapping gunzip 740 ms, parse 3113 ms, sort 0 ms, write 0 ms, index 586 ms: 7 candidates, 66622 repo-hours, 849 releases; waiting 506 ms; commit 0 ms)
2026-11-08T13:43:21Z [load_day 2025-09-06] 2025-09-06 hour 7: 147321 events in 0 files, snapshot none (task 5037 ms: download 2862 ms overlapping gunzip 738 ms, parse 2958 ms, sort 0 ms, write 0 ms, index 486 ms: 8 candidates, 59452 repo-hours, 766 releases; waiting 546 ms; commit 0 ms)
2026-11-08T13:43:28Z [load_day 2025-09-06] 2025-09-06 hour 8: 148204 events in 0 files, snapshot none (task 6091 ms: download 3577 ms overlapping gunzip 967 ms, parse 3852 ms, sort 0 ms, write 0 ms, index 491 ms: 7 candidates, 62299 repo-hours, 725 releases; waiting 512 ms; commit 0 ms)
2026-11-08T13:43:28Z [load_day 2025-09-06] 2025-09-06 hour 9: 153273 events in 0 files, snapshot none (task 5812 ms: download 3097 ms overlapping gunzip 921 ms, parse 3600 ms, sort 0 ms, write 0 ms, index 544 ms: 7 candidates, 65688 repo-hours, 811 releases; waiting 291 ms; commit 0 ms)
2026-11-08T13:43:34Z [load_day 2025-09-06] 2025-09-06 hour 10: 150658 events in 0 files, snapshot none (task 6118 ms: download 3639 ms overlapping gunzip 939 ms, parse 3895 ms, sort 0 ms, write 0 ms, index 473 ms: 4 candidates, 63926 repo-hours, 816 releases; waiting 507 ms; commit 0 ms)
2026-11-08T13:43:34Z [load_day 2025-09-06] 2025-09-06 hour 11: 150990 events in 0 files, snapshot none (task 5765 ms: download 2913 ms overlapping gunzip 969 ms, parse 3747 ms, sort 0 ms, write 0 ms, index 523 ms: 7 candidates, 61293 repo-hours, 645 releases; waiting 189 ms; commit 0 ms)
2026-11-08T13:43:41Z [load_day 2025-09-06] 2025-09-06 hour 12: 165294 events in 0 files, snapshot none (task 5863 ms: download 2269 ms overlapping gunzip 848 ms, parse 3753 ms, sort 0 ms, write 0 ms, index 767 ms: 7 candidates, 90170 repo-hours, 730 releases; waiting 244 ms; commit 0 ms)
2026-11-08T13:43:41Z [load_day 2025-09-06] 2025-09-06 hour 13: 160515 events in 0 files, snapshot none (task 6329 ms: download 3422 ms overlapping gunzip 945 ms, parse 3739 ms, sort 0 ms, write 0 ms, index 600 ms: 3 candidates, 76085 repo-hours, 643 releases; waiting 541 ms; commit 0 ms)
2026-11-08T13:43:46Z [load_day 2025-09-06] 2025-09-06 hour 14: 153669 events in 0 files, snapshot none (task 4682 ms: download 2862 ms overlapping gunzip 694 ms, parse 2657 ms, sort 0 ms, write 0 ms, index 573 ms: 16 candidates, 66837 repo-hours, 702 releases; waiting 481 ms; commit 0 ms)
2026-11-08T13:43:47Z [load_day 2025-09-06] 2025-09-06 hour 15: 157988 events in 0 files, snapshot none (task 4839 ms: download 3077 ms overlapping gunzip 706 ms, parse 2762 ms, sort 0 ms, write 0 ms, index 541 ms: 13 candidates, 71030 repo-hours, 806 releases; waiting 519 ms; commit 0 ms)
2026-11-08T13:43:51Z [load_day 2025-09-06] 2025-09-06 hour 16: 157662 events in 0 files, snapshot none (task 4929 ms: download 3128 ms overlapping gunzip 682 ms, parse 2749 ms, sort 0 ms, write 0 ms, index 530 ms: 7 candidates, 69000 repo-hours, 788 releases; waiting 720 ms; commit 0 ms)
2026-11-08T13:43:52Z [load_day 2025-09-06] 2025-09-06 hour 17: 153018 events in 0 files, snapshot none (task 4826 ms: download 3311 ms overlapping gunzip 707 ms, parse 2741 ms, sort 0 ms, write 0 ms, index 484 ms: 4 candidates, 63332 repo-hours, 780 releases; waiting 587 ms; commit 0 ms)
2026-11-08T13:43:59Z [load_day 2025-09-06] 2025-09-06 hour 18: 157725 events in 0 files, snapshot none (task 7112 ms: download 4119 ms overlapping gunzip 878 ms, parse 3484 ms, sort 0 ms, write 0 ms, index 677 ms: 10 candidates, 73678 repo-hours, 782 releases; waiting 1677 ms; commit 0 ms)
2026-11-08T13:43:59Z [load_day 2025-09-06] 2025-09-06 hour 19: 150465 events in 0 files, snapshot none (task 5690 ms: download 2626 ms overlapping gunzip 872 ms, parse 3373 ms, sort 0 ms, write 0 ms, index 674 ms: 4 candidates, 59100 repo-hours, 709 releases; waiting 351 ms; commit 0 ms)
2026-11-08T13:44:05Z [load_day 2025-09-06] 2025-09-06 hour 20: 145917 events in 0 files, snapshot none (task 5432 ms: download 2703 ms overlapping gunzip 804 ms, parse 3395 ms, sort 0 ms, write 0 ms, index 438 ms: 5 candidates, 57975 repo-hours, 711 releases; waiting 573 ms; commit 0 ms)
2026-11-08T13:44:05Z [load_day 2025-09-06] 2025-09-06 hour 21: 144823 events in 0 files, snapshot none (task 5841 ms: download 3332 ms overlapping gunzip 855 ms, parse 3492 ms, sort 0 ms, write 0 ms, index 448 ms: 8 candidates, 56519 repo-hours, 849 releases; waiting 728 ms; commit 0 ms)
2026-11-08T13:44:11Z [load_day 2025-09-06] 2025-09-06 hour 22: 141073 events in 0 files, snapshot none (task 6165 ms: download 2963 ms overlapping gunzip 917 ms, parse 3967 ms, sort 0 ms, write 0 ms, index 472 ms: 8 candidates, 51756 repo-hours, 1058 releases; waiting 510 ms; commit 0 ms)
2026-11-08T13:44:12Z [load_day 2025-09-06] 2025-09-06 hour 23: 142582 events in 0 files, snapshot none (task 6003 ms: download 3056 ms overlapping gunzip 973 ms, parse 4078 ms, sort 0 ms, write 0 ms, index 498 ms: 7 candidates, 52546 repo-hours, 755 releases; waiting 230 ms; commit 0 ms)
2026-11-08T13:44:20Z [load_day 2025-09-06] 2025-09-06: repo_hour merged from 24 files to 1 (1550721 rows, 7947 ms)
2026-11-08T13:44:23Z [load_day 2025-09-06] 2025-09-06: index committed in 10918 ms (24 + 1 + 24 files)
2026-11-08T13:44:23Z [load_day 2025-09-06] 2025-09-06: 3577960 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:44:23Z [load_day 2025-09-06] attempt 1 succeeded