orcaLog in

Runs · run 4390

load_day 2025-09-14, attempt 1 succeeded

Host
73ccef5e07c2:378819
Started
2026-11-08T13:50:18Z
Ended
2026-11-08T13:51:50Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
714 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
122.1 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4390/load_day/2025-09-14/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:50:18Z [load_day 2025-09-14] attempt 1 started
2026-11-08T13:50:19Z [load_day 2025-09-14] 2025-09-14: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:50:24Z [load_day 2025-09-14] 2025-09-14 hour 0: 137682 events in 0 files, snapshot none (task 4794 ms: download 2998 ms overlapping gunzip 669 ms, parse 2563 ms, sort 0 ms, write 0 ms, index 503 ms: 10 candidates, 68090 repo-hours, 978 releases; waiting 704 ms; commit 0 ms)
2026-11-08T13:50:24Z [load_day 2025-09-14] 2025-09-14 hour 1: 150447 events in 0 files, snapshot none (task 4493 ms: download 2629 ms overlapping gunzip 571 ms, parse 2425 ms, sort 0 ms, write 0 ms, index 634 ms: 4 candidates, 86593 repo-hours, 716 releases; waiting 531 ms; commit 0 ms)
2026-11-08T13:50:31Z [load_day 2025-09-14] 2025-09-14 hour 2: 139917 events in 0 files, snapshot none (task 6057 ms: download 3275 ms overlapping gunzip 954 ms, parse 3780 ms, sort 0 ms, write 0 ms, index 557 ms: 9 candidates, 63686 repo-hours, 767 releases; waiting 485 ms; commit 0 ms)
2026-11-08T13:50:31Z [load_day 2025-09-14] 2025-09-14 hour 3: 146059 events in 0 files, snapshot none (task 6070 ms: download 3664 ms overlapping gunzip 949 ms, parse 3894 ms, sort 0 ms, write 0 ms, index 475 ms: 4 candidates, 58719 repo-hours, 2143 releases; waiting 498 ms; commit 0 ms)
2026-11-08T13:50:37Z [load_day 2025-09-14] 2025-09-14 hour 4: 141827 events in 0 files, snapshot none (task 5627 ms: download 2362 ms overlapping gunzip 877 ms, parse 3751 ms, sort 0 ms, write 0 ms, index 477 ms: 4 candidates, 54682 repo-hours, 601 releases; waiting 246 ms; commit 0 ms)
2026-11-08T13:50:37Z [load_day 2025-09-14] 2025-09-14 hour 5: 142629 events in 0 files, snapshot none (task 5678 ms: download 2705 ms overlapping gunzip 880 ms, parse 3445 ms, sort 0 ms, write 0 ms, index 447 ms: 2 candidates, 55938 repo-hours, 541 releases; waiting 672 ms; commit 0 ms)
2026-11-08T13:50:43Z [load_day 2025-09-14] 2025-09-14 hour 6: 148944 events in 0 files, snapshot none (task 5007 ms: download 2166 ms overlapping gunzip 666 ms, parse 2797 ms, sort 0 ms, write 0 ms, index 965 ms: 2 candidates, 67270 repo-hours, 628 releases; waiting 220 ms; commit 0 ms)
2026-11-08T13:50:43Z [load_day 2025-09-14] 2025-09-14 hour 7: 148288 events in 0 files, snapshot none (task 5151 ms: download 2770 ms overlapping gunzip 722 ms, parse 3001 ms, sort 0 ms, write 0 ms, index 560 ms: 7 candidates, 61720 repo-hours, 552 releases; waiting 480 ms; commit 0 ms)
2026-11-08T13:50:49Z [load_day 2025-09-14] 2025-09-14 hour 8: 150938 events in 0 files, snapshot none (task 5577 ms: download 3576 ms overlapping gunzip 789 ms, parse 3278 ms, sort 0 ms, write 0 ms, index 545 ms: 8 candidates, 63473 repo-hours, 622 releases; waiting 648 ms; commit 0 ms)
2026-11-08T13:50:49Z [load_day 2025-09-14] 2025-09-14 hour 9: 152380 events in 0 files, snapshot none (task 5753 ms: download 3038 ms overlapping gunzip 759 ms, parse 3426 ms, sort 0 ms, write 0 ms, index 702 ms: 5 candidates, 64629 repo-hours, 714 releases; waiting 492 ms; commit 0 ms)
2026-11-08T13:50:55Z [load_day 2025-09-14] 2025-09-14 hour 10: 153675 events in 0 files, snapshot none (task 5317 ms: download 2520 ms overlapping gunzip 786 ms, parse 3390 ms, sort 0 ms, write 0 ms, index 548 ms: 6 candidates, 66970 repo-hours, 599 releases; waiting 233 ms; commit 0 ms)
2026-11-08T13:50:56Z [load_day 2025-09-14] 2025-09-14 hour 11: 156314 events in 0 files, snapshot none (task 6550 ms: download 4180 ms overlapping gunzip 769 ms, parse 3459 ms, sort 0 ms, write 0 ms, index 553 ms: 17 candidates, 62463 repo-hours, 638 releases; waiting 1380 ms; commit 0 ms)
2026-11-08T13:51:02Z [load_day 2025-09-14] 2025-09-14 hour 12: 173115 events in 0 files, snapshot none (task 6353 ms: download 3034 ms overlapping gunzip 895 ms, parse 3953 ms, sort 0 ms, write 0 ms, index 700 ms: 7 candidates, 94496 repo-hours, 709 releases; waiting 477 ms; commit 0 ms)
2026-11-08T13:51:03Z [load_day 2025-09-14] 2025-09-14 hour 13: 165066 events in 0 files, snapshot none (task 6141 ms: download 3272 ms overlapping gunzip 866 ms, parse 3828 ms, sort 0 ms, write 0 ms, index 606 ms: 1 candidates, 81633 repo-hours, 650 releases; waiting 194 ms; commit 0 ms)
2026-11-08T13:51:09Z [load_day 2025-09-14] 2025-09-14 hour 14: 156234 events in 0 files, snapshot none (task 6539 ms: download 3978 ms overlapping gunzip 1017 ms, parse 3935 ms, sort 0 ms, write 0 ms, index 566 ms: 4 candidates, 69399 repo-hours, 725 releases; waiting 734 ms; commit 0 ms)
2026-11-08T13:51:10Z [load_day 2025-09-14] 2025-09-14 hour 15: 162676 events in 0 files, snapshot none (task 6374 ms: download 3934 ms overlapping gunzip 1034 ms, parse 4026 ms, sort 0 ms, write 0 ms, index 536 ms: 11 candidates, 71673 repo-hours, 865 releases; waiting 518 ms; commit 0 ms)
2026-11-08T13:51:17Z [load_day 2025-09-14] 2025-09-14 hour 16: 155003 events in 0 files, snapshot none (task 7659 ms: download 3910 ms overlapping gunzip 1165 ms, parse 4819 ms, sort 0 ms, write 0 ms, index 802 ms: 5 candidates, 69381 repo-hours, 880 releases; waiting 598 ms; commit 0 ms)
2026-11-08T13:51:17Z [load_day 2025-09-14] 2025-09-14 hour 17: 158460 events in 0 files, snapshot none (task 7321 ms: download 4748 ms overlapping gunzip 1200 ms, parse 4738 ms, sort 0 ms, write 0 ms, index 619 ms: 6 candidates, 68538 repo-hours, 735 releases; waiting 529 ms; commit 0 ms)
2026-11-08T13:51:25Z [load_day 2025-09-14] 2025-09-14 hour 18: 157549 events in 0 files, snapshot none (task 7109 ms: download 4190 ms overlapping gunzip 1100 ms, parse 4315 ms, sort 0 ms, write 0 ms, index 715 ms: 2 candidates, 75366 repo-hours, 778 releases; waiting 660 ms; commit 0 ms)
2026-11-08T13:51:25Z [load_day 2025-09-14] 2025-09-14 hour 19: 152374 events in 0 files, snapshot none (task 7013 ms: download 4210 ms overlapping gunzip 1062 ms, parse 4649 ms, sort 0 ms, write 0 ms, index 466 ms: 6 candidates, 60458 repo-hours, 807 releases; waiting 553 ms; commit 0 ms)
2026-11-08T13:51:32Z [load_day 2025-09-14] 2025-09-14 hour 20: 150148 events in 0 files, snapshot none (task 6868 ms: download 4832 ms overlapping gunzip 1066 ms, parse 4291 ms, sort 0 ms, write 0 ms, index 485 ms: 6 candidates, 60961 repo-hours, 882 releases; waiting 714 ms; commit 0 ms)
2026-11-08T13:51:32Z [load_day 2025-09-14] 2025-09-14 hour 21: 147132 events in 0 files, snapshot none (task 6160 ms: download 3030 ms overlapping gunzip 947 ms, parse 3893 ms, sort 0 ms, write 0 ms, index 541 ms: 14 candidates, 59388 repo-hours, 809 releases; waiting 538 ms; commit 0 ms)
2026-11-08T13:51:39Z [load_day 2025-09-14] 2025-09-14 hour 22: 140510 events in 0 files, snapshot none (task 5848 ms: download 2833 ms overlapping gunzip 899 ms, parse 3785 ms, sort 0 ms, write 0 ms, index 536 ms: 5 candidates, 54696 repo-hours, 738 releases; waiting 402 ms; commit 0 ms)
2026-11-08T13:51:39Z [load_day 2025-09-14] 2025-09-14 hour 23: 136001 events in 0 files, snapshot none (task 6137 ms: download 2964 ms overlapping gunzip 945 ms, parse 3953 ms, sort 0 ms, write 0 ms, index 427 ms: 3 candidates, 51604 repo-hours, 564 releases; waiting 518 ms; commit 0 ms)
2026-11-08T13:51:47Z [load_day 2025-09-14] 2025-09-14: repo_hour merged from 24 files to 1 (1591826 rows, 8024 ms)
2026-11-08T13:51:50Z [load_day 2025-09-14] 2025-09-14: index committed in 11098 ms (24 + 1 + 24 files)
2026-11-08T13:51:50Z [load_day 2025-09-14] 2025-09-14: 3623368 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:51:50Z [load_day 2025-09-14] attempt 1 succeeded