orcaLog in

Runs · run 4103

load_day 2025-07-02, attempt 1 succeeded

Host
73ccef5e07c2:336266
Started
2026-11-08T12:46:12Z
Ended
2026-11-08T12:47:51Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
701 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
146.2 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4103/load_day/2025-07-02/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:46:12Z [load_day 2025-07-02] attempt 1 started
2026-11-08T12:46:13Z [load_day 2025-07-02] 2025-07-02: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:46:20Z [load_day 2025-07-02] 2025-07-02 hour 0: 146851 events in 0 files, snapshot none (task 5546 ms: download 2772 ms overlapping gunzip 814 ms, parse 3331 ms, sort 0 ms, write 0 ms, index 730 ms: 11 candidates, 72327 repo-hours, 1028 releases; waiting 339 ms; commit 0 ms)
2026-11-08T12:46:22Z [load_day 2025-07-02] 2025-07-02 hour 1: 157006 events in 0 files, snapshot none (task 7336 ms: download 3683 ms overlapping gunzip 970 ms, parse 3976 ms, sort 0 ms, write 0 ms, index 1057 ms: 7 candidates, 89524 repo-hours, 680 releases; waiting 1015 ms; commit 0 ms)
2026-11-08T12:46:26Z [load_day 2025-07-02] 2025-07-02 hour 2: 147605 events in 0 files, snapshot none (task 5343 ms: download 2788 ms overlapping gunzip 815 ms, parse 3288 ms, sort 0 ms, write 0 ms, index 540 ms: 3 candidates, 72140 repo-hours, 681 releases; waiting 391 ms; commit 0 ms)
2026-11-08T12:46:28Z [load_day 2025-07-02] 2025-07-02 hour 3: 146829 events in 0 files, snapshot none (task 5741 ms: download 3483 ms overlapping gunzip 769 ms, parse 3145 ms, sort 0 ms, write 0 ms, index 894 ms: 3 candidates, 68607 repo-hours, 1555 releases; waiting 579 ms; commit 0 ms)
2026-11-08T12:46:32Z [load_day 2025-07-02] 2025-07-02 hour 4: 145002 events in 0 files, snapshot none (task 5971 ms: download 3096 ms overlapping gunzip 909 ms, parse 3727 ms, sort 0 ms, write 0 ms, index 584 ms: 6 candidates, 65554 repo-hours, 1075 releases; waiting 461 ms; commit 0 ms)
2026-11-08T12:46:35Z [load_day 2025-07-02] 2025-07-02 hour 5: 149513 events in 0 files, snapshot none (task 6545 ms: download 3568 ms overlapping gunzip 832 ms, parse 3365 ms, sort 0 ms, write 0 ms, index 1297 ms: 4 candidates, 67260 repo-hours, 612 releases; waiting 780 ms; commit 0 ms)
2026-11-08T12:46:40Z [load_day 2025-07-02] 2025-07-02 hour 6: 156934 events in 0 files, snapshot none (task 7185 ms: download 3884 ms overlapping gunzip 1093 ms, parse 4443 ms, sort 0 ms, write 0 ms, index 949 ms: 6 candidates, 80093 repo-hours, 741 releases; waiting 385 ms; commit 0 ms)
2026-11-08T12:46:42Z [load_day 2025-07-02] 2025-07-02 hour 7: 158048 events in 0 files, snapshot none (task 6163 ms: download 3826 ms overlapping gunzip 872 ms, parse 3433 ms, sort 0 ms, write 0 ms, index 811 ms: 7 candidates, 77385 repo-hours, 727 releases; waiting 674 ms; commit 0 ms)
2026-11-08T12:46:46Z [load_day 2025-07-02] 2025-07-02 hour 8: 152724 events in 0 files, snapshot none (task 5896 ms: download 3109 ms overlapping gunzip 914 ms, parse 3720 ms, sort 0 ms, write 0 ms, index 628 ms: 10 candidates, 78040 repo-hours, 945 releases; waiting 360 ms; commit 0 ms)
2026-11-08T12:46:49Z [load_day 2025-07-02] 2025-07-02 hour 9: 159980 events in 0 files, snapshot none (task 6434 ms: download 3884 ms overlapping gunzip 959 ms, parse 3937 ms, sort 0 ms, write 0 ms, index 620 ms: 13 candidates, 82597 repo-hours, 997 releases; waiting 502 ms; commit 0 ms)
2026-11-08T12:46:52Z [load_day 2025-07-02] 2025-07-02 hour 10: 157132 events in 0 files, snapshot none (task 5317 ms: download 3016 ms overlapping gunzip 772 ms, parse 3149 ms, sort 0 ms, write 0 ms, index 626 ms: 7 candidates, 77482 repo-hours, 770 releases; waiting 346 ms; commit 0 ms)
2026-11-08T12:46:56Z [load_day 2025-07-02] 2025-07-02 hour 11: 161138 events in 0 files, snapshot none (task 5917 ms: download 3533 ms overlapping gunzip 865 ms, parse 3507 ms, sort 0 ms, write 0 ms, index 647 ms: 11 candidates, 76896 repo-hours, 855 releases; waiting 546 ms; commit 0 ms)
2026-11-08T12:46:58Z [load_day 2025-07-02] 2025-07-02 hour 12: 169667 events in 0 files, snapshot none (task 5715 ms: download 3878 ms overlapping gunzip 829 ms, parse 3402 ms, sort 0 ms, write 0 ms, index 682 ms: 2 candidates, 98328 repo-hours, 950 releases; waiting 527 ms; commit 0 ms)
2026-11-08T12:47:02Z [load_day 2025-07-02] 2025-07-02 hour 13: 164482 events in 0 files, snapshot none (task 6021 ms: download 3436 ms overlapping gunzip 842 ms, parse 3392 ms, sort 0 ms, write 0 ms, index 755 ms: 7 candidates, 91466 repo-hours, 754 releases; waiting 804 ms; commit 0 ms)
2026-11-08T12:47:06Z [load_day 2025-07-02] 2025-07-02 hour 14: 164911 events in 0 files, snapshot none (task 6783 ms: download 3928 ms overlapping gunzip 983 ms, parse 4074 ms, sort 0 ms, write 0 ms, index 900 ms: 4 candidates, 84113 repo-hours, 972 releases; waiting 512 ms; commit 0 ms)
2026-11-08T12:47:10Z [load_day 2025-07-02] 2025-07-02 hour 15: 161481 events in 0 files, snapshot none (task 6774 ms: download 4185 ms overlapping gunzip 1038 ms, parse 4155 ms, sort 0 ms, write 0 ms, index 779 ms: 7 candidates, 83033 repo-hours, 896 releases; waiting 550 ms; commit 0 ms)
2026-11-08T12:47:14Z [load_day 2025-07-02] 2025-07-02 hour 16: 159365 events in 0 files, snapshot none (task 7324 ms: download 4204 ms overlapping gunzip 1000 ms, parse 4258 ms, sort 0 ms, write 0 ms, index 941 ms: 10 candidates, 80172 repo-hours, 904 releases; waiting 885 ms; commit 0 ms)
2026-11-08T12:47:18Z [load_day 2025-07-02] 2025-07-02 hour 17: 158515 events in 0 files, snapshot none (task 7792 ms: download 4626 ms overlapping gunzip 1236 ms, parse 4844 ms, sort 0 ms, write 0 ms, index 984 ms: 4 candidates, 75296 repo-hours, 792 releases; waiting 485 ms; commit 0 ms)
2026-11-08T12:47:21Z [load_day 2025-07-02] 2025-07-02 hour 18: 160829 events in 0 files, snapshot none (task 7106 ms: download 4103 ms overlapping gunzip 1063 ms, parse 4193 ms, sort 0 ms, write 0 ms, index 965 ms: 12 candidates, 82613 repo-hours, 813 releases; waiting 509 ms; commit 0 ms)
2026-11-08T12:47:25Z [load_day 2025-07-02] 2025-07-02 hour 19: 157160 events in 0 files, snapshot none (task 6514 ms: download 3432 ms overlapping gunzip 1010 ms, parse 4190 ms, sort 0 ms, write 0 ms, index 654 ms: 7 candidates, 71957 repo-hours, 879 releases; waiting 352 ms; commit 0 ms)
2026-11-08T12:47:29Z [load_day 2025-07-02] 2025-07-02 hour 20: 152907 events in 0 files, snapshot none (task 7100 ms: download 3598 ms overlapping gunzip 1071 ms, parse 4470 ms, sort 0 ms, write 0 ms, index 1051 ms: 8 candidates, 69935 repo-hours, 910 releases; waiting 191 ms; commit 0 ms)
2026-11-08T12:47:32Z [load_day 2025-07-02] 2025-07-02 hour 21: 152661 events in 0 files, snapshot none (task 6639 ms: download 3623 ms overlapping gunzip 931 ms, parse 3734 ms, sort 0 ms, write 0 ms, index 879 ms: 15 candidates, 68128 repo-hours, 1011 releases; waiting 586 ms; commit 0 ms)
2026-11-08T12:47:37Z [load_day 2025-07-02] 2025-07-02 hour 22: 145559 events in 0 files, snapshot none (task 6996 ms: download 3953 ms overlapping gunzip 977 ms, parse 3771 ms, sort 0 ms, write 0 ms, index 1144 ms: 9 candidates, 60560 repo-hours, 923 releases; waiting 684 ms; commit 0 ms)
2026-11-08T12:47:39Z [load_day 2025-07-02] 2025-07-02 hour 23: 137163 events in 0 files, snapshot none (task 5807 ms: download 3343 ms overlapping gunzip 805 ms, parse 3780 ms, sort 0 ms, write 0 ms, index 402 ms: 7 candidates, 58039 repo-hours, 1112 releases; waiting 491 ms; commit 0 ms)
2026-11-08T12:47:48Z [load_day 2025-07-02] 2025-07-02: repo_hour merged from 24 files to 1 (1831545 rows, 8910 ms)
2026-11-08T12:47:51Z [load_day 2025-07-02] 2025-07-02: index committed in 11768 ms (24 + 1 + 24 files)
2026-11-08T12:47:51Z [load_day 2025-07-02] 2025-07-02: 3723462 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:47:51Z [load_day 2025-07-02] attempt 1 succeeded