orcaLog in

Runs · run 4155

load_day 2025-07-16, attempt 1 succeeded

Host
73ccef5e07c2:343619
Started
2026-11-08T12:57:27Z
Ended
2026-11-08T12:59:13Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
720 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
149.7 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4155/load_day/2025-07-16/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:57:27Z [load_day 2025-07-16] attempt 1 started
2026-11-08T12:57:28Z [load_day 2025-07-16] 2025-07-16: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:57:35Z [load_day 2025-07-16] 2025-07-16 hour 0: 145984 events in 0 files, snapshot none (task 6358 ms: download 3749 ms overlapping gunzip 972 ms, parse 4019 ms, sort 0 ms, write 0 ms, index 554 ms: 7 candidates, 69828 repo-hours, 1201 releases; waiting 504 ms; commit 0 ms)
2026-11-08T12:57:35Z [load_day 2025-07-16] 2025-07-16 hour 1: 152054 events in 0 files, snapshot none (task 5893 ms: download 3446 ms overlapping gunzip 811 ms, parse 3538 ms, sort 0 ms, write 0 ms, index 610 ms: 7 candidates, 87153 repo-hours, 956 releases; waiting 622 ms; commit 0 ms)
2026-11-08T12:57:43Z [load_day 2025-07-16] 2025-07-16 hour 2: 146434 events in 0 files, snapshot none (task 6701 ms: download 4047 ms overlapping gunzip 965 ms, parse 4005 ms, sort 0 ms, write 0 ms, index 556 ms: 2 candidates, 74643 repo-hours, 1007 releases; waiting 878 ms; commit 0 ms)
2026-11-08T12:57:43Z [load_day 2025-07-16] 2025-07-16 hour 3: 150799 events in 0 files, snapshot none (task 6587 ms: download 3983 ms overlapping gunzip 1043 ms, parse 4326 ms, sort 0 ms, write 0 ms, index 644 ms: 10 candidates, 68794 repo-hours, 1042 releases; waiting 315 ms; commit 0 ms)
2026-11-08T12:57:51Z [load_day 2025-07-16] 2025-07-16 hour 4: 148773 events in 0 files, snapshot none (task 6705 ms: download 3922 ms overlapping gunzip 1030 ms, parse 4281 ms, sort 0 ms, write 0 ms, index 589 ms: 5 candidates, 66359 repo-hours, 2149 releases; waiting 513 ms; commit 0 ms)
2026-11-08T12:57:52Z [load_day 2025-07-16] 2025-07-16 hour 5: 152629 events in 0 files, snapshot none (task 6882 ms: download 4231 ms overlapping gunzip 1076 ms, parse 4395 ms, sort 0 ms, write 0 ms, index 608 ms: 7 candidates, 66696 repo-hours, 739 releases; waiting 495 ms; commit 0 ms)
2026-11-08T12:57:59Z [load_day 2025-07-16] 2025-07-16 hour 6: 160787 events in 0 files, snapshot none (task 7077 ms: download 4106 ms overlapping gunzip 1041 ms, parse 4274 ms, sort 0 ms, write 0 ms, index 680 ms: 9 candidates, 79520 repo-hours, 837 releases; waiting 468 ms; commit 0 ms)
2026-11-08T12:57:59Z [load_day 2025-07-16] 2025-07-16 hour 7: 159623 events in 0 files, snapshot none (task 6794 ms: download 4357 ms overlapping gunzip 1045 ms, parse 4376 ms, sort 0 ms, write 0 ms, index 555 ms: 9 candidates, 77016 repo-hours, 888 releases; waiting 506 ms; commit 0 ms)
2026-11-08T12:58:05Z [load_day 2025-07-16] 2025-07-16 hour 8: 161409 events in 0 files, snapshot none (task 5670 ms: download 3781 ms overlapping gunzip 853 ms, parse 3397 ms, sort 0 ms, write 0 ms, index 580 ms: 6 candidates, 80645 repo-hours, 1056 releases; waiting 540 ms; commit 0 ms)
2026-11-08T12:58:06Z [load_day 2025-07-16] 2025-07-16 hour 9: 162383 events in 0 files, snapshot none (task 6577 ms: download 4712 ms overlapping gunzip 991 ms, parse 3838 ms, sort 0 ms, write 0 ms, index 640 ms: 12 candidates, 83142 repo-hours, 1081 releases; waiting 747 ms; commit 0 ms)
2026-11-08T12:58:11Z [load_day 2025-07-16] 2025-07-16 hour 10: 157850 events in 0 files, snapshot none (task 5518 ms: download 3174 ms overlapping gunzip 806 ms, parse 3284 ms, sort 0 ms, write 0 ms, index 562 ms: 7 candidates, 78740 repo-hours, 1001 releases; waiting 581 ms; commit 0 ms)
2026-11-08T12:58:12Z [load_day 2025-07-16] 2025-07-16 hour 11: 157792 events in 0 files, snapshot none (task 5568 ms: download 3443 ms overlapping gunzip 800 ms, parse 3308 ms, sort 0 ms, write 0 ms, index 610 ms: 7 candidates, 76094 repo-hours, 898 releases; waiting 538 ms; commit 0 ms)
2026-11-08T12:58:20Z [load_day 2025-07-16] 2025-07-16 hour 12: 170210 events in 0 files, snapshot none (task 8411 ms: download 5695 ms overlapping gunzip 851 ms, parse 3746 ms, sort 0 ms, write 0 ms, index 886 ms: 9 candidates, 99005 repo-hours, 995 releases; waiting 2701 ms; commit 0 ms)
2026-11-08T12:58:21Z [load_day 2025-07-16] 2025-07-16 hour 13: 168004 events in 0 files, snapshot none (task 8678 ms: download 5233 ms overlapping gunzip 1080 ms, parse 4400 ms, sort 0 ms, write 0 ms, index 1011 ms: 9 candidates, 92567 repo-hours, 875 releases; waiting 1871 ms; commit 0 ms)
2026-11-08T12:58:27Z [load_day 2025-07-16] 2025-07-16 hour 14: 164715 events in 0 files, snapshot none (task 6564 ms: download 3252 ms overlapping gunzip 998 ms, parse 4099 ms, sort 0 ms, write 0 ms, index 1214 ms: 3 candidates, 84524 repo-hours, 833 releases; waiting 21 ms; commit 0 ms)
2026-11-08T12:58:30Z [load_day 2025-07-16] 2025-07-16 hour 15: 163230 events in 0 files, snapshot none (task 7467 ms: download 4526 ms overlapping gunzip 1142 ms, parse 4588 ms, sort 0 ms, write 0 ms, index 888 ms: 7 candidates, 84392 repo-hours, 906 releases; waiting 584 ms; commit 0 ms)
2026-11-08T12:58:36Z [load_day 2025-07-16] 2025-07-16 hour 16: 161964 events in 0 files, snapshot none (task 7602 ms: download 3894 ms overlapping gunzip 1072 ms, parse 4442 ms, sort 0 ms, write 0 ms, index 1039 ms: 5 candidates, 80941 repo-hours, 843 releases; waiting 606 ms; commit 0 ms)
2026-11-08T12:58:39Z [load_day 2025-07-16] 2025-07-16 hour 17: 164452 events in 0 files, snapshot none (task 8578 ms: download 4620 ms overlapping gunzip 1366 ms, parse 5632 ms, sort 0 ms, write 0 ms, index 978 ms: 8 candidates, 78880 repo-hours, 774 releases; waiting 343 ms; commit 0 ms)
2026-11-08T12:58:45Z [load_day 2025-07-16] 2025-07-16 hour 18: 162756 events in 0 files, snapshot none (task 9033 ms: download 4070 ms overlapping gunzip 1353 ms, parse 5709 ms, sort 0 ms, write 0 ms, index 1213 ms: 22 candidates, 81812 repo-hours, 828 releases; waiting 467 ms; commit 0 ms)
2026-11-08T12:58:48Z [load_day 2025-07-16] 2025-07-16 hour 19: 159647 events in 0 files, snapshot none (task 8805 ms: download 5874 ms overlapping gunzip 1417 ms, parse 5731 ms, sort 0 ms, write 0 ms, index 730 ms: 5 candidates, 71809 repo-hours, 873 releases; waiting 512 ms; commit 0 ms)
2026-11-08T12:58:53Z [load_day 2025-07-16] 2025-07-16 hour 20: 153321 events in 0 files, snapshot none (task 6950 ms: download 3069 ms overlapping gunzip 1038 ms, parse 4262 ms, sort 0 ms, write 0 ms, index 1114 ms: 6 candidates, 71162 repo-hours, 860 releases; waiting 230 ms; commit 0 ms)
2026-11-08T12:58:56Z [load_day 2025-07-16] 2025-07-16 hour 21: 152007 events in 0 files, snapshot none (task 7032 ms: download 4315 ms overlapping gunzip 1021 ms, parse 4363 ms, sort 0 ms, write 0 ms, index 764 ms: 8 candidates, 66800 repo-hours, 1084 releases; waiting 570 ms; commit 0 ms)
2026-11-08T12:59:00Z [load_day 2025-07-16] 2025-07-16 hour 22: 148189 events in 0 files, snapshot none (task 6811 ms: download 3250 ms overlapping gunzip 981 ms, parse 4091 ms, sort 0 ms, write 0 ms, index 866 ms: 6 candidates, 62261 repo-hours, 1060 releases; waiting 526 ms; commit 0 ms)
2026-11-08T12:59:02Z [load_day 2025-07-16] 2025-07-16 hour 23: 140422 events in 0 files, snapshot none (task 6153 ms: download 3793 ms overlapping gunzip 942 ms, parse 3993 ms, sort 0 ms, write 0 ms, index 398 ms: 8 candidates, 56939 repo-hours, 1037 releases; waiting 523 ms; commit 0 ms)
2026-11-08T12:59:11Z [load_day 2025-07-16] 2025-07-16: repo_hour merged from 24 files to 1 (1839722 rows, 8514 ms)
2026-11-08T12:59:13Z [load_day 2025-07-16] 2025-07-16: index committed in 11147 ms (24 + 1 + 24 files)
2026-11-08T12:59:13Z [load_day 2025-07-16] 2025-07-16: 3765434 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:59:13Z [load_day 2025-07-16] attempt 1 succeeded