orcaLog in

Runs · run 3267

load_day 2024-12-02, attempt 1 succeeded

Host
73ccef5e07c2:215690
Started
2026-11-08T09:09:35Z
Ended
2026-11-08T09:12:10Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
795 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
259.9 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3267/load_day/2024-12-02/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:09:35Z [load_day 2024-12-02] attempt 1 started
2026-11-08T09:09:36Z [load_day 2024-12-02] 2024-12-02: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:09:45Z [load_day 2024-12-02] 2024-12-02 hour 0: 186324 events in 0 files, snapshot none (task 8322 ms: download 5108 ms overlapping gunzip 1286 ms, parse 5217 ms, sort 0 ms, write 0 ms, index 813 ms: 10 candidates, 82170 repo-hours, 1210 releases; waiting 493 ms; commit 0 ms)
2026-11-08T09:09:46Z [load_day 2024-12-02] 2024-12-02 hour 1: 220516 events in 0 files, snapshot none (task 9288 ms: download 5845 ms overlapping gunzip 1554 ms, parse 5828 ms, sort 0 ms, write 0 ms, index 1027 ms: 6 candidates, 114278 repo-hours, 939 releases; waiting 527 ms; commit 0 ms)
2026-11-08T09:09:54Z [load_day 2024-12-02] 2024-12-02 hour 2: 188891 events in 0 files, snapshot none (task 8233 ms: download 5170 ms overlapping gunzip 1439 ms, parse 5259 ms, sort 0 ms, write 0 ms, index 1021 ms: 5 candidates, 78365 repo-hours, 996 releases; waiting 181 ms; commit 0 ms)
2026-11-08T09:09:56Z [load_day 2024-12-02] 2024-12-02 hour 3: 220859 events in 0 files, snapshot none (task 10250 ms: download 7414 ms overlapping gunzip 1757 ms, parse 6683 ms, sort 0 ms, write 0 ms, index 973 ms: 2 candidates, 80605 repo-hours, 3851 releases; waiting 503 ms; commit 0 ms)
2026-11-08T09:10:04Z [load_day 2024-12-02] 2024-12-02 hour 4: 205552 events in 0 files, snapshot none (task 9436 ms: download 7088 ms overlapping gunzip 1730 ms, parse 6236 ms, sort 0 ms, write 0 ms, index 642 ms: 11 candidates, 67759 repo-hours, 719 releases; waiting 506 ms; commit 0 ms)
2026-11-08T09:10:07Z [load_day 2024-12-02] 2024-12-02 hour 5: 211441 events in 0 files, snapshot none (task 9534 ms: download 6705 ms overlapping gunzip 1687 ms, parse 5933 ms, sort 0 ms, write 0 ms, index 1053 ms: 6 candidates, 72084 repo-hours, 769 releases; waiting 506 ms; commit 0 ms)
2026-11-08T09:10:16Z [load_day 2024-12-02] 2024-12-02 hour 6: 231838 events in 0 files, snapshot none (task 10784 ms: download 7997 ms overlapping gunzip 1871 ms, parse 7117 ms, sort 0 ms, write 0 ms, index 973 ms: 14 candidates, 94467 repo-hours, 904 releases; waiting 532 ms; commit 0 ms)
2026-11-08T09:10:18Z [load_day 2024-12-02] 2024-12-02 hour 7: 235869 events in 0 files, snapshot none (task 11337 ms: download 8737 ms overlapping gunzip 2071 ms, parse 7740 ms, sort 0 ms, write 0 ms, index 906 ms: 15 candidates, 84753 repo-hours, 849 releases; waiting 323 ms; commit 0 ms)
2026-11-08T09:10:29Z [load_day 2024-12-02] 2024-12-02 hour 8: 248408 events in 0 files, snapshot none (task 12690 ms: download 9727 ms overlapping gunzip 2297 ms, parse 8402 ms, sort 0 ms, write 0 ms, index 1058 ms: 6 candidates, 94543 repo-hours, 1149 releases; waiting 506 ms; commit 0 ms)
2026-11-08T09:10:31Z [load_day 2024-12-02] 2024-12-02 hour 9: 260893 events in 0 files, snapshot none (task 12388 ms: download 9628 ms overlapping gunzip 2241 ms, parse 8326 ms, sort 0 ms, write 0 ms, index 1012 ms: 12 candidates, 101842 repo-hours, 1311 releases; waiting 497 ms; commit 0 ms)
2026-11-08T09:10:40Z [load_day 2024-12-02] 2024-12-02 hour 10: 252315 events in 0 files, snapshot none (task 10948 ms: download 8704 ms overlapping gunzip 1954 ms, parse 7546 ms, sort 0 ms, write 0 ms, index 655 ms: 7 candidates, 96515 repo-hours, 1175 releases; waiting 534 ms; commit 0 ms)
2026-11-08T09:10:43Z [load_day 2024-12-02] 2024-12-02 hour 11: 257870 events in 0 files, snapshot none (task 10922 ms: download 8635 ms overlapping gunzip 1905 ms, parse 6892 ms, sort 0 ms, write 0 ms, index 706 ms: 8 candidates, 93665 repo-hours, 1195 releases; waiting 1187 ms; commit 0 ms)
2026-11-08T09:10:50Z [load_day 2024-12-02] 2024-12-02 hour 12: 286539 events in 0 files, snapshot none (task 9724 ms: download 6840 ms overlapping gunzip 1560 ms, parse 6208 ms, sort 0 ms, write 0 ms, index 1075 ms: 11 candidates, 142623 repo-hours, 1339 releases; waiting 590 ms; commit 0 ms)
2026-11-08T09:10:56Z [load_day 2024-12-02] 2024-12-02 hour 13: 284852 events in 0 files, snapshot none (task 12810 ms: download 9019 ms overlapping gunzip 2248 ms, parse 8230 ms, sort 0 ms, write 0 ms, index 1191 ms: 10 candidates, 120823 repo-hours, 1230 releases; waiting 860 ms; commit 0 ms)
2026-11-08T09:11:05Z [load_day 2024-12-02] 2024-12-02 hour 14: 277141 events in 0 files, snapshot none (task 14163 ms: download 10518 ms overlapping gunzip 2527 ms, parse 9910 ms, sort 0 ms, write 0 ms, index 1196 ms: 8 candidates, 109347 repo-hours, 1137 releases; waiting 195 ms; commit 0 ms)
2026-11-08T09:11:10Z [load_day 2024-12-02] 2024-12-02 hour 15: 276587 events in 0 files, snapshot none (task 13262 ms: download 9787 ms overlapping gunzip 2315 ms, parse 8712 ms, sort 0 ms, write 0 ms, index 980 ms: 11 candidates, 112918 repo-hours, 1423 releases; waiting 584 ms; commit 0 ms)
2026-11-08T09:11:19Z [load_day 2024-12-02] 2024-12-02 hour 16: 266770 events in 0 files, snapshot none (task 13783 ms: download 11099 ms overlapping gunzip 2405 ms, parse 9586 ms, sort 0 ms, write 0 ms, index 833 ms: 8 candidates, 106025 repo-hours, 1030 releases; waiting 658 ms; commit 0 ms)
2026-11-08T09:11:25Z [load_day 2024-12-02] 2024-12-02 hour 17: 264782 events in 0 files, snapshot none (task 14506 ms: download 10540 ms overlapping gunzip 2750 ms, parse 9970 ms, sort 0 ms, write 0 ms, index 1047 ms: 8 candidates, 98895 repo-hours, 998 releases; waiting 499 ms; commit 0 ms)
2026-11-08T09:11:32Z [load_day 2024-12-02] 2024-12-02 hour 18: 269578 events in 0 files, snapshot none (task 12321 ms: download 9291 ms overlapping gunzip 2159 ms, parse 8254 ms, sort 0 ms, write 0 ms, index 1094 ms: 9 candidates, 111077 repo-hours, 1153 releases; waiting 519 ms; commit 0 ms)
2026-11-08T09:11:37Z [load_day 2024-12-02] 2024-12-02 hour 19: 247767 events in 0 files, snapshot none (task 11822 ms: download 8826 ms overlapping gunzip 2155 ms, parse 8096 ms, sort 0 ms, write 0 ms, index 744 ms: 11 candidates, 89058 repo-hours, 955 releases; waiting 519 ms; commit 0 ms)
2026-11-08T09:11:45Z [load_day 2024-12-02] 2024-12-02 hour 20: 246270 events in 0 files, snapshot none (task 12578 ms: download 8991 ms overlapping gunzip 2222 ms, parse 8527 ms, sort 0 ms, write 0 ms, index 1070 ms: 10 candidates, 91013 repo-hours, 995 releases; waiting 501 ms; commit 0 ms)
2026-11-08T09:11:48Z [load_day 2024-12-02] 2024-12-02 hour 21: 229180 events in 0 files, snapshot none (task 10440 ms: download 6774 ms overlapping gunzip 1751 ms, parse 7048 ms, sort 0 ms, write 0 ms, index 1055 ms: 8 candidates, 90801 repo-hours, 1224 releases; waiting 259 ms; commit 0 ms)
2026-11-08T09:11:56Z [load_day 2024-12-02] 2024-12-02 hour 22: 212030 events in 0 files, snapshot none (task 10308 ms: download 6711 ms overlapping gunzip 1712 ms, parse 6965 ms, sort 0 ms, write 0 ms, index 851 ms: 5 candidates, 80183 repo-hours, 1248 releases; waiting 480 ms; commit 0 ms)
2026-11-08T09:11:57Z [load_day 2024-12-02] 2024-12-02 hour 23: 197774 events in 0 files, snapshot none (task 8838 ms: download 6331 ms overlapping gunzip 1379 ms, parse 6051 ms, sort 0 ms, write 0 ms, index 586 ms: 6 candidates, 74746 repo-hours, 938 releases; waiting 530 ms; commit 0 ms)
2026-11-08T09:12:08Z [load_day 2024-12-02] 2024-12-02: repo_hour merged from 24 files to 1 (2288555 rows, 10078 ms)
2026-11-08T09:12:10Z [load_day 2024-12-02] 2024-12-02: index committed in 12979 ms (24 + 1 + 24 files)
2026-11-08T09:12:10Z [load_day 2024-12-02] 2024-12-02: 5780046 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:12:10Z [load_day 2024-12-02] attempt 1 succeeded