orcaLog in

Runs · run 3704

load_day 2025-03-23, attempt 1 succeeded

Host
73ccef5e07c2:275651
Started
2026-11-08T11:00:26Z
Ended
2026-11-08T11:02:24Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
756 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
141.4 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3704/load_day/2025-03-23/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:00:26Z [load_day 2025-03-23] attempt 1 started
2026-11-08T11:00:27Z [load_day 2025-03-23] 2025-03-23: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:00:34Z [load_day 2025-03-23] 2025-03-23 hour 0: 171662 events in 0 files, snapshot none (task 6602 ms: download 3438 ms overlapping gunzip 914 ms, parse 3997 ms, sort 0 ms, write 0 ms, index 822 ms: 11 candidates, 78568 repo-hours, 1217 releases; waiting 531 ms; commit 0 ms)
2026-11-08T11:00:34Z [load_day 2025-03-23] 2025-03-23 hour 1: 199282 events in 0 files, snapshot none (task 6668 ms: download 3095 ms overlapping gunzip 854 ms, parse 4036 ms, sort 0 ms, write 0 ms, index 961 ms: 3 candidates, 109604 repo-hours, 975 releases; waiting 515 ms; commit 0 ms)
2026-11-08T11:00:40Z [load_day 2025-03-23] 2025-03-23 hour 2: 159355 events in 0 files, snapshot none (task 5296 ms: download 2552 ms overlapping gunzip 682 ms, parse 2940 ms, sort 0 ms, write 0 ms, index 664 ms: 3 candidates, 67586 repo-hours, 894 releases; waiting 508 ms; commit 0 ms)
2026-11-08T11:00:42Z [load_day 2025-03-23] 2025-03-23 hour 3: 176285 events in 0 files, snapshot none (task 7020 ms: download 2793 ms overlapping gunzip 716 ms, parse 3043 ms, sort 0 ms, write 0 ms, index 2365 ms: 3 candidates, 70606 repo-hours, 3455 releases; waiting 540 ms; commit 0 ms)
2026-11-08T11:01:00Z [load_day 2025-03-23] 2025-03-23 hour 4: 165146 events in 0 files, snapshot none (task 7018 ms: download 4173 ms overlapping gunzip 771 ms, parse 3481 ms, sort 0 ms, write 0 ms, index 438 ms: 5 candidates, 59160 repo-hours, 721 releases; waiting 1987 ms; commit 0 ms)
2026-11-08T11:01:00Z [load_day 2025-03-23] 2025-03-23 hour 5: 173183 events in 0 files, snapshot none (task 6323 ms: download 2950 ms overlapping gunzip 964 ms, parse 3855 ms, sort 0 ms, write 0 ms, index 545 ms: 3 candidates, 62034 repo-hours, 870 releases; waiting 650 ms; commit 0 ms)
2026-11-08T11:01:08Z [load_day 2025-03-23] 2025-03-23 hour 6: 192734 events in 0 files, snapshot none (task 7246 ms: download 4069 ms overlapping gunzip 868 ms, parse 3802 ms, sort 0 ms, write 0 ms, index 659 ms: 3 candidates, 80666 repo-hours, 909 releases; waiting 1544 ms; commit 0 ms)
2026-11-08T11:01:08Z [load_day 2025-03-23] 2025-03-23 hour 7: 184147 events in 0 files, snapshot none (task 6200 ms: download 2644 ms overlapping gunzip 855 ms, parse 3866 ms, sort 0 ms, write 0 ms, index 646 ms: 4 candidates, 65892 repo-hours, 695 releases; waiting 535 ms; commit 0 ms)
2026-11-08T11:01:14Z [load_day 2025-03-23] 2025-03-23 hour 8: 189908 events in 0 files, snapshot none (task 5386 ms: download 2587 ms overlapping gunzip 703 ms, parse 2985 ms, sort 0 ms, write 0 ms, index 845 ms: 7 candidates, 72092 repo-hours, 800 releases; waiting 539 ms; commit 0 ms)
2026-11-08T11:01:15Z [load_day 2025-03-23] 2025-03-23 hour 9: 205155 events in 0 files, snapshot none (task 6486 ms: download 3292 ms overlapping gunzip 904 ms, parse 3953 ms, sort 0 ms, write 0 ms, index 827 ms: 2 candidates, 79720 repo-hours, 970 releases; waiting 479 ms; commit 0 ms)
2026-11-08T11:01:21Z [load_day 2025-03-23] 2025-03-23 hour 10: 199264 events in 0 files, snapshot none (task 6517 ms: download 3686 ms overlapping gunzip 970 ms, parse 4168 ms, sort 0 ms, write 0 ms, index 614 ms: 1 candidates, 78048 repo-hours, 849 releases; waiting 517 ms; commit 0 ms)
2026-11-08T11:01:22Z [load_day 2025-03-23] 2025-03-23 hour 11: 197931 events in 0 files, snapshot none (task 6164 ms: download 3564 ms overlapping gunzip 907 ms, parse 3875 ms, sort 0 ms, write 0 ms, index 611 ms: 3 candidates, 73941 repo-hours, 788 releases; waiting 492 ms; commit 0 ms)
2026-11-08T11:01:31Z [load_day 2025-03-23] 2025-03-23 hour 12: 260117 events in 0 files, snapshot none (task 9239 ms: download 4641 ms overlapping gunzip 1242 ms, parse 5836 ms, sort 0 ms, write 0 ms, index 1685 ms: 2 candidates, 126974 repo-hours, 1072 releases; waiting 218 ms; commit 0 ms)
2026-11-08T11:01:31Z [load_day 2025-03-23] 2025-03-23 hour 13: 237365 events in 0 files, snapshot none (task 8929 ms: download 5124 ms overlapping gunzip 1310 ms, parse 5688 ms, sort 0 ms, write 0 ms, index 1177 ms: 6 candidates, 107162 repo-hours, 929 releases; waiting 533 ms; commit 0 ms)
2026-11-08T11:01:40Z [load_day 2025-03-23] 2025-03-23 hour 14: 228268 events in 0 files, snapshot none (task 8298 ms: download 4064 ms overlapping gunzip 1148 ms, parse 5065 ms, sort 0 ms, write 0 ms, index 1140 ms: 8 candidates, 90988 repo-hours, 1007 releases; waiting 491 ms; commit 0 ms)
2026-11-08T11:01:40Z [load_day 2025-03-23] 2025-03-23 hour 15: 235167 events in 0 files, snapshot none (task 7445 ms: download 3743 ms overlapping gunzip 994 ms, parse 4390 ms, sort 0 ms, write 0 ms, index 1221 ms: 15 candidates, 97720 repo-hours, 1071 releases; waiting 520 ms; commit 0 ms)
2026-11-08T11:01:49Z [load_day 2025-03-23] 2025-03-23 hour 16: 229413 events in 0 files, snapshot none (task 8948 ms: download 5668 ms overlapping gunzip 1346 ms, parse 5931 ms, sort 0 ms, write 0 ms, index 936 ms: 3 candidates, 91878 repo-hours, 1013 releases; waiting 493 ms; commit 0 ms)
2026-11-08T11:01:49Z [load_day 2025-03-23] 2025-03-23 hour 17: 221713 events in 0 files, snapshot none (task 8947 ms: download 5621 ms overlapping gunzip 1377 ms, parse 6125 ms, sort 0 ms, write 0 ms, index 958 ms: 6 candidates, 84293 repo-hours, 1067 releases; waiting 188 ms; commit 0 ms)
2026-11-08T11:01:58Z [load_day 2025-03-23] 2025-03-23 hour 18: 232249 events in 0 files, snapshot none (task 8903 ms: download 5661 ms overlapping gunzip 1389 ms, parse 5944 ms, sort 0 ms, write 0 ms, index 739 ms: 13 candidates, 98921 repo-hours, 1257 releases; waiting 493 ms; commit 0 ms)
2026-11-08T11:01:58Z [load_day 2025-03-23] 2025-03-23 hour 19: 209508 events in 0 files, snapshot none (task 7835 ms: download 4283 ms overlapping gunzip 1097 ms, parse 4952 ms, sort 0 ms, write 0 ms, index 783 ms: 6 candidates, 76166 repo-hours, 1112 releases; waiting 511 ms; commit 0 ms)
2026-11-08T11:02:05Z [load_day 2025-03-23] 2025-03-23 hour 20: 201119 events in 0 files, snapshot none (task 5845 ms: download 3020 ms overlapping gunzip 866 ms, parse 3777 ms, sort 0 ms, write 0 ms, index 697 ms: 3 candidates, 77700 repo-hours, 1329 releases; waiting 243 ms; commit 0 ms)
2026-11-08T11:02:05Z [load_day 2025-03-23] 2025-03-23 hour 21: 200336 events in 0 files, snapshot none (task 6356 ms: download 3238 ms overlapping gunzip 868 ms, parse 3863 ms, sort 0 ms, write 0 ms, index 843 ms: 8 candidates, 76284 repo-hours, 1129 releases; waiting 540 ms; commit 0 ms)
2026-11-08T11:02:12Z [load_day 2025-03-23] 2025-03-23 hour 22: 180046 events in 0 files, snapshot none (task 6749 ms: download 3543 ms overlapping gunzip 926 ms, parse 4283 ms, sort 0 ms, write 0 ms, index 677 ms: 11 candidates, 67610 repo-hours, 1109 releases; waiting 522 ms; commit 0 ms)
2026-11-08T11:02:12Z [load_day 2025-03-23] 2025-03-23 hour 23: 171596 events in 0 files, snapshot none (task 6566 ms: download 3771 ms overlapping gunzip 959 ms, parse 4318 ms, sort 0 ms, write 0 ms, index 526 ms: 4 candidates, 63074 repo-hours, 946 releases; waiting 479 ms; commit 0 ms)
2026-11-08T11:02:21Z [load_day 2025-03-23] 2025-03-23: repo_hour merged from 24 files to 1 (1956687 rows, 8815 ms)
2026-11-08T11:02:24Z [load_day 2025-03-23] 2025-03-23: index committed in 11317 ms (24 + 1 + 24 files)
2026-11-08T11:02:24Z [load_day 2025-03-23] 2025-03-23: 4820949 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:02:24Z [load_day 2025-03-23] attempt 1 succeeded