orcaLog in

Runs · run 3998

load_day 2025-06-09, attempt 1 succeeded

Host
73ccef5e07c2:318931
Started
2026-11-08T12:20:45Z
Ended
2026-11-08T12:22:25Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
699 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
150.7 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3998/load_day/2025-06-09/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:20:45Z [load_day 2025-06-09] attempt 1 started
2026-11-08T12:20:46Z [load_day 2025-06-09] 2025-06-09: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:20:52Z [load_day 2025-06-09] 2025-06-09 hour 0: 137566 events in 0 files, snapshot none (task 5957 ms: download 3605 ms overlapping gunzip 921 ms, parse 3707 ms, sort 0 ms, write 0 ms, index 533 ms: 7 candidates, 64283 repo-hours, 1124 releases; waiting 494 ms; commit 0 ms)
2026-11-08T12:20:52Z [load_day 2025-06-09] 2025-06-09 hour 1: 148112 events in 0 files, snapshot none (task 5757 ms: download 3297 ms overlapping gunzip 885 ms, parse 3484 ms, sort 0 ms, write 0 ms, index 603 ms: 8 candidates, 84632 repo-hours, 721 releases; waiting 473 ms; commit 0 ms)
2026-11-08T12:20:59Z [load_day 2025-06-09] 2025-06-09 hour 2: 142874 events in 0 files, snapshot none (task 5985 ms: download 3269 ms overlapping gunzip 891 ms, parse 3612 ms, sort 0 ms, write 0 ms, index 724 ms: 6 candidates, 70076 repo-hours, 730 releases; waiting 481 ms; commit 0 ms)
2026-11-08T12:20:59Z [load_day 2025-06-09] 2025-06-09 hour 3: 142544 events in 0 files, snapshot none (task 5633 ms: download 3130 ms overlapping gunzip 877 ms, parse 3424 ms, sort 0 ms, write 0 ms, index 554 ms: 9 candidates, 65149 repo-hours, 1503 releases; waiting 468 ms; commit 0 ms)
2026-11-08T12:21:05Z [load_day 2025-06-09] 2025-06-09 hour 4: 138099 events in 0 files, snapshot none (task 5987 ms: download 3349 ms overlapping gunzip 983 ms, parse 3745 ms, sort 0 ms, write 0 ms, index 439 ms: 12 candidates, 61067 repo-hours, 1143 releases; waiting 519 ms; commit 0 ms)
2026-11-08T12:21:06Z [load_day 2025-06-09] 2025-06-09 hour 5: 144956 events in 0 files, snapshot none (task 6162 ms: download 3893 ms overlapping gunzip 977 ms, parse 3867 ms, sort 0 ms, write 0 ms, index 505 ms: 8 candidates, 62891 repo-hours, 984 releases; waiting 498 ms; commit 0 ms)
2026-11-08T12:21:13Z [load_day 2025-06-09] 2025-06-09 hour 6: 154925 events in 0 files, snapshot none (task 7472 ms: download 4457 ms overlapping gunzip 1260 ms, parse 4870 ms, sort 0 ms, write 0 ms, index 640 ms: 9 candidates, 76311 repo-hours, 923 releases; waiting 374 ms; commit 0 ms)
2026-11-08T12:21:14Z [load_day 2025-06-09] 2025-06-09 hour 7: 159759 events in 0 files, snapshot none (task 7821 ms: download 5099 ms overlapping gunzip 1397 ms, parse 5382 ms, sort 0 ms, write 0 ms, index 530 ms: 10 candidates, 74190 repo-hours, 885 releases; waiting 203 ms; commit 0 ms)
2026-11-08T12:21:22Z [load_day 2025-06-09] 2025-06-09 hour 8: 156090 events in 0 files, snapshot none (task 7817 ms: download 5300 ms overlapping gunzip 1327 ms, parse 5081 ms, sort 0 ms, write 0 ms, index 629 ms: 17 candidates, 75731 repo-hours, 962 releases; waiting 524 ms; commit 0 ms)
2026-11-08T12:21:22Z [load_day 2025-06-09] 2025-06-09 hour 9: 158743 events in 0 files, snapshot none (task 7739 ms: download 5166 ms overlapping gunzip 1233 ms, parse 5256 ms, sort 0 ms, write 0 ms, index 744 ms: 12 candidates, 76859 repo-hours, 1193 releases; waiting 223 ms; commit 0 ms)
2026-11-08T12:21:29Z [load_day 2025-06-09] 2025-06-09 hour 10: 155180 events in 0 files, snapshot none (task 6256 ms: download 3647 ms overlapping gunzip 978 ms, parse 3969 ms, sort 0 ms, write 0 ms, index 636 ms: 14 candidates, 74847 repo-hours, 1172 releases; waiting 332 ms; commit 0 ms)
2026-11-08T12:21:30Z [load_day 2025-06-09] 2025-06-09 hour 11: 158589 events in 0 files, snapshot none (task 6831 ms: download 3993 ms overlapping gunzip 1032 ms, parse 4179 ms, sort 0 ms, write 0 ms, index 677 ms: 9 candidates, 73380 repo-hours, 875 releases; waiting 479 ms; commit 0 ms)
2026-11-08T12:21:36Z [load_day 2025-06-09] 2025-06-09 hour 12: 165049 events in 0 files, snapshot none (task 7190 ms: download 3700 ms overlapping gunzip 1033 ms, parse 4149 ms, sort 0 ms, write 0 ms, index 992 ms: 17 candidates, 96470 repo-hours, 928 releases; waiting 746 ms; commit 0 ms)
2026-11-08T12:21:37Z [load_day 2025-06-09] 2025-06-09 hour 13: 164407 events in 0 files, snapshot none (task 6755 ms: download 3814 ms overlapping gunzip 1064 ms, parse 4421 ms, sort 0 ms, write 0 ms, index 702 ms: 9 candidates, 91247 repo-hours, 846 releases; waiting 289 ms; commit 0 ms)
2026-11-08T12:21:45Z [load_day 2025-06-09] 2025-06-09 hour 14: 163684 events in 0 files, snapshot none (task 7847 ms: download 5210 ms overlapping gunzip 1260 ms, parse 4905 ms, sort 0 ms, write 0 ms, index 632 ms: 6 candidates, 82098 repo-hours, 977 releases; waiting 802 ms; commit 0 ms)
2026-11-08T12:21:46Z [load_day 2025-06-09] 2025-06-09 hour 15: 164210 events in 0 files, snapshot none (task 8090 ms: download 5595 ms overlapping gunzip 1312 ms, parse 5131 ms, sort 0 ms, write 0 ms, index 616 ms: 12 candidates, 84129 repo-hours, 1182 releases; waiting 709 ms; commit 0 ms)
2026-11-08T12:21:53Z [load_day 2025-06-09] 2025-06-09 hour 16: 164533 events in 0 files, snapshot none (task 7394 ms: download 4855 ms overlapping gunzip 1122 ms, parse 4719 ms, sort 0 ms, write 0 ms, index 727 ms: 13 candidates, 82145 repo-hours, 863 releases; waiting 533 ms; commit 0 ms)
2026-11-08T12:21:53Z [load_day 2025-06-09] 2025-06-09 hour 17: 159615 events in 0 files, snapshot none (task 6786 ms: download 4360 ms overlapping gunzip 1056 ms, parse 4297 ms, sort 0 ms, write 0 ms, index 669 ms: 13 candidates, 76546 repo-hours, 857 releases; waiting 488 ms; commit 0 ms)
2026-11-08T12:21:59Z [load_day 2025-06-09] 2025-06-09 hour 18: 159621 events in 0 files, snapshot none (task 5929 ms: download 3466 ms overlapping gunzip 882 ms, parse 3560 ms, sort 0 ms, write 0 ms, index 594 ms: 9 candidates, 82293 repo-hours, 977 releases; waiting 505 ms; commit 0 ms)
2026-11-08T12:21:59Z [load_day 2025-06-09] 2025-06-09 hour 19: 157347 events in 0 files, snapshot none (task 5787 ms: download 3452 ms overlapping gunzip 883 ms, parse 3565 ms, sort 0 ms, write 0 ms, index 533 ms: 9 candidates, 71953 repo-hours, 873 releases; waiting 486 ms; commit 0 ms)
2026-11-08T12:22:05Z [load_day 2025-06-09] 2025-06-09 hour 20: 154253 events in 0 files, snapshot none (task 5876 ms: download 3527 ms overlapping gunzip 898 ms, parse 3554 ms, sort 0 ms, write 0 ms, index 547 ms: 9 candidates, 72466 repo-hours, 815 releases; waiting 541 ms; commit 0 ms)
2026-11-08T12:22:05Z [load_day 2025-06-09] 2025-06-09 hour 21: 151454 events in 0 files, snapshot none (task 5183 ms: download 3420 ms overlapping gunzip 839 ms, parse 3370 ms, sort 0 ms, write 0 ms, index 507 ms: 19 candidates, 69538 repo-hours, 874 releases; waiting 245 ms; commit 0 ms)
2026-11-08T12:22:13Z [load_day 2025-06-09] 2025-06-09 hour 22: 146597 events in 0 files, snapshot none (task 6961 ms: download 4525 ms overlapping gunzip 1058 ms, parse 4346 ms, sort 0 ms, write 0 ms, index 430 ms: 9 candidates, 62664 repo-hours, 879 releases; waiting 866 ms; commit 0 ms)
2026-11-08T12:22:13Z [load_day 2025-06-09] 2025-06-09 hour 23: 147211 events in 0 files, snapshot none (task 5848 ms: download 3739 ms overlapping gunzip 902 ms, parse 3587 ms, sort 0 ms, write 0 ms, index 482 ms: 13 candidates, 61972 repo-hours, 1007 releases; waiting 569 ms; commit 0 ms)
2026-11-08T12:22:22Z [load_day 2025-06-09] 2025-06-09: repo_hour merged from 24 files to 1 (1792937 rows, 8635 ms)
2026-11-08T12:22:25Z [load_day 2025-06-09] 2025-06-09: index committed in 11940 ms (24 + 1 + 24 files)
2026-11-08T12:22:25Z [load_day 2025-06-09] 2025-06-09: 3695418 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:22:25Z [load_day 2025-06-09] attempt 1 succeeded