orcaLog in

Runs · run 4311

load_day 2025-08-25, attempt 1 succeeded

Host
73ccef5e07c2:366735
Started
2026-11-08T13:32:07Z
Ended
2026-11-08T13:34:02Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
696 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
164.2 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4311/load_day/2025-08-25/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:32:07Z [load_day 2025-08-25] attempt 1 started
2026-11-08T13:32:08Z [load_day 2025-08-25] 2025-08-25: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:32:17Z [load_day 2025-08-25] 2025-08-25 hour 0: 143147 events in 0 files, snapshot none (task 8470 ms: download 5069 ms overlapping gunzip 1391 ms, parse 5542 ms, sort 0 ms, write 0 ms, index 742 ms: 5 candidates, 70201 repo-hours, 1247 releases; waiting 533 ms; commit 0 ms)
2026-11-08T13:32:17Z [load_day 2025-08-25] 2025-08-25 hour 1: 156598 events in 0 files, snapshot none (task 8783 ms: download 5681 ms overlapping gunzip 1318 ms, parse 5282 ms, sort 0 ms, write 0 ms, index 673 ms: 7 candidates, 90133 repo-hours, 746 releases; waiting 1189 ms; commit 0 ms)
2026-11-08T13:32:24Z [load_day 2025-08-25] 2025-08-25 hour 2: 147605 events in 0 files, snapshot none (task 6839 ms: download 4464 ms overlapping gunzip 1211 ms, parse 4628 ms, sort 0 ms, write 0 ms, index 548 ms: 8 candidates, 74662 repo-hours, 949 releases; waiting 190 ms; commit 0 ms)
2026-11-08T13:32:26Z [load_day 2025-08-25] 2025-08-25 hour 3: 148038 events in 0 files, snapshot none (task 7251 ms: download 4532 ms overlapping gunzip 1174 ms, parse 4502 ms, sort 0 ms, write 0 ms, index 793 ms: 6 candidates, 69558 repo-hours, 1954 releases; waiting 476 ms; commit 0 ms)
2026-11-08T13:32:31Z [load_day 2025-08-25] 2025-08-25 hour 4: 148015 events in 0 files, snapshot none (task 6248 ms: download 3747 ms overlapping gunzip 1026 ms, parse 3904 ms, sort 0 ms, write 0 ms, index 542 ms: 4 candidates, 66070 repo-hours, 758 releases; waiting 498 ms; commit 0 ms)
2026-11-08T13:32:33Z [load_day 2025-08-25] 2025-08-25 hour 5: 150890 events in 0 files, snapshot none (task 6422 ms: download 3738 ms overlapping gunzip 989 ms, parse 3808 ms, sort 0 ms, write 0 ms, index 822 ms: 7 candidates, 66998 repo-hours, 667 releases; waiting 484 ms; commit 0 ms)
2026-11-08T13:32:40Z [load_day 2025-08-25] 2025-08-25 hour 6: 158145 events in 0 files, snapshot none (task 8053 ms: download 4734 ms overlapping gunzip 1300 ms, parse 4760 ms, sort 0 ms, write 0 ms, index 1265 ms: 10 candidates, 80943 repo-hours, 724 releases; waiting 483 ms; commit 0 ms)
2026-11-08T13:32:40Z [load_day 2025-08-25] 2025-08-25 hour 7: 156363 events in 0 files, snapshot none (task 6706 ms: download 3833 ms overlapping gunzip 1057 ms, parse 4037 ms, sort 0 ms, write 0 ms, index 747 ms: 6 candidates, 75054 repo-hours, 693 releases; waiting 509 ms; commit 0 ms)
2026-11-08T13:32:48Z [load_day 2025-08-25] 2025-08-25 hour 8: 158355 events in 0 files, snapshot none (task 8074 ms: download 4850 ms overlapping gunzip 1402 ms, parse 5137 ms, sort 0 ms, write 0 ms, index 754 ms: 2 candidates, 79633 repo-hours, 827 releases; waiting 523 ms; commit 0 ms)
2026-11-08T13:32:49Z [load_day 2025-08-25] 2025-08-25 hour 9: 156804 events in 0 files, snapshot none (task 7635 ms: download 4723 ms overlapping gunzip 1337 ms, parse 4793 ms, sort 0 ms, write 0 ms, index 739 ms: 4 candidates, 78693 repo-hours, 823 releases; waiting 506 ms; commit 0 ms)
2026-11-08T13:32:59Z [load_day 2025-08-25] 2025-08-25 hour 10: 156449 events in 0 files, snapshot none (task 9419 ms: download 7142 ms overlapping gunzip 1276 ms, parse 5019 ms, sort 0 ms, write 0 ms, index 597 ms: 7 candidates, 78453 repo-hours, 752 releases; waiting 2271 ms; commit 0 ms)
2026-11-08T13:32:59Z [load_day 2025-08-25] 2025-08-25 hour 11: 165172 events in 0 files, snapshot none (task 7726 ms: download 4574 ms overlapping gunzip 1348 ms, parse 5143 ms, sort 0 ms, write 0 ms, index 735 ms: 7 candidates, 78515 repo-hours, 825 releases; waiting 247 ms; commit 0 ms)
2026-11-08T13:33:09Z [load_day 2025-08-25] 2025-08-25 hour 12: 168796 events in 0 files, snapshot none (task 9765 ms: download 6438 ms overlapping gunzip 1468 ms, parse 6244 ms, sort 0 ms, write 0 ms, index 1239 ms: 8 candidates, 98926 repo-hours, 881 releases; waiting 513 ms; commit 0 ms)
2026-11-08T13:33:09Z [load_day 2025-08-25] 2025-08-25 hour 13: 165255 events in 0 files, snapshot none (task 8615 ms: download 5893 ms overlapping gunzip 1438 ms, parse 5593 ms, sort 0 ms, write 0 ms, index 850 ms: 10 candidates, 92160 repo-hours, 780 releases; waiting 498 ms; commit 0 ms)
2026-11-08T13:33:18Z [load_day 2025-08-25] 2025-08-25 hour 14: 163439 events in 0 files, snapshot none (task 8231 ms: download 5177 ms overlapping gunzip 1346 ms, parse 5201 ms, sort 0 ms, write 0 ms, index 843 ms: 4 candidates, 84162 repo-hours, 829 releases; waiting 512 ms; commit 0 ms)
2026-11-08T13:33:18Z [load_day 2025-08-25] 2025-08-25 hour 15: 164164 events in 0 files, snapshot none (task 7597 ms: download 4624 ms overlapping gunzip 1237 ms, parse 4857 ms, sort 0 ms, write 0 ms, index 761 ms: 4 candidates, 84698 repo-hours, 853 releases; waiting 469 ms; commit 0 ms)
2026-11-08T13:33:25Z [load_day 2025-08-25] 2025-08-25 hour 16: 162468 events in 0 files, snapshot none (task 6799 ms: download 4380 ms overlapping gunzip 1115 ms, parse 4229 ms, sort 0 ms, write 0 ms, index 699 ms: 14 candidates, 82527 repo-hours, 850 releases; waiting 507 ms; commit 0 ms)
2026-11-08T13:33:25Z [load_day 2025-08-25] 2025-08-25 hour 17: 165326 events in 0 files, snapshot none (task 6845 ms: download 4584 ms overlapping gunzip 1047 ms, parse 4021 ms, sort 0 ms, write 0 ms, index 595 ms: 11 candidates, 79200 repo-hours, 772 releases; waiting 891 ms; commit 0 ms)
2026-11-08T13:33:32Z [load_day 2025-08-25] 2025-08-25 hour 18: 160468 events in 0 files, snapshot none (task 6405 ms: download 4130 ms overlapping gunzip 1099 ms, parse 3928 ms, sort 0 ms, write 0 ms, index 619 ms: 9 candidates, 82451 repo-hours, 829 releases; waiting 522 ms; commit 0 ms)
2026-11-08T13:33:32Z [load_day 2025-08-25] 2025-08-25 hour 19: 154699 events in 0 files, snapshot none (task 6245 ms: download 4126 ms overlapping gunzip 1065 ms, parse 3826 ms, sort 0 ms, write 0 ms, index 563 ms: 9 candidates, 70009 repo-hours, 597 releases; waiting 554 ms; commit 0 ms)
2026-11-08T13:33:40Z [load_day 2025-08-25] 2025-08-25 hour 20: 154731 events in 0 files, snapshot none (task 7911 ms: download 5689 ms overlapping gunzip 1413 ms, parse 5374 ms, sort 0 ms, write 0 ms, index 570 ms: 17 candidates, 70873 repo-hours, 719 releases; waiting 352 ms; commit 0 ms)
2026-11-08T13:33:41Z [load_day 2025-08-25] 2025-08-25 hour 21: 152003 events in 0 files, snapshot none (task 8345 ms: download 5875 ms overlapping gunzip 1380 ms, parse 5598 ms, sort 0 ms, write 0 ms, index 563 ms: 8 candidates, 66932 repo-hours, 806 releases; waiting 543 ms; commit 0 ms)
2026-11-08T13:33:50Z [load_day 2025-08-25] 2025-08-25 hour 22: 146467 events in 0 files, snapshot none (task 9151 ms: download 6640 ms overlapping gunzip 1065 ms, parse 4145 ms, sort 0 ms, write 0 ms, index 597 ms: 3 candidates, 63103 repo-hours, 864 releases; waiting 3048 ms; commit 0 ms)
2026-11-08T13:33:50Z [load_day 2025-08-25] 2025-08-25 hour 23: 148372 events in 0 files, snapshot none (task 6665 ms: download 4362 ms overlapping gunzip 1138 ms, parse 4221 ms, sort 0 ms, write 0 ms, index 476 ms: 5 candidates, 61157 repo-hours, 833 releases; waiting 538 ms; commit 0 ms)
2026-11-08T13:33:58Z [load_day 2025-08-25] 2025-08-25: repo_hour merged from 24 files to 1 (1845111 rows, 8302 ms)
2026-11-08T13:34:02Z [load_day 2025-08-25] 2025-08-25: index committed in 11635 ms (24 + 1 + 24 files)
2026-11-08T13:34:02Z [load_day 2025-08-25] 2025-08-25: 3751769 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:34:02Z [load_day 2025-08-25] attempt 1 succeeded