orcaLog in

Runs · run 4267

load_day 2025-08-13, attempt 1 succeeded

Host
73ccef5e07c2:360177
Started
2026-11-08T13:21:43Z
Ended
2026-11-08T13:23:44Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
685 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
156.1 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4267/load_day/2025-08-13/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:21:43Z [load_day 2025-08-13] attempt 1 started
2026-11-08T13:21:44Z [load_day 2025-08-13] 2025-08-13: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:21:52Z [load_day 2025-08-13] 2025-08-13 hour 0: 148904 events in 0 files, snapshot none (task 7365 ms: download 4600 ms overlapping gunzip 1249 ms, parse 4644 ms, sort 0 ms, write 0 ms, index 590 ms: 4 candidates, 70722 repo-hours, 1012 releases; waiting 511 ms; commit 0 ms)
2026-11-08T13:21:52Z [load_day 2025-08-13] 2025-08-13 hour 1: 158795 events in 0 files, snapshot none (task 7106 ms: download 4026 ms overlapping gunzip 1118 ms, parse 4393 ms, sort 0 ms, write 0 ms, index 711 ms: 8 candidates, 89902 repo-hours, 760 releases; waiting 516 ms; commit 0 ms)
2026-11-08T13:22:00Z [load_day 2025-08-13] 2025-08-13 hour 2: 150567 events in 0 files, snapshot none (task 7904 ms: download 4909 ms overlapping gunzip 1338 ms, parse 5323 ms, sort 0 ms, write 0 ms, index 618 ms: 9 candidates, 71050 repo-hours, 813 releases; waiting 327 ms; commit 0 ms)
2026-11-08T13:22:00Z [load_day 2025-08-13] 2025-08-13 hour 3: 150787 events in 0 files, snapshot none (task 7502 ms: download 4636 ms overlapping gunzip 1161 ms, parse 4845 ms, sort 0 ms, write 0 ms, index 773 ms: 7 candidates, 67770 repo-hours, 1525 releases; waiting 480 ms; commit 0 ms)
2026-11-08T13:22:07Z [load_day 2025-08-13] 2025-08-13 hour 4: 151387 events in 0 files, snapshot none (task 6002 ms: download 2963 ms overlapping gunzip 836 ms, parse 3436 ms, sort 0 ms, write 0 ms, index 824 ms: 12 candidates, 65870 repo-hours, 939 releases; waiting 544 ms; commit 0 ms)
2026-11-08T13:22:08Z [load_day 2025-08-13] 2025-08-13 hour 5: 153241 events in 0 files, snapshot none (task 7359 ms: download 4383 ms overlapping gunzip 967 ms, parse 3750 ms, sort 0 ms, write 0 ms, index 649 ms: 11 candidates, 65359 repo-hours, 622 releases; waiting 1717 ms; commit 0 ms)
2026-11-08T13:22:18Z [load_day 2025-08-13] 2025-08-13 hour 6: 157547 events in 0 files, snapshot none (task 8498 ms: download 5507 ms overlapping gunzip 1196 ms, parse 5091 ms, sort 0 ms, write 0 ms, index 904 ms: 6 candidates, 77749 repo-hours, 743 releases; waiting 998 ms; commit 0 ms)
2026-11-08T13:22:19Z [load_day 2025-08-13] 2025-08-13 hour 7: 159145 events in 0 files, snapshot none (task 9410 ms: download 5539 ms overlapping gunzip 1476 ms, parse 6070 ms, sort 0 ms, write 0 ms, index 896 ms: 5 candidates, 74627 repo-hours, 745 releases; waiting 570 ms; commit 0 ms)
2026-11-08T13:22:30Z [load_day 2025-08-13] 2025-08-13 hour 8: 162827 events in 0 files, snapshot none (task 10748 ms: download 8288 ms overlapping gunzip 1261 ms, parse 5080 ms, sort 0 ms, write 0 ms, index 656 ms: 5 candidates, 78755 repo-hours, 771 releases; waiting 3461 ms; commit 0 ms)
2026-11-08T13:22:30Z [load_day 2025-08-13] 2025-08-13 hour 9: 165601 events in 0 files, snapshot none (task 7995 ms: download 4129 ms overlapping gunzip 1245 ms, parse 4917 ms, sort 0 ms, write 0 ms, index 1001 ms: 5 candidates, 80155 repo-hours, 920 releases; waiting 559 ms; commit 0 ms)
2026-11-08T13:22:38Z [load_day 2025-08-13] 2025-08-13 hour 10: 160802 events in 0 files, snapshot none (task 8283 ms: download 5462 ms overlapping gunzip 1330 ms, parse 5569 ms, sort 0 ms, write 0 ms, index 583 ms: 5 candidates, 76086 repo-hours, 884 releases; waiting 511 ms; commit 0 ms)
2026-11-08T13:22:38Z [load_day 2025-08-13] 2025-08-13 hour 11: 158383 events in 0 files, snapshot none (task 8212 ms: download 5678 ms overlapping gunzip 1299 ms, parse 5633 ms, sort 0 ms, write 0 ms, index 611 ms: 2 candidates, 73118 repo-hours, 704 releases; waiting 370 ms; commit 0 ms)
2026-11-08T13:22:46Z [load_day 2025-08-13] 2025-08-13 hour 12: 168956 events in 0 files, snapshot none (task 7211 ms: download 4752 ms overlapping gunzip 927 ms, parse 3775 ms, sort 0 ms, write 0 ms, index 651 ms: 7 candidates, 96689 repo-hours, 830 releases; waiting 1586 ms; commit 0 ms)
2026-11-08T13:22:46Z [load_day 2025-08-13] 2025-08-13 hour 13: 165818 events in 0 files, snapshot none (task 6424 ms: download 3970 ms overlapping gunzip 960 ms, parse 3868 ms, sort 0 ms, write 0 ms, index 631 ms: 5 candidates, 91432 repo-hours, 817 releases; waiting 649 ms; commit 0 ms)
2026-11-08T13:22:53Z [load_day 2025-08-13] 2025-08-13 hour 14: 167303 events in 0 files, snapshot none (task 6080 ms: download 3801 ms overlapping gunzip 948 ms, parse 3685 ms, sort 0 ms, write 0 ms, index 584 ms: 11 candidates, 84079 repo-hours, 869 releases; waiting 572 ms; commit 0 ms)
2026-11-08T13:22:53Z [load_day 2025-08-13] 2025-08-13 hour 15: 162154 events in 0 files, snapshot none (task 6100 ms: download 3771 ms overlapping gunzip 926 ms, parse 3560 ms, sort 0 ms, write 0 ms, index 661 ms: 6 candidates, 82283 repo-hours, 855 releases; waiting 663 ms; commit 0 ms)
2026-11-08T13:23:01Z [load_day 2025-08-13] 2025-08-13 hour 16: 165995 events in 0 files, snapshot none (task 7869 ms: download 5471 ms overlapping gunzip 1284 ms, parse 5065 ms, sort 0 ms, write 0 ms, index 754 ms: 7 candidates, 81035 repo-hours, 743 releases; waiting 517 ms; commit 0 ms)
2026-11-08T13:23:01Z [load_day 2025-08-13] 2025-08-13 hour 17: 164781 events in 0 files, snapshot none (task 7583 ms: download 5173 ms overlapping gunzip 1306 ms, parse 5034 ms, sort 0 ms, write 0 ms, index 678 ms: 6 candidates, 78776 repo-hours, 773 releases; waiting 246 ms; commit 0 ms)
2026-11-08T13:23:08Z [load_day 2025-08-13] 2025-08-13 hour 18: 160248 events in 0 files, snapshot none (task 6703 ms: download 4046 ms overlapping gunzip 1018 ms, parse 4073 ms, sort 0 ms, write 0 ms, index 853 ms: 10 candidates, 82499 repo-hours, 870 releases; waiting 480 ms; commit 0 ms)
2026-11-08T13:23:08Z [load_day 2025-08-13] 2025-08-13 hour 19: 155562 events in 0 files, snapshot none (task 6337 ms: download 3796 ms overlapping gunzip 942 ms, parse 3893 ms, sort 0 ms, write 0 ms, index 713 ms: 8 candidates, 71248 repo-hours, 851 releases; waiting 502 ms; commit 0 ms)
2026-11-08T13:23:17Z [load_day 2025-08-13] 2025-08-13 hour 20: 156301 events in 0 files, snapshot none (task 7735 ms: download 5052 ms overlapping gunzip 1254 ms, parse 4626 ms, sort 0 ms, write 0 ms, index 708 ms: 4 candidates, 70212 repo-hours, 884 releases; waiting 761 ms; commit 0 ms)
2026-11-08T13:23:17Z [load_day 2025-08-13] 2025-08-13 hour 21: 151665 events in 0 files, snapshot none (task 8071 ms: download 4937 ms overlapping gunzip 1184 ms, parse 4840 ms, sort 0 ms, write 0 ms, index 576 ms: 12 candidates, 65565 repo-hours, 865 releases; waiting 1034 ms; commit 0 ms)
2026-11-08T13:23:26Z [load_day 2025-08-13] 2025-08-13 hour 22: 150012 events in 0 files, snapshot none (task 8934 ms: download 6346 ms overlapping gunzip 1218 ms, parse 4802 ms, sort 0 ms, write 0 ms, index 439 ms: 10 candidates, 63322 repo-hours, 825 releases; waiting 2174 ms; commit 0 ms)
2026-11-08T13:23:26Z [load_day 2025-08-13] 2025-08-13 hour 23: 147542 events in 0 files, snapshot none (task 6424 ms: download 3252 ms overlapping gunzip 1026 ms, parse 4072 ms, sort 0 ms, write 0 ms, index 736 ms: 4 candidates, 59076 repo-hours, 820 releases; waiting 384 ms; commit 0 ms)
2026-11-08T13:23:41Z [load_day 2025-08-13] 2025-08-13: repo_hour merged from 24 files to 1 (1817379 rows, 15439 ms)
2026-11-08T13:23:44Z [load_day 2025-08-13] 2025-08-13: index committed in 18193 ms (24 + 1 + 24 files)
2026-11-08T13:23:44Z [load_day 2025-08-13] 2025-08-13: 3794323 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:23:44Z [load_day 2025-08-13] attempt 1 succeeded