orcaLog in

Runs · run 4074

load_day 2025-06-26, attempt 1 succeeded

Host
73ccef5e07c2:331891
Started
2026-11-08T12:40:02Z
Ended
2026-11-08T12:41:43Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
687 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
144.1 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4074/load_day/2025-06-26/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:40:02Z [load_day 2025-06-26] attempt 1 started
2026-11-08T12:40:03Z [load_day 2025-06-26] 2025-06-26: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:40:09Z [load_day 2025-06-26] 2025-06-26 hour 0: 146200 events in 0 files, snapshot none (task 4668 ms: download 2724 ms overlapping gunzip 707 ms, parse 2895 ms, sort 0 ms, write 0 ms, index 550 ms: 13 candidates, 72722 repo-hours, 1053 releases; waiting 203 ms; commit 0 ms)
2026-11-08T12:40:09Z [load_day 2025-06-26] 2025-06-26 hour 1: 150813 events in 0 files, snapshot none (task 4882 ms: download 2355 ms overlapping gunzip 662 ms, parse 2784 ms, sort 0 ms, write 0 ms, index 598 ms: 7 candidates, 88123 repo-hours, 725 releases; waiting 501 ms; commit 0 ms)
2026-11-08T12:40:15Z [load_day 2025-06-26] 2025-06-26 hour 2: 147670 events in 0 files, snapshot none (task 5309 ms: download 3065 ms overlapping gunzip 719 ms, parse 2953 ms, sort 0 ms, write 0 ms, index 541 ms: 9 candidates, 73283 repo-hours, 804 releases; waiting 758 ms; commit 0 ms)
2026-11-08T12:40:15Z [load_day 2025-06-26] 2025-06-26 hour 3: 146935 events in 0 files, snapshot none (task 4760 ms: download 2700 ms overlapping gunzip 678 ms, parse 2749 ms, sort 0 ms, write 0 ms, index 505 ms: 9 candidates, 68798 repo-hours, 1783 releases; waiting 512 ms; commit 0 ms)
2026-11-08T12:40:21Z [load_day 2025-06-26] 2025-06-26 hour 4: 146565 events in 0 files, snapshot none (task 5730 ms: download 3378 ms overlapping gunzip 914 ms, parse 3854 ms, sort 0 ms, write 0 ms, index 469 ms: 10 candidates, 64295 repo-hours, 995 releases; waiting 228 ms; commit 0 ms)
2026-11-08T12:40:21Z [load_day 2025-06-26] 2025-06-26 hour 5: 146806 events in 0 files, snapshot none (task 6030 ms: download 3610 ms overlapping gunzip 942 ms, parse 4019 ms, sort 0 ms, write 0 ms, index 461 ms: 4 candidates, 64995 repo-hours, 622 releases; waiting 220 ms; commit 0 ms)
2026-11-08T12:40:28Z [load_day 2025-06-26] 2025-06-26 hour 6: 153431 events in 0 files, snapshot none (task 6451 ms: download 3870 ms overlapping gunzip 1033 ms, parse 4110 ms, sort 0 ms, write 0 ms, index 561 ms: 3 candidates, 78439 repo-hours, 706 releases; waiting 510 ms; commit 0 ms)
2026-11-08T12:40:29Z [load_day 2025-06-26] 2025-06-26 hour 7: 158686 events in 0 files, snapshot none (task 7210 ms: download 4835 ms overlapping gunzip 1128 ms, parse 4706 ms, sort 0 ms, write 0 ms, index 609 ms: 5 candidates, 75461 repo-hours, 779 releases; waiting 491 ms; commit 0 ms)
2026-11-08T12:40:36Z [load_day 2025-06-26] 2025-06-26 hour 8: 156919 events in 0 files, snapshot none (task 7326 ms: download 4512 ms overlapping gunzip 1174 ms, parse 4930 ms, sort 0 ms, write 0 ms, index 706 ms: 5 candidates, 77702 repo-hours, 855 releases; waiting 226 ms; commit 0 ms)
2026-11-08T12:40:36Z [load_day 2025-06-26] 2025-06-26 hour 9: 158397 events in 0 files, snapshot none (task 7254 ms: download 4451 ms overlapping gunzip 1148 ms, parse 4716 ms, sort 0 ms, write 0 ms, index 756 ms: 6 candidates, 79670 repo-hours, 872 releases; waiting 318 ms; commit 0 ms)
2026-11-08T12:40:45Z [load_day 2025-06-26] 2025-06-26 hour 10: 160584 events in 0 files, snapshot none (task 8890 ms: download 5970 ms overlapping gunzip 1500 ms, parse 5894 ms, sort 0 ms, write 0 ms, index 772 ms: 9 candidates, 78443 repo-hours, 840 releases; waiting 508 ms; commit 0 ms)
2026-11-08T12:40:45Z [load_day 2025-06-26] 2025-06-26 hour 11: 161313 events in 0 files, snapshot none (task 8403 ms: download 5294 ms overlapping gunzip 1352 ms, parse 5803 ms, sort 0 ms, write 0 ms, index 752 ms: 9 candidates, 75919 repo-hours, 791 releases; waiting 184 ms; commit 0 ms)
2026-11-08T12:40:53Z [load_day 2025-06-26] 2025-06-26 hour 12: 161698 events in 0 files, snapshot none (task 7575 ms: download 4553 ms overlapping gunzip 1155 ms, parse 4891 ms, sort 0 ms, write 0 ms, index 753 ms: 8 candidates, 94608 repo-hours, 794 releases; waiting 532 ms; commit 0 ms)
2026-11-08T12:40:53Z [load_day 2025-06-26] 2025-06-26 hour 13: 157920 events in 0 files, snapshot none (task 7346 ms: download 4406 ms overlapping gunzip 1147 ms, parse 4926 ms, sort 0 ms, write 0 ms, index 787 ms: 11 candidates, 88726 repo-hours, 773 releases; waiting 188 ms; commit 0 ms)
2026-11-08T12:41:01Z [load_day 2025-06-26] 2025-06-26 hour 14: 153470 events in 0 files, snapshot none (task 7343 ms: download 4766 ms overlapping gunzip 1189 ms, parse 4740 ms, sort 0 ms, write 0 ms, index 634 ms: 4 candidates, 80014 repo-hours, 822 releases; waiting 546 ms; commit 0 ms)
2026-11-08T12:41:02Z [load_day 2025-06-26] 2025-06-26 hour 15: 163375 events in 0 files, snapshot none (task 7945 ms: download 5137 ms overlapping gunzip 1298 ms, parse 5222 ms, sort 0 ms, write 0 ms, index 686 ms: 10 candidates, 84169 repo-hours, 938 releases; waiting 491 ms; commit 0 ms)
2026-11-08T12:41:09Z [load_day 2025-06-26] 2025-06-26 hour 16: 163696 events in 0 files, snapshot none (task 7586 ms: download 4864 ms overlapping gunzip 1164 ms, parse 4820 ms, sort 0 ms, write 0 ms, index 753 ms: 5 candidates, 81971 repo-hours, 998 releases; waiting 530 ms; commit 0 ms)
2026-11-08T12:41:10Z [load_day 2025-06-26] 2025-06-26 hour 17: 159686 events in 0 files, snapshot none (task 7414 ms: download 4730 ms overlapping gunzip 1183 ms, parse 4862 ms, sort 0 ms, write 0 ms, index 617 ms: 11 candidates, 75047 repo-hours, 737 releases; waiting 521 ms; commit 0 ms)
2026-11-08T12:41:17Z [load_day 2025-06-26] 2025-06-26 hour 18: 163654 events in 0 files, snapshot none (task 7254 ms: download 4388 ms overlapping gunzip 1115 ms, parse 4537 ms, sort 0 ms, write 0 ms, index 725 ms: 7 candidates, 80827 repo-hours, 912 releases; waiting 564 ms; commit 0 ms)
2026-11-08T12:41:17Z [load_day 2025-06-26] 2025-06-26 hour 19: 154830 events in 0 files, snapshot none (task 6922 ms: download 4205 ms overlapping gunzip 1072 ms, parse 4618 ms, sort 0 ms, write 0 ms, index 528 ms: 14 candidates, 69536 repo-hours, 890 releases; waiting 409 ms; commit 0 ms)
2026-11-08T12:41:25Z [load_day 2025-06-26] 2025-06-26 hour 20: 154651 events in 0 files, snapshot none (task 7155 ms: download 4337 ms overlapping gunzip 1094 ms, parse 4617 ms, sort 0 ms, write 0 ms, index 544 ms: 7 candidates, 68982 repo-hours, 760 releases; waiting 531 ms; commit 0 ms)
2026-11-08T12:41:25Z [load_day 2025-06-26] 2025-06-26 hour 21: 150857 events in 0 files, snapshot none (task 6393 ms: download 3641 ms overlapping gunzip 986 ms, parse 3937 ms, sort 0 ms, write 0 ms, index 705 ms: 9 candidates, 65592 repo-hours, 807 releases; waiting 540 ms; commit 0 ms)
2026-11-08T12:41:32Z [load_day 2025-06-26] 2025-06-26 hour 22: 147977 events in 0 files, snapshot none (task 6516 ms: download 3996 ms overlapping gunzip 1020 ms, parse 4078 ms, sort 0 ms, write 0 ms, index 401 ms: 11 candidates, 60254 repo-hours, 897 releases; waiting 679 ms; commit 0 ms)
2026-11-08T12:41:32Z [load_day 2025-06-26] 2025-06-26 hour 23: 145949 events in 0 files, snapshot none (task 6322 ms: download 3228 ms overlapping gunzip 993 ms, parse 3917 ms, sort 0 ms, write 0 ms, index 597 ms: 12 candidates, 57709 repo-hours, 921 releases; waiting 527 ms; commit 0 ms)
2026-11-08T12:41:40Z [load_day 2025-06-26] 2025-06-26: repo_hour merged from 24 files to 1 (1805285 rows, 8521 ms)
2026-11-08T12:41:43Z [load_day 2025-06-26] 2025-06-26: index committed in 10995 ms (24 + 1 + 24 files)
2026-11-08T12:41:43Z [load_day 2025-06-26] 2025-06-26: 3712082 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:41:43Z [load_day 2025-06-26] attempt 1 succeeded