orcaLog in

Runs · run 3366

load_day 2024-12-27, attempt 1 succeeded

Host
73ccef5e07c2:228619
Started
2026-11-08T09:33:19Z
Ended
2026-11-08T09:34:52Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
773 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
132.9 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3366/load_day/2024-12-27/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:33:19Z [load_day 2024-12-27] attempt 1 started
2026-11-08T09:33:20Z [load_day 2024-12-27] 2024-12-27: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:33:26Z [load_day 2024-12-27] 2024-12-27 hour 0: 161373 events in 0 files, snapshot none (task 4891 ms: download 2564 ms overlapping gunzip 672 ms, parse 2851 ms, sort 0 ms, write 0 ms, index 703 ms: 7 candidates, 78375 repo-hours, 1416 releases; waiting 312 ms; commit 0 ms)
2026-11-08T09:33:26Z [load_day 2024-12-27] 2024-12-27 hour 1: 178701 events in 0 files, snapshot none (task 5524 ms: download 2874 ms overlapping gunzip 798 ms, parse 3318 ms, sort 0 ms, write 0 ms, index 753 ms: 5 candidates, 99168 repo-hours, 824 releases; waiting 444 ms; commit 0 ms)
2026-11-08T09:33:31Z [load_day 2024-12-27] 2024-12-27 hour 2: 157100 events in 0 files, snapshot none (task 5414 ms: download 2941 ms overlapping gunzip 766 ms, parse 3262 ms, sort 0 ms, write 0 ms, index 515 ms: 3 candidates, 70508 repo-hours, 829 releases; waiting 531 ms; commit 0 ms)
2026-11-08T09:33:32Z [load_day 2024-12-27] 2024-12-27 hour 3: 176363 events in 0 files, snapshot none (task 4974 ms: download 2470 ms overlapping gunzip 716 ms, parse 3146 ms, sort 0 ms, write 0 ms, index 537 ms: 3 candidates, 69823 repo-hours, 4005 releases; waiting 285 ms; commit 0 ms)
2026-11-08T09:33:37Z [load_day 2024-12-27] 2024-12-27 hour 4: 159452 events in 0 files, snapshot none (task 5160 ms: download 2245 ms overlapping gunzip 752 ms, parse 3074 ms, sort 0 ms, write 0 ms, index 416 ms: 4 candidates, 56589 repo-hours, 641 releases; waiting 513 ms; commit 0 ms)
2026-11-08T09:33:38Z [load_day 2024-12-27] 2024-12-27 hour 5: 166378 events in 0 files, snapshot none (task 5548 ms: download 3004 ms overlapping gunzip 791 ms, parse 3483 ms, sort 0 ms, write 0 ms, index 492 ms: 6 candidates, 61196 repo-hours, 722 releases; waiting 472 ms; commit 0 ms)
2026-11-08T09:33:44Z [load_day 2024-12-27] 2024-12-27 hour 6: 192968 events in 0 files, snapshot none (task 6134 ms: download 3129 ms overlapping gunzip 887 ms, parse 4111 ms, sort 0 ms, write 0 ms, index 652 ms: 2 candidates, 81654 repo-hours, 912 releases; waiting 212 ms; commit 0 ms)
2026-11-08T09:33:44Z [load_day 2024-12-27] 2024-12-27 hour 7: 185563 events in 0 files, snapshot none (task 5952 ms: download 3400 ms overlapping gunzip 981 ms, parse 3919 ms, sort 0 ms, write 0 ms, index 516 ms: 3 candidates, 69000 repo-hours, 746 releases; waiting 261 ms; commit 0 ms)
2026-11-08T09:33:51Z [load_day 2024-12-27] 2024-12-27 hour 8: 189744 events in 0 files, snapshot none (task 6220 ms: download 3252 ms overlapping gunzip 932 ms, parse 4121 ms, sort 0 ms, write 0 ms, index 586 ms: 8 candidates, 74508 repo-hours, 815 releases; waiting 289 ms; commit 0 ms)
2026-11-08T09:33:52Z [load_day 2024-12-27] 2024-12-27 hour 9: 203352 events in 0 files, snapshot none (task 6885 ms: download 4135 ms overlapping gunzip 1020 ms, parse 4479 ms, sort 0 ms, write 0 ms, index 590 ms: 4 candidates, 80783 repo-hours, 1022 releases; waiting 515 ms; commit 0 ms)
2026-11-08T09:33:58Z [load_day 2024-12-27] 2024-12-27 hour 10: 193838 events in 0 files, snapshot none (task 6979 ms: download 3984 ms overlapping gunzip 1072 ms, parse 4437 ms, sort 0 ms, write 0 ms, index 544 ms: 5 candidates, 73866 repo-hours, 906 releases; waiting 512 ms; commit 0 ms)
2026-11-08T09:33:59Z [load_day 2024-12-27] 2024-12-27 hour 11: 186530 events in 0 files, snapshot none (task 6420 ms: download 3650 ms overlapping gunzip 989 ms, parse 4130 ms, sort 0 ms, write 0 ms, index 578 ms: 6 candidates, 68508 repo-hours, 864 releases; waiting 496 ms; commit 0 ms)
2026-11-08T09:34:06Z [load_day 2024-12-27] 2024-12-27 hour 12: 240060 events in 0 files, snapshot none (task 7119 ms: download 4318 ms overlapping gunzip 1068 ms, parse 4745 ms, sort 0 ms, write 0 ms, index 764 ms: 7 candidates, 115744 repo-hours, 989 releases; waiting 247 ms; commit 0 ms)
2026-11-08T09:34:06Z [load_day 2024-12-27] 2024-12-27 hour 13: 211973 events in 0 files, snapshot none (task 6651 ms: download 4075 ms overlapping gunzip 997 ms, parse 4230 ms, sort 0 ms, write 0 ms, index 657 ms: 4 candidates, 95333 repo-hours, 1259 releases; waiting 447 ms; commit 0 ms)
2026-11-08T09:34:12Z [load_day 2024-12-27] 2024-12-27 hour 14: 205022 events in 0 files, snapshot none (task 5882 ms: download 3362 ms overlapping gunzip 908 ms, parse 3826 ms, sort 0 ms, write 0 ms, index 573 ms: 5 candidates, 78657 repo-hours, 997 releases; waiting 276 ms; commit 0 ms)
2026-11-08T09:34:12Z [load_day 2024-12-27] 2024-12-27 hour 15: 212087 events in 0 files, snapshot none (task 5948 ms: download 3368 ms overlapping gunzip 854 ms, parse 3598 ms, sort 0 ms, write 0 ms, index 663 ms: 4 candidates, 86484 repo-hours, 1137 releases; waiting 491 ms; commit 0 ms)
2026-11-08T09:34:21Z [load_day 2024-12-27] 2024-12-27 hour 16: 204556 events in 0 files, snapshot none (task 8786 ms: download 5824 ms overlapping gunzip 850 ms, parse 3910 ms, sort 0 ms, write 0 ms, index 667 ms: 6 candidates, 81774 repo-hours, 982 releases; waiting 3060 ms; commit 0 ms)
2026-11-08T09:34:21Z [load_day 2024-12-27] 2024-12-27 hour 17: 194505 events in 0 files, snapshot none (task 5578 ms: download 2596 ms overlapping gunzip 700 ms, parse 3055 ms, sort 0 ms, write 0 ms, index 1084 ms: 1 candidates, 73913 repo-hours, 891 releases; waiting 521 ms; commit 0 ms)
2026-11-08T09:34:29Z [load_day 2024-12-27] 2024-12-27 hour 18: 199556 events in 0 files, snapshot none (task 7679 ms: download 4682 ms overlapping gunzip 1156 ms, parse 5059 ms, sort 0 ms, write 0 ms, index 656 ms: 4 candidates, 85404 repo-hours, 1052 releases; waiting 504 ms; commit 0 ms)
2026-11-08T09:34:29Z [load_day 2024-12-27] 2024-12-27 hour 19: 175101 events in 0 files, snapshot none (task 7032 ms: download 3873 ms overlapping gunzip 1125 ms, parse 4861 ms, sort 0 ms, write 0 ms, index 521 ms: 4 candidates, 64067 repo-hours, 939 releases; waiting 211 ms; commit 0 ms)
2026-11-08T09:34:35Z [load_day 2024-12-27] 2024-12-27 hour 20: 166200 events in 0 files, snapshot none (task 5679 ms: download 3249 ms overlapping gunzip 837 ms, parse 3584 ms, sort 0 ms, write 0 ms, index 452 ms: 4 candidates, 62796 repo-hours, 898 releases; waiting 508 ms; commit 0 ms)
2026-11-08T09:34:35Z [load_day 2024-12-27] 2024-12-27 hour 21: 164571 events in 0 files, snapshot none (task 5462 ms: download 3088 ms overlapping gunzip 762 ms, parse 3420 ms, sort 0 ms, write 0 ms, index 543 ms: 5 candidates, 63043 repo-hours, 902 releases; waiting 466 ms; commit 0 ms)
2026-11-08T09:34:41Z [load_day 2024-12-27] 2024-12-27 hour 22: 150200 events in 0 files, snapshot none (task 5085 ms: download 2919 ms overlapping gunzip 726 ms, parse 3051 ms, sort 0 ms, write 0 ms, index 404 ms: 7 candidates, 54206 repo-hours, 1032 releases; waiting 524 ms; commit 0 ms)
2026-11-08T09:34:41Z [load_day 2024-12-27] 2024-12-27 hour 23: 139639 events in 0 files, snapshot none (task 5488 ms: download 2988 ms overlapping gunzip 789 ms, parse 3648 ms, sort 0 ms, write 0 ms, index 388 ms: 7 candidates, 50378 repo-hours, 688 releases; waiting 433 ms; commit 0 ms)
2026-11-08T09:34:50Z [load_day 2024-12-27] 2024-12-27: repo_hour merged from 24 files to 1 (1795777 rows, 8178 ms)
2026-11-08T09:34:52Z [load_day 2024-12-27] 2024-12-27: index committed in 10689 ms (24 + 1 + 24 files)
2026-11-08T09:34:52Z [load_day 2024-12-27] 2024-12-27: 4414832 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:34:52Z [load_day 2024-12-27] attempt 1 succeeded