orcaLog in

Runs · run 3833

load_day 2025-04-27, attempt 1 succeeded

Host
73ccef5e07c2:294628
Started
2026-11-08T11:38:11Z
Ended
2026-11-08T11:39:52Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
706 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
146.6 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3833/load_day/2025-04-27/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:38:11Z [load_day 2025-04-27] attempt 1 started
2026-11-08T11:38:12Z [load_day 2025-04-27] 2025-04-27: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:38:19Z [load_day 2025-04-27] 2025-04-27 hour 0: 166175 events in 0 files, snapshot none (task 6515 ms: download 2800 ms overlapping gunzip 977 ms, parse 4347 ms, sort 0 ms, write 0 ms, index 653 ms: 15 candidates, 75821 repo-hours, 1143 releases; waiting 214 ms; commit 0 ms)
2026-11-08T11:38:19Z [load_day 2025-04-27] 2025-04-27 hour 1: 199517 events in 0 files, snapshot none (task 7001 ms: download 3208 ms overlapping gunzip 1001 ms, parse 4302 ms, sort 0 ms, write 0 ms, index 877 ms: 12 candidates, 109950 repo-hours, 932 releases; waiting 490 ms; commit 0 ms)
2026-11-08T11:38:26Z [load_day 2025-04-27] 2025-04-27 hour 2: 170922 events in 0 files, snapshot none (task 6775 ms: download 3684 ms overlapping gunzip 943 ms, parse 4169 ms, sort 0 ms, write 0 ms, index 766 ms: 4 candidates, 77900 repo-hours, 1001 releases; waiting 583 ms; commit 0 ms)
2026-11-08T11:38:27Z [load_day 2025-04-27] 2025-04-27 hour 3: 183845 events in 0 files, snapshot none (task 6688 ms: download 3699 ms overlapping gunzip 933 ms, parse 4242 ms, sort 0 ms, write 0 ms, index 621 ms: 14 candidates, 74875 repo-hours, 3006 releases; waiting 574 ms; commit 0 ms)
2026-11-08T11:38:33Z [load_day 2025-04-27] 2025-04-27 hour 4: 164567 events in 0 files, snapshot none (task 6180 ms: download 2971 ms overlapping gunzip 921 ms, parse 3894 ms, sort 0 ms, write 0 ms, index 627 ms: 6 candidates, 61648 repo-hours, 762 releases; waiting 517 ms; commit 0 ms)
2026-11-08T11:38:33Z [load_day 2025-04-27] 2025-04-27 hour 5: 167990 events in 0 files, snapshot none (task 6208 ms: download 3274 ms overlapping gunzip 882 ms, parse 3675 ms, sort 0 ms, write 0 ms, index 534 ms: 2 candidates, 65145 repo-hours, 766 releases; waiting 528 ms; commit 0 ms)
2026-11-08T11:38:39Z [load_day 2025-04-27] 2025-04-27 hour 6: 191827 events in 0 files, snapshot none (task 5422 ms: download 2839 ms overlapping gunzip 743 ms, parse 3232 ms, sort 0 ms, write 0 ms, index 688 ms: 3 candidates, 84239 repo-hours, 859 releases; waiting 513 ms; commit 0 ms)
2026-11-08T11:38:40Z [load_day 2025-04-27] 2025-04-27 hour 7: 193678 events in 0 files, snapshot none (task 6179 ms: download 3574 ms overlapping gunzip 823 ms, parse 3461 ms, sort 0 ms, write 0 ms, index 584 ms: 2 candidates, 74331 repo-hours, 896 releases; waiting 905 ms; commit 0 ms)
2026-11-08T11:38:45Z [load_day 2025-04-27] 2025-04-27 hour 8: 196868 events in 0 files, snapshot none (task 5348 ms: download 2825 ms overlapping gunzip 719 ms, parse 3076 ms, sort 0 ms, write 0 ms, index 560 ms: 2 candidates, 79377 repo-hours, 857 releases; waiting 518 ms; commit 0 ms)
2026-11-08T11:38:46Z [load_day 2025-04-27] 2025-04-27 hour 9: 206900 events in 0 files, snapshot none (task 5703 ms: download 3167 ms overlapping gunzip 786 ms, parse 3403 ms, sort 0 ms, write 0 ms, index 611 ms: 6 candidates, 83418 repo-hours, 1014 releases; waiting 564 ms; commit 0 ms)
2026-11-08T11:38:52Z [load_day 2025-04-27] 2025-04-27 hour 10: 205943 events in 0 files, snapshot none (task 6577 ms: download 3366 ms overlapping gunzip 923 ms, parse 3998 ms, sort 0 ms, write 0 ms, index 780 ms: 7 candidates, 82019 repo-hours, 972 releases; waiting 561 ms; commit 0 ms)
2026-11-08T11:38:54Z [load_day 2025-04-27] 2025-04-27 hour 11: 200106 events in 0 files, snapshot none (task 6940 ms: download 3931 ms overlapping gunzip 982 ms, parse 4420 ms, sort 0 ms, write 0 ms, index 719 ms: 2 candidates, 76314 repo-hours, 942 releases; waiting 522 ms; commit 0 ms)
2026-11-08T11:39:00Z [load_day 2025-04-27] 2025-04-27 hour 12: 249751 events in 0 files, snapshot none (task 8050 ms: download 3212 ms overlapping gunzip 1104 ms, parse 4917 ms, sort 0 ms, write 0 ms, index 1393 ms: 5 candidates, 123721 repo-hours, 1037 releases; waiting 309 ms; commit 0 ms)
2026-11-08T11:39:02Z [load_day 2025-04-27] 2025-04-27 hour 13: 234711 events in 0 files, snapshot none (task 8005 ms: download 4592 ms overlapping gunzip 1094 ms, parse 4994 ms, sort 0 ms, write 0 ms, index 868 ms: 6 candidates, 106261 repo-hours, 979 releases; waiting 787 ms; commit 0 ms)
2026-11-08T11:39:08Z [load_day 2025-04-27] 2025-04-27 hour 14: 225473 events in 0 files, snapshot none (task 7201 ms: download 3343 ms overlapping gunzip 945 ms, parse 4333 ms, sort 0 ms, write 0 ms, index 1109 ms: 11 candidates, 88011 repo-hours, 1092 releases; waiting 506 ms; commit 0 ms)
2026-11-08T11:39:10Z [load_day 2025-04-27] 2025-04-27 hour 15: 219413 events in 0 files, snapshot none (task 7057 ms: download 3552 ms overlapping gunzip 1026 ms, parse 4649 ms, sort 0 ms, write 0 ms, index 745 ms: 5 candidates, 93093 repo-hours, 1084 releases; waiting 335 ms; commit 0 ms)
2026-11-08T11:39:16Z [load_day 2025-04-27] 2025-04-27 hour 16: 219133 events in 0 files, snapshot none (task 6772 ms: download 3618 ms overlapping gunzip 911 ms, parse 4137 ms, sort 0 ms, write 0 ms, index 936 ms: 3 candidates, 89336 repo-hours, 924 releases; waiting 556 ms; commit 0 ms)
2026-11-08T11:39:18Z [load_day 2025-04-27] 2025-04-27 hour 17: 216526 events in 0 files, snapshot none (task 7328 ms: download 4038 ms overlapping gunzip 1099 ms, parse 4444 ms, sort 0 ms, write 0 ms, index 1012 ms: 8 candidates, 84484 repo-hours, 963 releases; waiting 538 ms; commit 0 ms)
2026-11-08T11:39:24Z [load_day 2025-04-27] 2025-04-27 hour 18: 229383 events in 0 files, snapshot none (task 7490 ms: download 4742 ms overlapping gunzip 1109 ms, parse 4936 ms, sort 0 ms, write 0 ms, index 717 ms: 12 candidates, 97515 repo-hours, 881 releases; waiting 479 ms; commit 0 ms)
2026-11-08T11:39:26Z [load_day 2025-04-27] 2025-04-27 hour 19: 204034 events in 0 files, snapshot none (task 6948 ms: download 3825 ms overlapping gunzip 981 ms, parse 4169 ms, sort 0 ms, write 0 ms, index 935 ms: 7 candidates, 75316 repo-hours, 958 releases; waiting 506 ms; commit 0 ms)
2026-11-08T11:39:32Z [load_day 2025-04-27] 2025-04-27 hour 20: 200613 events in 0 files, snapshot none (task 7549 ms: download 4182 ms overlapping gunzip 1141 ms, parse 5159 ms, sort 0 ms, write 0 ms, index 731 ms: 4 candidates, 78068 repo-hours, 989 releases; waiting 201 ms; commit 0 ms)
2026-11-08T11:39:33Z [load_day 2025-04-27] 2025-04-27 hour 21: 189504 events in 0 files, snapshot none (task 6795 ms: download 3719 ms overlapping gunzip 1063 ms, parse 4683 ms, sort 0 ms, write 0 ms, index 562 ms: 10 candidates, 71612 repo-hours, 954 releases; waiting 187 ms; commit 0 ms)
2026-11-08T11:39:38Z [load_day 2025-04-27] 2025-04-27 hour 22: 174331 events in 0 files, snapshot none (task 5700 ms: download 3102 ms overlapping gunzip 811 ms, parse 3398 ms, sort 0 ms, write 0 ms, index 653 ms: 16 candidates, 64175 repo-hours, 853 releases; waiting 636 ms; commit 0 ms)
2026-11-08T11:39:40Z [load_day 2025-04-27] 2025-04-27 hour 23: 170321 events in 0 files, snapshot none (task 6175 ms: download 3614 ms overlapping gunzip 918 ms, parse 3906 ms, sort 0 ms, write 0 ms, index 535 ms: 5 candidates, 63685 repo-hours, 696 releases; waiting 516 ms; commit 0 ms)
2026-11-08T11:39:49Z [load_day 2025-04-27] 2025-04-27: repo_hour merged from 24 files to 1 (1980314 rows, 9334 ms)
2026-11-08T11:39:52Z [load_day 2025-04-27] 2025-04-27: index committed in 12411 ms (24 + 1 + 24 files)
2026-11-08T11:39:52Z [load_day 2025-04-27] 2025-04-27: 4781531 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:39:52Z [load_day 2025-04-27] attempt 1 succeeded