orcaLog in

Runs · run 3913

load_day 2025-05-17, attempt 1 succeeded

Host
73ccef5e07c2:306825
Started
2026-11-08T11:59:44Z
Ended
2026-11-08T12:01:25Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
838 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
146.5 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3913/load_day/2025-05-17/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:59:44Z [load_day 2025-05-17] attempt 1 started
2026-11-08T11:59:45Z [load_day 2025-05-17] 2025-05-17: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:59:54Z [load_day 2025-05-17] 2025-05-17 hour 0: 175883 events in 0 files, snapshot none (task 9164 ms: download 5473 ms overlapping gunzip 1428 ms, parse 6159 ms, sort 0 ms, write 0 ms, index 707 ms: 8 candidates, 82219 repo-hours, 1230 releases; waiting 515 ms; commit 0 ms)
2026-11-08T11:59:54Z [load_day 2025-05-17] 2025-05-17 hour 1: 203849 events in 0 files, snapshot none (task 8710 ms: download 4953 ms overlapping gunzip 1290 ms, parse 5426 ms, sort 0 ms, write 0 ms, index 1180 ms: 17 candidates, 113588 repo-hours, 862 releases; waiting 501 ms; commit 0 ms)
2026-11-08T12:00:02Z [load_day 2025-05-17] 2025-05-17 hour 2: 163159 events in 0 files, snapshot none (task 7364 ms: download 3180 ms overlapping gunzip 1081 ms, parse 4723 ms, sort 0 ms, write 0 ms, index 869 ms: 8 candidates, 71829 repo-hours, 748 releases; waiting 357 ms; commit 0 ms)
2026-11-08T12:00:02Z [load_day 2025-05-17] 2025-05-17 hour 3: 182962 events in 0 files, snapshot none (task 7560 ms: download 3955 ms overlapping gunzip 1134 ms, parse 4790 ms, sort 0 ms, write 0 ms, index 798 ms: 6 candidates, 74337 repo-hours, 2791 releases; waiting 530 ms; commit 0 ms)
2026-11-08T12:00:09Z [load_day 2025-05-17] 2025-05-17 hour 4: 168478 events in 0 files, snapshot none (task 6155 ms: download 3373 ms overlapping gunzip 914 ms, parse 3834 ms, sort 0 ms, write 0 ms, index 561 ms: 8 candidates, 64883 repo-hours, 712 releases; waiting 564 ms; commit 0 ms)
2026-11-08T12:00:09Z [load_day 2025-05-17] 2025-05-17 hour 5: 175090 events in 0 files, snapshot none (task 6130 ms: download 3942 ms overlapping gunzip 903 ms, parse 3912 ms, sort 0 ms, write 0 ms, index 574 ms: 2 candidates, 67903 repo-hours, 873 releases; waiting 458 ms; commit 0 ms)
2026-11-08T12:00:17Z [load_day 2025-05-17] 2025-05-17 hour 6: 191489 events in 0 files, snapshot none (task 7265 ms: download 4115 ms overlapping gunzip 1141 ms, parse 4877 ms, sort 0 ms, write 0 ms, index 736 ms: 4 candidates, 83015 repo-hours, 1070 releases; waiting 205 ms; commit 0 ms)
2026-11-08T12:00:17Z [load_day 2025-05-17] 2025-05-17 hour 7: 190018 events in 0 files, snapshot none (task 7734 ms: download 4610 ms overlapping gunzip 1175 ms, parse 4925 ms, sort 0 ms, write 0 ms, index 612 ms: 4 candidates, 74153 repo-hours, 1084 releases; waiting 461 ms; commit 0 ms)
2026-11-08T12:00:25Z [load_day 2025-05-17] 2025-05-17 hour 8: 193792 events in 0 files, snapshot none (task 7495 ms: download 4087 ms overlapping gunzip 1126 ms, parse 4457 ms, sort 0 ms, write 0 ms, index 761 ms: 11 candidates, 79419 repo-hours, 1116 releases; waiting 764 ms; commit 0 ms)
2026-11-08T12:00:25Z [load_day 2025-05-17] 2025-05-17 hour 9: 200417 events in 0 files, snapshot none (task 7278 ms: download 4368 ms overlapping gunzip 1021 ms, parse 4435 ms, sort 0 ms, write 0 ms, index 703 ms: 12 candidates, 81550 repo-hours, 1122 releases; waiting 794 ms; commit 0 ms)
2026-11-08T12:00:31Z [load_day 2025-05-17] 2025-05-17 hour 10: 198088 events in 0 files, snapshot none (task 5324 ms: download 2915 ms overlapping gunzip 725 ms, parse 3231 ms, sort 0 ms, write 0 ms, index 636 ms: 6 candidates, 81508 repo-hours, 1029 releases; waiting 501 ms; commit 0 ms)
2026-11-08T12:00:31Z [load_day 2025-05-17] 2025-05-17 hour 11: 196256 events in 0 files, snapshot none (task 5391 ms: download 3316 ms overlapping gunzip 772 ms, parse 3236 ms, sort 0 ms, write 0 ms, index 626 ms: 19 candidates, 76804 repo-hours, 1079 releases; waiting 480 ms; commit 0 ms)
2026-11-08T12:00:37Z [load_day 2025-05-17] 2025-05-17 hour 12: 256462 events in 0 files, snapshot none (task 6014 ms: download 2928 ms overlapping gunzip 796 ms, parse 3577 ms, sort 0 ms, write 0 ms, index 795 ms: 10 candidates, 125182 repo-hours, 1080 releases; waiting 277 ms; commit 0 ms)
2026-11-08T12:00:38Z [load_day 2025-05-17] 2025-05-17 hour 13: 228825 events in 0 files, snapshot none (task 6209 ms: download 3521 ms overlapping gunzip 830 ms, parse 3846 ms, sort 0 ms, write 0 ms, index 750 ms: 11 candidates, 109343 repo-hours, 937 releases; waiting 496 ms; commit 0 ms)
2026-11-08T12:00:44Z [load_day 2025-05-17] 2025-05-17 hour 14: 214646 events in 0 files, snapshot none (task 5941 ms: download 3470 ms overlapping gunzip 843 ms, parse 3624 ms, sort 0 ms, write 0 ms, index 630 ms: 16 candidates, 88016 repo-hours, 852 releases; waiting 549 ms; commit 0 ms)
2026-11-08T12:00:44Z [load_day 2025-05-17] 2025-05-17 hour 15: 219180 events in 0 files, snapshot none (task 5938 ms: download 3456 ms overlapping gunzip 790 ms, parse 3470 ms, sort 0 ms, write 0 ms, index 676 ms: 13 candidates, 92555 repo-hours, 1053 releases; waiting 718 ms; commit 0 ms)
2026-11-08T12:00:51Z [load_day 2025-05-17] 2025-05-17 hour 16: 215436 events in 0 files, snapshot none (task 7137 ms: download 4255 ms overlapping gunzip 981 ms, parse 4639 ms, sort 0 ms, write 0 ms, index 724 ms: 15 candidates, 88728 repo-hours, 1003 releases; waiting 524 ms; commit 0 ms)
2026-11-08T12:00:51Z [load_day 2025-05-17] 2025-05-17 hour 17: 206045 events in 0 files, snapshot none (task 6303 ms: download 4073 ms overlapping gunzip 910 ms, parse 4073 ms, sort 0 ms, write 0 ms, index 595 ms: 4 candidates, 79655 repo-hours, 874 releases; waiting 464 ms; commit 0 ms)
2026-11-08T12:00:59Z [load_day 2025-05-17] 2025-05-17 hour 18: 213731 events in 0 files, snapshot none (task 7157 ms: download 4207 ms overlapping gunzip 968 ms, parse 4429 ms, sort 0 ms, write 0 ms, index 907 ms: 14 candidates, 95643 repo-hours, 1032 releases; waiting 512 ms; commit 0 ms)
2026-11-08T12:00:59Z [load_day 2025-05-17] 2025-05-17 hour 19: 192480 events in 0 files, snapshot none (task 6816 ms: download 4300 ms overlapping gunzip 980 ms, parse 4457 ms, sort 0 ms, write 0 ms, index 559 ms: 11 candidates, 71446 repo-hours, 882 releases; waiting 482 ms; commit 0 ms)
2026-11-08T12:01:07Z [load_day 2025-05-17] 2025-05-17 hour 20: 187987 events in 0 files, snapshot none (task 7978 ms: download 4895 ms overlapping gunzip 821 ms, parse 4022 ms, sort 0 ms, write 0 ms, index 630 ms: 12 candidates, 73010 repo-hours, 993 releases; waiting 2137 ms; commit 0 ms)
2026-11-08T12:01:07Z [load_day 2025-05-17] 2025-05-17 hour 21: 178959 events in 0 files, snapshot none (task 6931 ms: download 3717 ms overlapping gunzip 829 ms, parse 3652 ms, sort 0 ms, write 0 ms, index 711 ms: 4 candidates, 70287 repo-hours, 979 releases; waiting 1374 ms; commit 0 ms)
2026-11-08T12:01:13Z [load_day 2025-05-17] 2025-05-17 hour 22: 161302 events in 0 files, snapshot none (task 5146 ms: download 3060 ms overlapping gunzip 673 ms, parse 2971 ms, sort 0 ms, write 0 ms, index 437 ms: 7 candidates, 58030 repo-hours, 860 releases; waiting 649 ms; commit 0 ms)
2026-11-08T12:01:13Z [load_day 2025-05-17] 2025-05-17 hour 23: 155503 events in 0 files, snapshot none (task 4974 ms: download 3261 ms overlapping gunzip 699 ms, parse 2941 ms, sort 0 ms, write 0 ms, index 452 ms: 6 candidates, 58606 repo-hours, 919 releases; waiting 537 ms; commit 0 ms)
2026-11-08T12:01:22Z [load_day 2025-05-17] 2025-05-17: repo_hour merged from 24 files to 1 (1961709 rows, 8859 ms)
2026-11-08T12:01:25Z [load_day 2025-05-17] 2025-05-17: index committed in 11762 ms (24 + 1 + 24 files)
2026-11-08T12:01:25Z [load_day 2025-05-17] 2025-05-17: 4670037 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:01:25Z [load_day 2025-05-17] attempt 1 succeeded