orcaLog in

Runs · run 4554

load_day 2025-10-29, attempt 1 succeeded

Host
73ccef5e07c2:398455
Started
2026-11-08T14:20:26Z
Ended
2026-11-08T14:21:29Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
732 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
70.7 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4554/load_day/2025-10-29/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:20:26Z [load_day 2025-10-29] attempt 1 started
2026-11-08T14:20:27Z [load_day 2025-10-29] 2025-10-29: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:20:30Z [load_day 2025-10-29] 2025-10-29 hour 0: 146321 events in 0 files, snapshot none (task 2696 ms: download 1562 ms overlapping gunzip 352 ms, parse 1103 ms, sort 0 ms, write 0 ms, index 534 ms: 3 candidates, 70412 repo-hours, 705 releases; waiting 350 ms; commit 0 ms)
2026-11-08T14:20:30Z [load_day 2025-10-29] 2025-10-29 hour 1: 153394 events in 0 files, snapshot none (task 2731 ms: download 1570 ms overlapping gunzip 382 ms, parse 1193 ms, sort 0 ms, write 0 ms, index 657 ms: 8 candidates, 87583 repo-hours, 591 releases; waiting 245 ms; commit 0 ms)
2026-11-08T14:20:34Z [load_day 2025-10-29] 2025-10-29 hour 2: 148706 events in 0 files, snapshot none (task 3174 ms: download 1931 ms overlapping gunzip 359 ms, parse 1133 ms, sort 0 ms, write 0 ms, index 561 ms: 7 candidates, 70952 repo-hours, 594 releases; waiting 794 ms; commit 0 ms)
2026-11-08T14:20:35Z [load_day 2025-10-29] 2025-10-29 hour 3: 145809 events in 0 files, snapshot none (task 4631 ms: download 2226 ms overlapping gunzip 349 ms, parse 1097 ms, sort 0 ms, write 0 ms, index 2061 ms: 2 candidates, 66941 repo-hours, 1378 releases; waiting 828 ms; commit 0 ms)
2026-11-08T14:20:37Z [load_day 2025-10-29] 2025-10-29 hour 4: 143670 events in 0 files, snapshot none (task 2924 ms: download 2102 ms overlapping gunzip 341 ms, parse 1056 ms, sort 0 ms, write 0 ms, index 455 ms: 4 candidates, 60424 repo-hours, 492 releases; waiting 754 ms; commit 0 ms)
2026-11-08T14:20:39Z [load_day 2025-10-29] 2025-10-29 hour 5: 148259 events in 0 files, snapshot none (task 2856 ms: download 1955 ms overlapping gunzip 343 ms, parse 1095 ms, sort 0 ms, write 0 ms, index 440 ms: 8 candidates, 62386 repo-hours, 514 releases; waiting 706 ms; commit 0 ms)
2026-11-08T14:20:41Z [load_day 2025-10-29] 2025-10-29 hour 6: 147075 events in 0 files, snapshot none (task 3313 ms: download 1871 ms overlapping gunzip 412 ms, parse 1295 ms, sort 0 ms, write 0 ms, index 689 ms: 1 candidates, 71533 repo-hours, 523 releases; waiting 543 ms; commit 0 ms)
2026-11-08T14:20:43Z [load_day 2025-10-29] 2025-10-29 hour 7: 146533 events in 0 files, snapshot none (task 3634 ms: download 2682 ms overlapping gunzip 486 ms, parse 1506 ms, sort 0 ms, write 0 ms, index 562 ms: 1 candidates, 68043 repo-hours, 530 releases; waiting 791 ms; commit 0 ms)
2026-11-08T14:20:44Z [load_day 2025-10-29] 2025-10-29 hour 8: 145343 events in 0 files, snapshot none (task 2791 ms: download 1570 ms overlapping gunzip 359 ms, parse 1084 ms, sort 0 ms, write 0 ms, index 636 ms: 3 candidates, 70095 repo-hours, 514 releases; waiting 326 ms; commit 0 ms)
2026-11-08T14:20:46Z [load_day 2025-10-29] 2025-10-29 hour 9: 145876 events in 0 files, snapshot none (task 2984 ms: download 2022 ms overlapping gunzip 370 ms, parse 1110 ms, sort 0 ms, write 0 ms, index 534 ms: 1 candidates, 72279 repo-hours, 626 releases; waiting 747 ms; commit 0 ms)
2026-11-08T14:20:48Z [load_day 2025-10-29] 2025-10-29 hour 10: 149803 events in 0 files, snapshot none (task 3190 ms: download 2106 ms overlapping gunzip 376 ms, parse 1126 ms, sort 0 ms, write 0 ms, index 604 ms: 3 candidates, 73666 repo-hours, 571 releases; waiting 784 ms; commit 0 ms)
2026-11-08T14:20:50Z [load_day 2025-10-29] 2025-10-29 hour 11: 150313 events in 0 files, snapshot none (task 3238 ms: download 2232 ms overlapping gunzip 375 ms, parse 1160 ms, sort 0 ms, write 0 ms, index 565 ms: 3 candidates, 71943 repo-hours, 488 releases; waiting 837 ms; commit 0 ms)
2026-11-08T14:20:52Z [load_day 2025-10-29] 2025-10-29 hour 12: 157768 events in 0 files, snapshot none (task 3245 ms: download 2055 ms overlapping gunzip 326 ms, parse 1049 ms, sort 0 ms, write 0 ms, index 677 ms: 6 candidates, 94091 repo-hours, 401 releases; waiting 835 ms; commit 0 ms)
2026-11-08T14:20:53Z [load_day 2025-10-29] 2025-10-29 hour 13: 147952 events in 0 files, snapshot none (task 2935 ms: download 1736 ms overlapping gunzip 305 ms, parse 963 ms, sort 0 ms, write 0 ms, index 636 ms: 6 candidates, 86383 repo-hours, 357 releases; waiting 623 ms; commit 0 ms)
2026-11-08T14:20:56Z [load_day 2025-10-29] 2025-10-29 hour 14: 147692 events in 0 files, snapshot none (task 3547 ms: download 2096 ms overlapping gunzip 413 ms, parse 1241 ms, sort 0 ms, write 0 ms, index 1023 ms: 7 candidates, 80555 repo-hours, 534 releases; waiting 655 ms; commit 0 ms)
2026-11-08T14:20:58Z [load_day 2025-10-29] 2025-10-29 hour 15: 148430 events in 0 files, snapshot none (task 3870 ms: download 1973 ms overlapping gunzip 459 ms, parse 1340 ms, sort 0 ms, write 0 ms, index 1380 ms: 5 candidates, 81595 repo-hours, 549 releases; waiting 427 ms; commit 0 ms)
2026-11-08T14:21:03Z [load_day 2025-10-29] 2025-10-29 hour 16: 145419 events in 0 files, snapshot none (task 3932 ms: download 2564 ms overlapping gunzip 564 ms, parse 1699 ms, sort 0 ms, write 0 ms, index 714 ms: 2 candidates, 78555 repo-hours, 552 releases; waiting 665 ms; commit 0 ms)
2026-11-08T14:21:03Z [load_day 2025-10-29] 2025-10-29 hour 17: 145141 events in 0 files, snapshot none (task 3956 ms: download 2234 ms overlapping gunzip 587 ms, parse 1780 ms, sort 0 ms, write 0 ms, index 578 ms: 5 candidates, 73505 repo-hours, 520 releases; waiting 671 ms; commit 0 ms)
2026-11-08T14:21:08Z [load_day 2025-10-29] 2025-10-29 hour 18: 153026 events in 0 files, snapshot none (task 3971 ms: download 2233 ms overlapping gunzip 571 ms, parse 1708 ms, sort 0 ms, write 0 ms, index 722 ms: 4 candidates, 80113 repo-hours, 549 releases; waiting 561 ms; commit 0 ms)
2026-11-08T14:21:08Z [load_day 2025-10-29] 2025-10-29 hour 19: 147744 events in 0 files, snapshot none (task 3554 ms: download 2336 ms overlapping gunzip 492 ms, parse 1501 ms, sort 0 ms, write 0 ms, index 562 ms: 5 candidates, 70100 repo-hours, 544 releases; waiting 685 ms; commit 0 ms)
2026-11-08T14:21:12Z [load_day 2025-10-29] 2025-10-29 hour 20: 142721 events in 0 files, snapshot none (task 4150 ms: download 1971 ms overlapping gunzip 595 ms, parse 1807 ms, sort 0 ms, write 0 ms, index 870 ms: 3 candidates, 69629 repo-hours, 573 releases; waiting 572 ms; commit 0 ms)
2026-11-08T14:21:12Z [load_day 2025-10-29] 2025-10-29 hour 21: 148593 events in 0 files, snapshot none (task 4537 ms: download 2613 ms overlapping gunzip 628 ms, parse 1982 ms, sort 0 ms, write 0 ms, index 680 ms: 2 candidates, 67498 repo-hours, 749 releases; waiting 668 ms; commit 0 ms)
2026-11-08T14:21:17Z [load_day 2025-10-29] 2025-10-29 hour 22: 145126 events in 0 files, snapshot none (task 4041 ms: download 2035 ms overlapping gunzip 631 ms, parse 1945 ms, sort 0 ms, write 0 ms, index 724 ms: 5 candidates, 63519 repo-hours, 651 releases; waiting 460 ms; commit 0 ms)
2026-11-08T14:21:17Z [load_day 2025-10-29] 2025-10-29 hour 23: 138789 events in 0 files, snapshot none (task 4176 ms: download 2479 ms overlapping gunzip 536 ms, parse 1943 ms, sort 0 ms, write 0 ms, index 526 ms: 9 candidates, 62553 repo-hours, 646 releases; waiting 868 ms; commit 0 ms)
2026-11-08T14:21:26Z [load_day 2025-10-29] 2025-10-29: repo_hour merged from 24 files to 1 (1754353 rows, 8754 ms)
2026-11-08T14:21:29Z [load_day 2025-10-29] 2025-10-29: index committed in 11578 ms (24 + 1 + 24 files)
2026-11-08T14:21:29Z [load_day 2025-10-29] 2025-10-29: 3539503 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:21:29Z [load_day 2025-10-29] attempt 1 succeeded