orcaLog in

Runs · run 4398

load_day 2025-09-17, attempt 1 succeeded

Host
73ccef5e07c2:379795
Started
2026-11-08T13:52:06Z
Ended
2026-11-08T13:53:54Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
692 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
152.5 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4398/load_day/2025-09-17/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:52:06Z [load_day 2025-09-17] attempt 1 started
2026-11-08T13:52:07Z [load_day 2025-09-17] 2025-09-17: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:52:14Z [load_day 2025-09-17] 2025-09-17 hour 0: 151522 events in 0 files, snapshot none (task 6870 ms: download 4262 ms overlapping gunzip 1088 ms, parse 4490 ms, sort 0 ms, write 0 ms, index 562 ms: 8 candidates, 79017 repo-hours, 980 releases; waiting 510 ms; commit 0 ms)
2026-11-08T13:52:14Z [load_day 2025-09-17] 2025-09-17 hour 1: 161081 events in 0 files, snapshot none (task 7206 ms: download 4282 ms overlapping gunzip 1090 ms, parse 4460 ms, sort 0 ms, write 0 ms, index 678 ms: 12 candidates, 95387 repo-hours, 790 releases; waiting 543 ms; commit 0 ms)
2026-11-08T13:52:22Z [load_day 2025-09-17] 2025-09-17 hour 2: 150282 events in 0 files, snapshot none (task 7263 ms: download 4377 ms overlapping gunzip 1115 ms, parse 4635 ms, sort 0 ms, write 0 ms, index 753 ms: 11 candidates, 76153 repo-hours, 812 releases; waiting 465 ms; commit 0 ms)
2026-11-08T13:52:23Z [load_day 2025-09-17] 2025-09-17 hour 3: 156487 events in 0 files, snapshot none (task 7620 ms: download 5063 ms overlapping gunzip 975 ms, parse 4365 ms, sort 0 ms, write 0 ms, index 599 ms: 10 candidates, 72037 repo-hours, 1924 releases; waiting 1431 ms; commit 0 ms)
2026-11-08T13:52:31Z [load_day 2025-09-17] 2025-09-17 hour 4: 150743 events in 0 files, snapshot none (task 8439 ms: download 4524 ms overlapping gunzip 1293 ms, parse 5541 ms, sort 0 ms, write 0 ms, index 736 ms: 7 candidates, 66698 repo-hours, 710 releases; waiting 594 ms; commit 0 ms)
2026-11-08T13:52:31Z [load_day 2025-09-17] 2025-09-17 hour 5: 151240 events in 0 files, snapshot none (task 8302 ms: download 5159 ms overlapping gunzip 1377 ms, parse 5510 ms, sort 0 ms, write 0 ms, index 680 ms: 5 candidates, 67667 repo-hours, 661 releases; waiting 489 ms; commit 0 ms)
2026-11-08T13:52:39Z [load_day 2025-09-17] 2025-09-17 hour 6: 157634 events in 0 files, snapshot none (task 7682 ms: download 4596 ms overlapping gunzip 1222 ms, parse 5031 ms, sort 0 ms, write 0 ms, index 650 ms: 7 candidates, 81592 repo-hours, 808 releases; waiting 520 ms; commit 0 ms)
2026-11-08T13:52:40Z [load_day 2025-09-17] 2025-09-17 hour 7: 162617 events in 0 files, snapshot none (task 7862 ms: download 5129 ms overlapping gunzip 1384 ms, parse 5327 ms, sort 0 ms, write 0 ms, index 641 ms: 4 candidates, 77119 repo-hours, 849 releases; waiting 246 ms; commit 0 ms)
2026-11-08T13:52:47Z [load_day 2025-09-17] 2025-09-17 hour 8: 160465 events in 0 files, snapshot none (task 7451 ms: download 4060 ms overlapping gunzip 1120 ms, parse 4623 ms, sort 0 ms, write 0 ms, index 808 ms: 5 candidates, 81575 repo-hours, 809 releases; waiting 570 ms; commit 0 ms)
2026-11-08T13:52:48Z [load_day 2025-09-17] 2025-09-17 hour 9: 162390 events in 0 files, snapshot none (task 7909 ms: download 4999 ms overlapping gunzip 1235 ms, parse 5173 ms, sort 0 ms, write 0 ms, index 743 ms: 8 candidates, 81639 repo-hours, 886 releases; waiting 514 ms; commit 0 ms)
2026-11-08T13:52:54Z [load_day 2025-09-17] 2025-09-17 hour 10: 158881 events in 0 files, snapshot none (task 6568 ms: download 3383 ms overlapping gunzip 1038 ms, parse 4316 ms, sort 0 ms, write 0 ms, index 718 ms: 5 candidates, 79444 repo-hours, 822 releases; waiting 305 ms; commit 0 ms)
2026-11-08T13:52:57Z [load_day 2025-09-17] 2025-09-17 hour 11: 167455 events in 0 files, snapshot none (task 7983 ms: download 5082 ms overlapping gunzip 1302 ms, parse 5065 ms, sort 0 ms, write 0 ms, index 807 ms: 4 candidates, 77846 repo-hours, 702 releases; waiting 584 ms; commit 0 ms)
2026-11-08T13:53:02Z [load_day 2025-09-17] 2025-09-17 hour 12: 164468 events in 0 files, snapshot none (task 6989 ms: download 3447 ms overlapping gunzip 909 ms, parse 3603 ms, sort 0 ms, write 0 ms, index 1701 ms: 10 candidates, 95650 repo-hours, 795 releases; waiting 548 ms; commit 0 ms)
2026-11-08T13:53:05Z [load_day 2025-09-17] 2025-09-17 hour 13: 166248 events in 0 files, snapshot none (task 7407 ms: download 4579 ms overlapping gunzip 1094 ms, parse 4606 ms, sort 0 ms, write 0 ms, index 816 ms: 12 candidates, 92294 repo-hours, 730 releases; waiting 569 ms; commit 0 ms)
2026-11-08T13:53:10Z [load_day 2025-09-17] 2025-09-17 hour 14: 167489 events in 0 files, snapshot none (task 7628 ms: download 4165 ms overlapping gunzip 1107 ms, parse 4736 ms, sort 0 ms, write 0 ms, index 800 ms: 12 candidates, 86255 repo-hours, 869 releases; waiting 577 ms; commit 0 ms)
2026-11-08T13:53:12Z [load_day 2025-09-17] 2025-09-17 hour 15: 164002 events in 0 files, snapshot none (task 7331 ms: download 4339 ms overlapping gunzip 1081 ms, parse 4504 ms, sort 0 ms, write 0 ms, index 857 ms: 8 candidates, 85864 repo-hours, 919 releases; waiting 516 ms; commit 0 ms)
2026-11-08T13:53:17Z [load_day 2025-09-17] 2025-09-17 hour 16: 165408 events in 0 files, snapshot none (task 6899 ms: download 3371 ms overlapping gunzip 1043 ms, parse 4134 ms, sort 0 ms, write 0 ms, index 900 ms: 7 candidates, 84737 repo-hours, 992 releases; waiting 554 ms; commit 0 ms)
2026-11-08T13:53:20Z [load_day 2025-09-17] 2025-09-17 hour 17: 164514 events in 0 files, snapshot none (task 7235 ms: download 4193 ms overlapping gunzip 1069 ms, parse 4418 ms, sort 0 ms, write 0 ms, index 945 ms: 7 candidates, 79407 repo-hours, 786 releases; waiting 515 ms; commit 0 ms)
2026-11-08T13:53:25Z [load_day 2025-09-17] 2025-09-17 hour 18: 166606 events in 0 files, snapshot none (task 7006 ms: download 3942 ms overlapping gunzip 1062 ms, parse 4173 ms, sort 0 ms, write 0 ms, index 999 ms: 6 candidates, 88259 repo-hours, 866 releases; waiting 492 ms; commit 0 ms)
2026-11-08T13:53:28Z [load_day 2025-09-17] 2025-09-17 hour 19: 161046 events in 0 files, snapshot none (task 6729 ms: download 4167 ms overlapping gunzip 1072 ms, parse 4082 ms, sort 0 ms, write 0 ms, index 769 ms: 14 candidates, 74265 repo-hours, 766 releases; waiting 527 ms; commit 0 ms)
2026-11-08T13:53:31Z [load_day 2025-09-17] 2025-09-17 hour 20: 154427 events in 0 files, snapshot none (task 5877 ms: download 3543 ms overlapping gunzip 913 ms, parse 3638 ms, sort 0 ms, write 0 ms, index 547 ms: 12 candidates, 71338 repo-hours, 774 releases; waiting 526 ms; commit 0 ms)
2026-11-08T13:53:35Z [load_day 2025-09-17] 2025-09-17 hour 21: 150702 events in 0 files, snapshot none (task 7072 ms: download 4610 ms overlapping gunzip 905 ms, parse 3711 ms, sort 0 ms, write 0 ms, index 529 ms: 11 candidates, 67384 repo-hours, 762 releases; waiting 1603 ms; commit 0 ms)
2026-11-08T13:53:37Z [load_day 2025-09-17] 2025-09-17 hour 22: 152167 events in 0 files, snapshot none (task 5341 ms: download 3143 ms overlapping gunzip 858 ms, parse 3413 ms, sort 0 ms, write 0 ms, index 449 ms: 6 candidates, 62958 repo-hours, 886 releases; waiting 384 ms; commit 0 ms)
2026-11-08T13:53:41Z [load_day 2025-09-17] 2025-09-17 hour 23: 144294 events in 0 files, snapshot none (task 5326 ms: download 3914 ms overlapping gunzip 698 ms, parse 2849 ms, sort 0 ms, write 0 ms, index 420 ms: 5 candidates, 59498 repo-hours, 671 releases; waiting 1120 ms; commit 0 ms)
2026-11-08T13:53:51Z [load_day 2025-09-17] 2025-09-17: repo_hour merged from 24 files to 1 (1884083 rows, 9729 ms)
2026-11-08T13:53:54Z [load_day 2025-09-17] 2025-09-17: index committed in 13073 ms (24 + 1 + 24 files)
2026-11-08T13:53:54Z [load_day 2025-09-17] 2025-09-17: 3812168 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:53:54Z [load_day 2025-09-17] attempt 1 succeeded