orcaLog in

Runs · run 3951

load_day 2025-05-27, attempt 1 succeeded

Host
73ccef5e07c2:312543
Started
2026-11-08T12:09:52Z
Ended
2026-11-08T12:11:39Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
688 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
141.3 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3951/load_day/2025-05-27/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:09:52Z [load_day 2025-05-27] attempt 1 started
2026-11-08T12:09:53Z [load_day 2025-05-27] 2025-05-27: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:09:59Z [load_day 2025-05-27] 2025-05-27 hour 0: 145819 events in 0 files, snapshot none (task 5387 ms: download 2833 ms overlapping gunzip 826 ms, parse 3196 ms, sort 0 ms, write 0 ms, index 636 ms: 5 candidates, 75779 repo-hours, 944 releases; waiting 430 ms; commit 0 ms)
2026-11-08T12:09:59Z [load_day 2025-05-27] 2025-05-27 hour 1: 152398 events in 0 files, snapshot none (task 5265 ms: download 2963 ms overlapping gunzip 735 ms, parse 3209 ms, sort 0 ms, write 0 ms, index 668 ms: 5 candidates, 91507 repo-hours, 715 releases; waiting 227 ms; commit 0 ms)
2026-11-08T12:10:06Z [load_day 2025-05-27] 2025-05-27 hour 2: 147202 events in 0 files, snapshot none (task 6481 ms: download 4608 ms overlapping gunzip 637 ms, parse 2671 ms, sort 0 ms, write 0 ms, index 569 ms: 6 candidates, 74634 repo-hours, 772 releases; waiting 2089 ms; commit 0 ms)
2026-11-08T12:10:06Z [load_day 2025-05-27] 2025-05-27 hour 3: 144421 events in 0 files, snapshot none (task 4725 ms: download 2370 ms overlapping gunzip 624 ms, parse 2569 ms, sort 0 ms, write 0 ms, index 622 ms: 4 candidates, 69759 repo-hours, 1945 releases; waiting 496 ms; commit 0 ms)
2026-11-08T12:10:11Z [load_day 2025-05-27] 2025-05-27 hour 4: 145384 events in 0 files, snapshot none (task 4696 ms: download 2878 ms overlapping gunzip 587 ms, parse 2615 ms, sort 0 ms, write 0 ms, index 615 ms: 8 candidates, 65909 repo-hours, 713 releases; waiting 458 ms; commit 0 ms)
2026-11-08T12:10:12Z [load_day 2025-05-27] 2025-05-27 hour 5: 148079 events in 0 files, snapshot none (task 5575 ms: download 3561 ms overlapping gunzip 740 ms, parse 2935 ms, sort 0 ms, write 0 ms, index 562 ms: 6 candidates, 67140 repo-hours, 640 releases; waiting 1048 ms; commit 0 ms)
2026-11-08T12:10:19Z [load_day 2025-05-27] 2025-05-27 hour 6: 151986 events in 0 files, snapshot none (task 7268 ms: download 4477 ms overlapping gunzip 1102 ms, parse 4707 ms, sort 0 ms, write 0 ms, index 581 ms: 12 candidates, 79807 repo-hours, 781 releases; waiting 571 ms; commit 0 ms)
2026-11-08T12:10:19Z [load_day 2025-05-27] 2025-05-27 hour 7: 159342 events in 0 files, snapshot none (task 7236 ms: download 4640 ms overlapping gunzip 1101 ms, parse 4676 ms, sort 0 ms, write 0 ms, index 632 ms: 10 candidates, 79402 repo-hours, 727 releases; waiting 484 ms; commit 0 ms)
2026-11-08T12:10:28Z [load_day 2025-05-27] 2025-05-27 hour 8: 158004 events in 0 files, snapshot none (task 8773 ms: download 4577 ms overlapping gunzip 1347 ms, parse 5632 ms, sort 0 ms, write 0 ms, index 1274 ms: 4 candidates, 81020 repo-hours, 813 releases; waiting 197 ms; commit 0 ms)
2026-11-08T12:10:29Z [load_day 2025-05-27] 2025-05-27 hour 9: 160661 events in 0 files, snapshot none (task 8607 ms: download 4844 ms overlapping gunzip 1350 ms, parse 5488 ms, sort 0 ms, write 0 ms, index 856 ms: 8 candidates, 82769 repo-hours, 970 releases; waiting 624 ms; commit 0 ms)
2026-11-08T12:10:38Z [load_day 2025-05-27] 2025-05-27 hour 10: 156008 events in 0 files, snapshot none (task 7861 ms: download 4706 ms overlapping gunzip 1190 ms, parse 5286 ms, sort 0 ms, write 0 ms, index 621 ms: 8 candidates, 80136 repo-hours, 842 releases; waiting 515 ms; commit 0 ms)
2026-11-08T12:10:38Z [load_day 2025-05-27] 2025-05-27 hour 11: 163049 events in 0 files, snapshot none (task 7568 ms: download 4542 ms overlapping gunzip 1141 ms, parse 4873 ms, sort 0 ms, write 0 ms, index 623 ms: 5 candidates, 79070 repo-hours, 892 releases; waiting 534 ms; commit 0 ms)
2026-11-08T12:10:46Z [load_day 2025-05-27] 2025-05-27 hour 12: 168609 events in 0 files, snapshot none (task 7548 ms: download 4525 ms overlapping gunzip 1126 ms, parse 4726 ms, sort 0 ms, write 0 ms, index 856 ms: 9 candidates, 100790 repo-hours, 924 releases; waiting 489 ms; commit 0 ms)
2026-11-08T12:10:46Z [load_day 2025-05-27] 2025-05-27 hour 13: 162791 events in 0 files, snapshot none (task 7778 ms: download 5113 ms overlapping gunzip 1181 ms, parse 4991 ms, sort 0 ms, write 0 ms, index 699 ms: 10 candidates, 93148 repo-hours, 873 releases; waiting 521 ms; commit 0 ms)
2026-11-08T12:10:53Z [load_day 2025-05-27] 2025-05-27 hour 14: 161595 events in 0 files, snapshot none (task 6959 ms: download 4226 ms overlapping gunzip 1085 ms, parse 4632 ms, sort 0 ms, write 0 ms, index 751 ms: 4 candidates, 88156 repo-hours, 1062 releases; waiting 187 ms; commit 0 ms)
2026-11-08T12:10:54Z [load_day 2025-05-27] 2025-05-27 hour 15: 163141 events in 0 files, snapshot none (task 7464 ms: download 4601 ms overlapping gunzip 1122 ms, parse 4688 ms, sort 0 ms, write 0 ms, index 845 ms: 9 candidates, 87594 repo-hours, 1146 releases; waiting 495 ms; commit 0 ms)
2026-11-08T12:11:00Z [load_day 2025-05-27] 2025-05-27 hour 16: 163396 events in 0 files, snapshot none (task 6610 ms: download 3881 ms overlapping gunzip 961 ms, parse 3946 ms, sort 0 ms, write 0 ms, index 759 ms: 4 candidates, 83191 repo-hours, 885 releases; waiting 622 ms; commit 0 ms)
2026-11-08T12:11:01Z [load_day 2025-05-27] 2025-05-27 hour 17: 165159 events in 0 files, snapshot none (task 6743 ms: download 4110 ms overlapping gunzip 1014 ms, parse 4226 ms, sort 0 ms, write 0 ms, index 680 ms: 9 candidates, 82822 repo-hours, 880 releases; waiting 525 ms; commit 0 ms)
2026-11-08T12:11:07Z [load_day 2025-05-27] 2025-05-27 hour 18: 137272 events in 0 files, snapshot none (task 6454 ms: download 3933 ms overlapping gunzip 799 ms, parse 3198 ms, sort 0 ms, write 0 ms, index 626 ms: 8 candidates, 75591 repo-hours, 777 releases; waiting 1454 ms; commit 0 ms)
2026-11-08T12:11:07Z [load_day 2025-05-27] 2025-05-27 hour 19: 137899 events in 0 files, snapshot none (task 5628 ms: download 2886 ms overlapping gunzip 852 ms, parse 3408 ms, sort 0 ms, write 0 ms, index 713 ms: 16 candidates, 67331 repo-hours, 840 releases; waiting 358 ms; commit 0 ms)
2026-11-08T12:11:14Z [load_day 2025-05-27] 2025-05-27 hour 20: 132368 events in 0 files, snapshot none (task 5859 ms: download 3389 ms overlapping gunzip 943 ms, parse 3842 ms, sort 0 ms, write 0 ms, index 619 ms: 22 candidates, 68170 repo-hours, 746 releases; waiting 229 ms; commit 0 ms)
2026-11-08T12:11:14Z [load_day 2025-05-27] 2025-05-27 hour 21: 133986 events in 0 files, snapshot none (task 6056 ms: download 3065 ms overlapping gunzip 845 ms, parse 3702 ms, sort 0 ms, write 0 ms, index 603 ms: 14 candidates, 63852 repo-hours, 805 releases; waiting 527 ms; commit 0 ms)
2026-11-08T12:11:21Z [load_day 2025-05-27] 2025-05-27 hour 22: 133015 events in 0 files, snapshot none (task 6230 ms: download 4004 ms overlapping gunzip 985 ms, parse 4007 ms, sort 0 ms, write 0 ms, index 427 ms: 9 candidates, 60428 repo-hours, 833 releases; waiting 488 ms; commit 0 ms)
2026-11-08T12:11:21Z [load_day 2025-05-27] 2025-05-27 hour 23: 128137 events in 0 files, snapshot none (task 5742 ms: download 3297 ms overlapping gunzip 878 ms, parse 3711 ms, sort 0 ms, write 0 ms, index 482 ms: 11 candidates, 57748 repo-hours, 690 releases; waiting 398 ms; commit 0 ms)
2026-11-08T12:11:32Z [load_day 2025-05-27] 2025-05-27: repo_hour merged from 24 files to 1 (1855753 rows, 10839 ms)
2026-11-08T12:11:39Z [load_day 2025-05-27] 2025-05-27: index committed in 18087 ms (24 + 1 + 24 files)
2026-11-08T12:11:39Z [load_day 2025-05-27] 2025-05-27: 3619721 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:11:39Z [load_day 2025-05-27] attempt 1 succeeded