orcaLog in

Runs · run 4134

load_day 2025-07-11, attempt 1 succeeded

Host
73ccef5e07c2:340781
Started
2026-11-08T12:53:25Z
Ended
2026-11-08T12:55:02Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
696 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
139.4 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4134/load_day/2025-07-11/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:53:25Z [load_day 2025-07-11] attempt 1 started
2026-11-08T12:53:26Z [load_day 2025-07-11] 2025-07-11: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:53:33Z [load_day 2025-07-11] 2025-07-11 hour 0: 143860 events in 0 files, snapshot none (task 6587 ms: download 3425 ms overlapping gunzip 1048 ms, parse 4285 ms, sort 0 ms, write 0 ms, index 620 ms: 12 candidates, 69307 repo-hours, 1109 releases; waiting 293 ms; commit 0 ms)
2026-11-08T12:53:33Z [load_day 2025-07-11] 2025-07-11 hour 1: 151983 events in 0 files, snapshot none (task 6687 ms: download 3746 ms overlapping gunzip 996 ms, parse 4276 ms, sort 0 ms, write 0 ms, index 624 ms: 12 candidates, 88043 repo-hours, 687 releases; waiting 495 ms; commit 0 ms)
2026-11-08T12:53:41Z [load_day 2025-07-11] 2025-07-11 hour 2: 150284 events in 0 files, snapshot none (task 7027 ms: download 4129 ms overlapping gunzip 1133 ms, parse 4561 ms, sort 0 ms, write 0 ms, index 628 ms: 8 candidates, 75158 repo-hours, 826 releases; waiting 452 ms; commit 0 ms)
2026-11-08T12:53:41Z [load_day 2025-07-11] 2025-07-11 hour 3: 145483 events in 0 files, snapshot none (task 6802 ms: download 3083 ms overlapping gunzip 1085 ms, parse 4366 ms, sort 0 ms, write 0 ms, index 604 ms: 2 candidates, 67540 repo-hours, 912 releases; waiting 515 ms; commit 0 ms)
2026-11-08T12:53:47Z [load_day 2025-07-11] 2025-07-11 hour 4: 149202 events in 0 files, snapshot none (task 6005 ms: download 3570 ms overlapping gunzip 878 ms, parse 3626 ms, sort 0 ms, write 0 ms, index 661 ms: 3 candidates, 68984 repo-hours, 1933 releases; waiting 507 ms; commit 0 ms)
2026-11-08T12:53:48Z [load_day 2025-07-11] 2025-07-11 hour 5: 150387 events in 0 files, snapshot none (task 6468 ms: download 3452 ms overlapping gunzip 1056 ms, parse 4311 ms, sort 0 ms, write 0 ms, index 520 ms: 2 candidates, 66695 repo-hours, 730 releases; waiting 232 ms; commit 0 ms)
2026-11-08T12:53:55Z [load_day 2025-07-11] 2025-07-11 hour 6: 160366 events in 0 files, snapshot none (task 6891 ms: download 3517 ms overlapping gunzip 1072 ms, parse 4231 ms, sort 0 ms, write 0 ms, index 843 ms: 16 candidates, 81714 repo-hours, 866 releases; waiting 382 ms; commit 0 ms)
2026-11-08T12:53:55Z [load_day 2025-07-11] 2025-07-11 hour 7: 156090 events in 0 files, snapshot none (task 6798 ms: download 3599 ms overlapping gunzip 1035 ms, parse 4446 ms, sort 0 ms, write 0 ms, index 751 ms: 1 candidates, 73611 repo-hours, 800 releases; waiting 309 ms; commit 0 ms)
2026-11-08T12:54:01Z [load_day 2025-07-11] 2025-07-11 hour 8: 157452 events in 0 files, snapshot none (task 5840 ms: download 3353 ms overlapping gunzip 818 ms, parse 3398 ms, sort 0 ms, write 0 ms, index 657 ms: 6 candidates, 78016 repo-hours, 871 releases; waiting 690 ms; commit 0 ms)
2026-11-08T12:54:01Z [load_day 2025-07-11] 2025-07-11 hour 9: 161903 events in 0 files, snapshot none (task 5904 ms: download 3408 ms overlapping gunzip 872 ms, parse 3524 ms, sort 0 ms, write 0 ms, index 631 ms: 7 candidates, 79491 repo-hours, 860 releases; waiting 537 ms; commit 0 ms)
2026-11-08T12:54:08Z [load_day 2025-07-11] 2025-07-11 hour 10: 155631 events in 0 files, snapshot none (task 6167 ms: download 3639 ms overlapping gunzip 927 ms, parse 3831 ms, sort 0 ms, write 0 ms, index 641 ms: 7 candidates, 75936 repo-hours, 807 releases; waiting 530 ms; commit 0 ms)
2026-11-08T12:54:08Z [load_day 2025-07-11] 2025-07-11 hour 11: 150870 events in 0 files, snapshot none (task 5912 ms: download 3421 ms overlapping gunzip 841 ms, parse 3734 ms, sort 0 ms, write 0 ms, index 555 ms: 9 candidates, 70637 repo-hours, 759 releases; waiting 504 ms; commit 0 ms)
2026-11-08T12:54:14Z [load_day 2025-07-11] 2025-07-11 hour 12: 168186 events in 0 files, snapshot none (task 6054 ms: download 3214 ms overlapping gunzip 868 ms, parse 3697 ms, sort 0 ms, write 0 ms, index 732 ms: 12 candidates, 96578 repo-hours, 858 releases; waiting 388 ms; commit 0 ms)
2026-11-08T12:54:15Z [load_day 2025-07-11] 2025-07-11 hour 13: 163519 events in 0 files, snapshot none (task 6475 ms: download 3621 ms overlapping gunzip 882 ms, parse 3891 ms, sort 0 ms, write 0 ms, index 844 ms: 4 candidates, 89652 repo-hours, 818 releases; waiting 528 ms; commit 0 ms)
2026-11-08T12:54:22Z [load_day 2025-07-11] 2025-07-11 hour 14: 162358 events in 0 files, snapshot none (task 7092 ms: download 4558 ms overlapping gunzip 1128 ms, parse 4513 ms, sort 0 ms, write 0 ms, index 615 ms: 14 candidates, 81400 repo-hours, 867 releases; waiting 509 ms; commit 0 ms)
2026-11-08T12:54:22Z [load_day 2025-07-11] 2025-07-11 hour 15: 165703 events in 0 files, snapshot none (task 6589 ms: download 4240 ms overlapping gunzip 1024 ms, parse 4195 ms, sort 0 ms, write 0 ms, index 590 ms: 11 candidates, 82351 repo-hours, 926 releases; waiting 509 ms; commit 0 ms)
2026-11-08T12:54:29Z [load_day 2025-07-11] 2025-07-11 hour 16: 158592 events in 0 files, snapshot none (task 6947 ms: download 4176 ms overlapping gunzip 1098 ms, parse 4464 ms, sort 0 ms, write 0 ms, index 766 ms: 8 candidates, 78758 repo-hours, 874 releases; waiting 259 ms; commit 0 ms)
2026-11-08T12:54:29Z [load_day 2025-07-11] 2025-07-11 hour 17: 156269 events in 0 files, snapshot none (task 6996 ms: download 4456 ms overlapping gunzip 1053 ms, parse 4546 ms, sort 0 ms, write 0 ms, index 605 ms: 6 candidates, 72956 repo-hours, 761 releases; waiting 469 ms; commit 0 ms)
2026-11-08T12:54:37Z [load_day 2025-07-11] 2025-07-11 hour 18: 159695 events in 0 files, snapshot none (task 7388 ms: download 4683 ms overlapping gunzip 1085 ms, parse 4471 ms, sort 0 ms, write 0 ms, index 617 ms: 5 candidates, 78686 repo-hours, 818 releases; waiting 851 ms; commit 0 ms)
2026-11-08T12:54:37Z [load_day 2025-07-11] 2025-07-11 hour 19: 153543 events in 0 files, snapshot none (task 6727 ms: download 3355 ms overlapping gunzip 1009 ms, parse 4251 ms, sort 0 ms, write 0 ms, index 719 ms: 12 candidates, 67877 repo-hours, 727 releases; waiting 482 ms; commit 0 ms)
2026-11-08T12:54:45Z [load_day 2025-07-11] 2025-07-11 hour 20: 148224 events in 0 files, snapshot none (task 6710 ms: download 4179 ms overlapping gunzip 1082 ms, parse 4352 ms, sort 0 ms, write 0 ms, index 496 ms: 4 candidates, 66633 repo-hours, 650 releases; waiting 374 ms; commit 0 ms)
2026-11-08T12:54:45Z [load_day 2025-07-11] 2025-07-11 hour 21: 144570 events in 0 files, snapshot none (task 6474 ms: download 3930 ms overlapping gunzip 1053 ms, parse 4084 ms, sort 0 ms, write 0 ms, index 428 ms: 5 candidates, 62455 repo-hours, 750 releases; waiting 546 ms; commit 0 ms)
2026-11-08T12:54:51Z [load_day 2025-07-11] 2025-07-11 hour 22: 142560 events in 0 files, snapshot none (task 6444 ms: download 4191 ms overlapping gunzip 1023 ms, parse 4273 ms, sort 0 ms, write 0 ms, index 384 ms: 2 candidates, 56263 repo-hours, 835 releases; waiting 479 ms; commit 0 ms)
2026-11-08T12:54:51Z [load_day 2025-07-11] 2025-07-11 hour 23: 139993 events in 0 files, snapshot none (task 5624 ms: download 3297 ms overlapping gunzip 905 ms, parse 3530 ms, sort 0 ms, write 0 ms, index 453 ms: 3 candidates, 54583 repo-hours, 902 releases; waiting 497 ms; commit 0 ms)
2026-11-08T12:55:00Z [load_day 2025-07-11] 2025-07-11: repo_hour merged from 24 files to 1 (1783324 rows, 8118 ms)
2026-11-08T12:55:02Z [load_day 2025-07-11] 2025-07-11: index committed in 10840 ms (24 + 1 + 24 files)
2026-11-08T12:55:02Z [load_day 2025-07-11] 2025-07-11: 3696723 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:55:02Z [load_day 2025-07-11] attempt 1 succeeded