orcaLog in

Runs · run 4384

load_day 2025-09-13, attempt 1 succeeded

Host
73ccef5e07c2:377891
Started
2026-11-08T13:48:50Z
Ended
2026-11-08T13:50:21Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
645 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
126.3 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4384/load_day/2025-09-13/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:48:50Z [load_day 2025-09-13] attempt 1 started
2026-11-08T13:48:51Z [load_day 2025-09-13] 2025-09-13: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:48:57Z [load_day 2025-09-13] 2025-09-13 hour 0: 143363 events in 0 files, snapshot none (task 5634 ms: download 2913 ms overlapping gunzip 764 ms, parse 3219 ms, sort 0 ms, write 0 ms, index 922 ms: 5 candidates, 75423 repo-hours, 1076 releases; waiting 484 ms; commit 0 ms)
2026-11-08T13:48:57Z [load_day 2025-09-13] 2025-09-13 hour 1: 150907 events in 0 files, snapshot none (task 5303 ms: download 2337 ms overlapping gunzip 722 ms, parse 2965 ms, sort 0 ms, write 0 ms, index 883 ms: 8 candidates, 86493 repo-hours, 863 releases; waiting 209 ms; commit 0 ms)
2026-11-08T13:49:03Z [load_day 2025-09-13] 2025-09-13 hour 2: 140111 events in 0 files, snapshot none (task 5900 ms: download 3525 ms overlapping gunzip 921 ms, parse 3710 ms, sort 0 ms, write 0 ms, index 497 ms: 8 candidates, 63794 repo-hours, 859 releases; waiting 466 ms; commit 0 ms)
2026-11-08T13:49:03Z [load_day 2025-09-13] 2025-09-13 hour 3: 148355 events in 0 files, snapshot none (task 5573 ms: download 3174 ms overlapping gunzip 818 ms, parse 3408 ms, sort 0 ms, write 0 ms, index 472 ms: 5 candidates, 61796 repo-hours, 2127 releases; waiting 515 ms; commit 0 ms)
2026-11-08T13:49:09Z [load_day 2025-09-13] 2025-09-13 hour 4: 140974 events in 0 files, snapshot none (task 5539 ms: download 3061 ms overlapping gunzip 886 ms, parse 3339 ms, sort 0 ms, write 0 ms, index 460 ms: 6 candidates, 55592 repo-hours, 603 releases; waiting 510 ms; commit 0 ms)
2026-11-08T13:49:10Z [load_day 2025-09-13] 2025-09-13 hour 5: 145544 events in 0 files, snapshot none (task 5984 ms: download 3488 ms overlapping gunzip 932 ms, parse 3814 ms, sort 0 ms, write 0 ms, index 462 ms: 4 candidates, 59086 repo-hours, 592 releases; waiting 470 ms; commit 0 ms)
2026-11-08T13:49:18Z [load_day 2025-09-13] 2025-09-13 hour 6: 150073 events in 0 files, snapshot none (task 7721 ms: download 4034 ms overlapping gunzip 1289 ms, parse 4808 ms, sort 0 ms, write 0 ms, index 839 ms: 1 candidates, 69403 repo-hours, 795 releases; waiting 527 ms; commit 0 ms)
2026-11-08T13:49:18Z [load_day 2025-09-13] 2025-09-13 hour 7: 148546 events in 0 files, snapshot none (task 7671 ms: download 4570 ms overlapping gunzip 1235 ms, parse 5033 ms, sort 0 ms, write 0 ms, index 539 ms: 3 candidates, 61311 repo-hours, 689 releases; waiting 546 ms; commit 0 ms)
2026-11-08T13:49:25Z [load_day 2025-09-13] 2025-09-13 hour 8: 151675 events in 0 files, snapshot none (task 7189 ms: download 3699 ms overlapping gunzip 1114 ms, parse 4449 ms, sort 0 ms, write 0 ms, index 827 ms: 6 candidates, 66769 repo-hours, 700 releases; waiting 529 ms; commit 0 ms)
2026-11-08T13:49:26Z [load_day 2025-09-13] 2025-09-13 hour 9: 152252 events in 0 files, snapshot none (task 7075 ms: download 3500 ms overlapping gunzip 1197 ms, parse 4757 ms, sort 0 ms, write 0 ms, index 630 ms: 5 candidates, 65051 repo-hours, 874 releases; waiting 191 ms; commit 0 ms)
2026-11-08T13:49:32Z [load_day 2025-09-13] 2025-09-13 hour 10: 151985 events in 0 files, snapshot none (task 6205 ms: download 3144 ms overlapping gunzip 941 ms, parse 3597 ms, sort 0 ms, write 0 ms, index 557 ms: 3 candidates, 63808 repo-hours, 768 releases; waiting 824 ms; commit 0 ms)
2026-11-08T13:49:33Z [load_day 2025-09-13] 2025-09-13 hour 11: 157251 events in 0 files, snapshot none (task 6387 ms: download 3190 ms overlapping gunzip 977 ms, parse 4009 ms, sort 0 ms, write 0 ms, index 599 ms: 7 candidates, 64897 repo-hours, 614 releases; waiting 487 ms; commit 0 ms)
2026-11-08T13:49:38Z [load_day 2025-09-13] 2025-09-13 hour 12: 166580 events in 0 files, snapshot none (task 5233 ms: download 2719 ms overlapping gunzip 755 ms, parse 3166 ms, sort 0 ms, write 0 ms, index 849 ms: 5 candidates, 94171 repo-hours, 688 releases; waiting 227 ms; commit 0 ms)
2026-11-08T13:49:39Z [load_day 2025-09-13] 2025-09-13 hour 13: 161352 events in 0 files, snapshot none (task 6184 ms: download 3331 ms overlapping gunzip 994 ms, parse 3769 ms, sort 0 ms, write 0 ms, index 773 ms: 8 candidates, 77022 repo-hours, 685 releases; waiting 328 ms; commit 0 ms)
2026-11-08T13:49:44Z [load_day 2025-09-13] 2025-09-13 hour 14: 158883 events in 0 files, snapshot none (task 5515 ms: download 2914 ms overlapping gunzip 875 ms, parse 3608 ms, sort 0 ms, write 0 ms, index 598 ms: 8 candidates, 69878 repo-hours, 709 releases; waiting 200 ms; commit 0 ms)
2026-11-08T13:49:46Z [load_day 2025-09-13] 2025-09-13 hour 15: 156424 events in 0 files, snapshot none (task 5676 ms: download 3702 ms overlapping gunzip 747 ms, parse 3118 ms, sort 0 ms, write 0 ms, index 696 ms: 7 candidates, 71015 repo-hours, 768 releases; waiting 814 ms; commit 0 ms)
2026-11-08T13:49:51Z [load_day 2025-09-13] 2025-09-13 hour 16: 163366 events in 0 files, snapshot none (task 6702 ms: download 3664 ms overlapping gunzip 1100 ms, parse 4086 ms, sort 0 ms, write 0 ms, index 603 ms: 2 candidates, 71634 repo-hours, 674 releases; waiting 588 ms; commit 0 ms)
2026-11-08T13:49:53Z [load_day 2025-09-13] 2025-09-13 hour 17: 156341 events in 0 files, snapshot none (task 6630 ms: download 4213 ms overlapping gunzip 1049 ms, parse 4102 ms, sort 0 ms, write 0 ms, index 521 ms: 3 candidates, 66130 repo-hours, 698 releases; waiting 546 ms; commit 0 ms)
2026-11-08T13:49:58Z [load_day 2025-09-13] 2025-09-13 hour 18: 156928 events in 0 files, snapshot none (task 6344 ms: download 3515 ms overlapping gunzip 1016 ms, parse 3910 ms, sort 0 ms, write 0 ms, index 542 ms: 9 candidates, 72926 repo-hours, 689 releases; waiting 567 ms; commit 0 ms)
2026-11-08T13:49:59Z [load_day 2025-09-13] 2025-09-13 hour 19: 152127 events in 0 files, snapshot none (task 5503 ms: download 3260 ms overlapping gunzip 826 ms, parse 3511 ms, sort 0 ms, write 0 ms, index 440 ms: 3 candidates, 60731 repo-hours, 660 releases; waiting 495 ms; commit 0 ms)
2026-11-08T13:50:04Z [load_day 2025-09-13] 2025-09-13 hour 20: 147764 events in 0 files, snapshot none (task 5475 ms: download 3022 ms overlapping gunzip 741 ms, parse 3027 ms, sort 0 ms, write 0 ms, index 750 ms: 3 candidates, 58703 repo-hours, 639 releases; waiting 604 ms; commit 0 ms)
2026-11-08T13:50:06Z [load_day 2025-09-13] 2025-09-13 hour 21: 147475 events in 0 files, snapshot none (task 5935 ms: download 3931 ms overlapping gunzip 868 ms, parse 3515 ms, sort 0 ms, write 0 ms, index 459 ms: 9 candidates, 57927 repo-hours, 804 releases; waiting 747 ms; commit 0 ms)
2026-11-08T13:50:09Z [load_day 2025-09-13] 2025-09-13 hour 22: 141181 events in 0 files, snapshot none (task 4472 ms: download 3311 ms overlapping gunzip 592 ms, parse 2417 ms, sort 0 ms, write 0 ms, index 426 ms: 4 candidates, 54696 repo-hours, 738 releases; waiting 730 ms; commit 0 ms)
2026-11-08T13:50:11Z [load_day 2025-09-13] 2025-09-13 hour 23: 142491 events in 0 files, snapshot none (task 4738 ms: download 3310 ms overlapping gunzip 674 ms, parse 2627 ms, sort 0 ms, write 0 ms, index 366 ms: 4 candidates, 54353 repo-hours, 535 releases; waiting 756 ms; commit 0 ms)
2026-11-08T13:50:18Z [load_day 2025-09-13] 2025-09-13: repo_hour merged from 24 files to 1 (1602609 rows, 7251 ms)
2026-11-08T13:50:21Z [load_day 2025-09-13] 2025-09-13: index committed in 10244 ms (24 + 1 + 24 files)
2026-11-08T13:50:21Z [load_day 2025-09-13] 2025-09-13: 3631948 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:50:21Z [load_day 2025-09-13] attempt 1 succeeded