orcaLog in

Runs · run 4117

load_day 2025-07-06, attempt 1 succeeded

Host
73ccef5e07c2:338414
Started
2026-11-08T12:49:25Z
Ended
2026-11-08T12:50:46Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
645 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
109.4 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4117/load_day/2025-07-06/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:49:25Z [load_day 2025-07-06] attempt 1 started
2026-11-08T12:49:26Z [load_day 2025-07-06] 2025-07-06: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:49:32Z [load_day 2025-07-06] 2025-07-06 hour 0: 127377 events in 0 files, snapshot none (task 4980 ms: download 2829 ms overlapping gunzip 691 ms, parse 2953 ms, sort 0 ms, write 0 ms, index 441 ms: 6 candidates, 58123 repo-hours, 962 releases; waiting 510 ms; commit 0 ms)
2026-11-08T12:49:32Z [load_day 2025-07-06] 2025-07-06 hour 1: 140757 events in 0 files, snapshot none (task 5481 ms: download 2388 ms overlapping gunzip 691 ms, parse 3202 ms, sort 0 ms, write 0 ms, index 838 ms: 6 candidates, 82278 repo-hours, 573 releases; waiting 479 ms; commit 0 ms)
2026-11-08T12:49:37Z [load_day 2025-07-06] 2025-07-06 hour 2: 137175 events in 0 files, snapshot none (task 5165 ms: download 2221 ms overlapping gunzip 749 ms, parse 3064 ms, sort 0 ms, write 0 ms, index 771 ms: 2 candidates, 65795 repo-hours, 632 releases; waiting 273 ms; commit 0 ms)
2026-11-08T12:49:38Z [load_day 2025-07-06] 2025-07-06 hour 3: 132744 events in 0 files, snapshot none (task 4882 ms: download 2303 ms overlapping gunzip 674 ms, parse 2889 ms, sort 0 ms, write 0 ms, index 495 ms: 4 candidates, 57043 repo-hours, 963 releases; waiting 513 ms; commit 0 ms)
2026-11-08T12:49:43Z [load_day 2025-07-06] 2025-07-06 hour 4: 134241 events in 0 files, snapshot none (task 4949 ms: download 2371 ms overlapping gunzip 736 ms, parse 3031 ms, sort 0 ms, write 0 ms, index 436 ms: 6 candidates, 57762 repo-hours, 1599 releases; waiting 404 ms; commit 0 ms)
2026-11-08T12:49:44Z [load_day 2025-07-06] 2025-07-06 hour 5: 138925 events in 0 files, snapshot none (task 5682 ms: download 3646 ms overlapping gunzip 732 ms, parse 3127 ms, sort 0 ms, write 0 ms, index 376 ms: 2 candidates, 54462 repo-hours, 584 releases; waiting 1087 ms; commit 0 ms)
2026-11-08T12:49:48Z [load_day 2025-07-06] 2025-07-06 hour 6: 142041 events in 0 files, snapshot none (task 4282 ms: download 2048 ms overlapping gunzip 563 ms, parse 2530 ms, sort 0 ms, write 0 ms, index 558 ms: 4 candidates, 66936 repo-hours, 690 releases; waiting 302 ms; commit 0 ms)
2026-11-08T12:49:48Z [load_day 2025-07-06] 2025-07-06 hour 7: 142238 events in 0 files, snapshot none (task 4345 ms: download 2185 ms overlapping gunzip 588 ms, parse 2484 ms, sort 0 ms, write 0 ms, index 481 ms: 5 candidates, 58251 repo-hours, 621 releases; waiting 493 ms; commit 0 ms)
2026-11-08T12:49:54Z [load_day 2025-07-06] 2025-07-06 hour 8: 146602 events in 0 files, snapshot none (task 4489 ms: download 2784 ms overlapping gunzip 601 ms, parse 2460 ms, sort 0 ms, write 0 ms, index 446 ms: 6 candidates, 64502 repo-hours, 680 releases; waiting 695 ms; commit 0 ms)
2026-11-08T12:49:54Z [load_day 2025-07-06] 2025-07-06 hour 9: 146733 events in 0 files, snapshot none (task 4405 ms: download 2749 ms overlapping gunzip 603 ms, parse 2553 ms, sort 0 ms, write 0 ms, index 502 ms: 5 candidates, 65444 repo-hours, 764 releases; waiting 489 ms; commit 0 ms)
2026-11-08T12:49:58Z [load_day 2025-07-06] 2025-07-06 hour 10: 149255 events in 0 files, snapshot none (task 3987 ms: download 2214 ms overlapping gunzip 547 ms, parse 2310 ms, sort 0 ms, write 0 ms, index 506 ms: 7 candidates, 65971 repo-hours, 639 releases; waiting 348 ms; commit 0 ms)
2026-11-08T12:49:59Z [load_day 2025-07-06] 2025-07-06 hour 11: 145212 events in 0 files, snapshot none (task 4472 ms: download 3174 ms overlapping gunzip 547 ms, parse 2291 ms, sort 0 ms, write 0 ms, index 514 ms: 7 candidates, 63270 repo-hours, 624 releases; waiting 815 ms; commit 0 ms)
2026-11-08T12:50:04Z [load_day 2025-07-06] 2025-07-06 hour 12: 166472 events in 0 files, snapshot none (task 5548 ms: download 3442 ms overlapping gunzip 584 ms, parse 2558 ms, sort 0 ms, write 0 ms, index 1278 ms: 6 candidates, 92750 repo-hours, 656 releases; waiting 890 ms; commit 0 ms)
2026-11-08T12:50:05Z [load_day 2025-07-06] 2025-07-06 hour 13: 157786 events in 0 files, snapshot none (task 6107 ms: download 3590 ms overlapping gunzip 697 ms, parse 2891 ms, sort 0 ms, write 0 ms, index 648 ms: 9 candidates, 80099 repo-hours, 621 releases; waiting 1451 ms; commit 0 ms)
2026-11-08T12:50:11Z [load_day 2025-07-06] 2025-07-06 hour 14: 153052 events in 0 files, snapshot none (task 6619 ms: download 2738 ms overlapping gunzip 601 ms, parse 2555 ms, sort 0 ms, write 0 ms, index 2496 ms: 3 candidates, 71088 repo-hours, 699 releases; waiting 600 ms; commit 0 ms)
2026-11-08T12:50:12Z [load_day 2025-07-06] 2025-07-06 hour 15: 158047 events in 0 files, snapshot none (task 4876 ms: download 2968 ms overlapping gunzip 703 ms, parse 2888 ms, sort 0 ms, write 0 ms, index 614 ms: 12 candidates, 72424 repo-hours, 789 releases; waiting 312 ms; commit 0 ms)
2026-11-08T12:50:18Z [load_day 2025-07-06] 2025-07-06 hour 16: 153872 events in 0 files, snapshot none (task 5740 ms: download 3027 ms overlapping gunzip 741 ms, parse 3326 ms, sort 0 ms, write 0 ms, index 731 ms: 14 candidates, 70028 repo-hours, 664 releases; waiting 618 ms; commit 0 ms)
2026-11-08T12:50:18Z [load_day 2025-07-06] 2025-07-06 hour 17: 149799 events in 0 files, snapshot none (task 5637 ms: download 2881 ms overlapping gunzip 740 ms, parse 3291 ms, sort 0 ms, write 0 ms, index 766 ms: 12 candidates, 66941 repo-hours, 619 releases; waiting 518 ms; commit 0 ms)
2026-11-08T12:50:23Z [load_day 2025-07-06] 2025-07-06 hour 18: 159153 events in 0 files, snapshot none (task 5291 ms: download 1939 ms overlapping gunzip 723 ms, parse 3107 ms, sort 0 ms, write 0 ms, index 961 ms: 11 candidates, 74474 repo-hours, 787 releases; waiting 181 ms; commit 0 ms)
2026-11-08T12:50:24Z [load_day 2025-07-06] 2025-07-06 hour 19: 150370 events in 0 files, snapshot none (task 4942 ms: download 2082 ms overlapping gunzip 724 ms, parse 3131 ms, sort 0 ms, write 0 ms, index 563 ms: 35 candidates, 61778 repo-hours, 763 releases; waiting 224 ms; commit 0 ms)
2026-11-08T12:50:29Z [load_day 2025-07-06] 2025-07-06 hour 20: 146779 events in 0 files, snapshot none (task 4599 ms: download 2280 ms overlapping gunzip 665 ms, parse 2956 ms, sort 0 ms, write 0 ms, index 434 ms: 6 candidates, 62641 repo-hours, 727 releases; waiting 235 ms; commit 0 ms)
2026-11-08T12:50:29Z [load_day 2025-07-06] 2025-07-06 hour 21: 141665 events in 0 files, snapshot none (task 4513 ms: download 2619 ms overlapping gunzip 627 ms, parse 2667 ms, sort 0 ms, write 0 ms, index 428 ms: 13 candidates, 57674 repo-hours, 730 releases; waiting 545 ms; commit 0 ms)
2026-11-08T12:50:35Z [load_day 2025-07-06] 2025-07-06 hour 22: 140640 events in 0 files, snapshot none (task 5409 ms: download 2693 ms overlapping gunzip 821 ms, parse 3577 ms, sort 0 ms, write 0 ms, index 456 ms: 5 candidates, 55123 repo-hours, 715 releases; waiting 306 ms; commit 0 ms)
2026-11-08T12:50:35Z [load_day 2025-07-06] 2025-07-06 hour 23: 138735 events in 0 files, snapshot none (task 6022 ms: download 3240 ms overlapping gunzip 959 ms, parse 3966 ms, sort 0 ms, write 0 ms, index 403 ms: 3 candidates, 54047 repo-hours, 688 releases; waiting 456 ms; commit 0 ms)
2026-11-08T12:50:43Z [load_day 2025-07-06] 2025-07-06: repo_hour merged from 24 files to 1 (1578904 rows, 7555 ms)
2026-11-08T12:50:45Z [load_day 2025-07-06] 2025-07-06: index committed in 10256 ms (24 + 1 + 24 files)
2026-11-08T12:50:45Z [load_day 2025-07-06] 2025-07-06: 3499670 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:50:45Z [load_day 2025-07-06] attempt 1 succeeded