orcaLog in

Runs · run 4337

load_day 2025-08-31, attempt 1 succeeded

Host
73ccef5e07c2:370701
Started
2026-11-08T13:37:38Z
Ended
2026-11-08T13:39:01Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
661 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
118.6 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4337/load_day/2025-08-31/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:37:38Z [load_day 2025-08-31] attempt 1 started
2026-11-08T13:37:39Z [load_day 2025-08-31] 2025-08-31: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:37:45Z [load_day 2025-08-31] 2025-08-31 hour 0: 131826 events in 0 files, snapshot none (task 4992 ms: download 2301 ms overlapping gunzip 657 ms, parse 2902 ms, sort 0 ms, write 0 ms, index 650 ms: 6 candidates, 62464 repo-hours, 1121 releases; waiting 490 ms; commit 0 ms)
2026-11-08T13:37:45Z [load_day 2025-08-31] 2025-08-31 hour 1: 147320 events in 0 files, snapshot none (task 5108 ms: download 2351 ms overlapping gunzip 688 ms, parse 2938 ms, sort 0 ms, write 0 ms, index 861 ms: 4 candidates, 86337 repo-hours, 777 releases; waiting 388 ms; commit 0 ms)
2026-11-08T13:37:51Z [load_day 2025-08-31] 2025-08-31 hour 2: 127027 events in 0 files, snapshot none (task 5521 ms: download 2842 ms overlapping gunzip 733 ms, parse 3005 ms, sort 0 ms, write 0 ms, index 468 ms: 6 candidates, 57009 repo-hours, 866 releases; waiting 766 ms; commit 0 ms)
2026-11-08T13:37:51Z [load_day 2025-08-31] 2025-08-31 hour 3: 133394 events in 0 files, snapshot none (task 5936 ms: download 4407 ms overlapping gunzip 656 ms, parse 2814 ms, sort 0 ms, write 0 ms, index 410 ms: 3 candidates, 55057 repo-hours, 2269 releases; waiting 1785 ms; commit 0 ms)
2026-11-08T13:37:56Z [load_day 2025-08-31] 2025-08-31 hour 4: 135298 events in 0 files, snapshot none (task 4735 ms: download 2430 ms overlapping gunzip 702 ms, parse 2830 ms, sort 0 ms, write 0 ms, index 558 ms: 6 candidates, 51337 repo-hours, 655 releases; waiting 341 ms; commit 0 ms)
2026-11-08T13:37:56Z [load_day 2025-08-31] 2025-08-31 hour 5: 137953 events in 0 files, snapshot none (task 4726 ms: download 2688 ms overlapping gunzip 697 ms, parse 2789 ms, sort 0 ms, write 0 ms, index 454 ms: 3 candidates, 52758 repo-hours, 601 releases; waiting 534 ms; commit 0 ms)
2026-11-08T13:38:01Z [load_day 2025-08-31] 2025-08-31 hour 6: 141440 events in 0 files, snapshot none (task 4727 ms: download 2784 ms overlapping gunzip 687 ms, parse 2576 ms, sort 0 ms, write 0 ms, index 645 ms: 5 candidates, 63032 repo-hours, 696 releases; waiting 499 ms; commit 0 ms)
2026-11-08T13:38:02Z [load_day 2025-08-31] 2025-08-31 hour 7: 142704 events in 0 files, snapshot none (task 5101 ms: download 3419 ms overlapping gunzip 689 ms, parse 2774 ms, sort 0 ms, write 0 ms, index 644 ms: 6 candidates, 56713 repo-hours, 590 releases; waiting 752 ms; commit 0 ms)
2026-11-08T13:38:07Z [load_day 2025-08-31] 2025-08-31 hour 8: 147419 events in 0 files, snapshot none (task 4842 ms: download 2951 ms overlapping gunzip 679 ms, parse 2715 ms, sort 0 ms, write 0 ms, index 542 ms: 9 candidates, 61711 repo-hours, 692 releases; waiting 622 ms; commit 0 ms)
2026-11-08T13:38:08Z [load_day 2025-08-31] 2025-08-31 hour 9: 152823 events in 0 files, snapshot none (task 6244 ms: download 3314 ms overlapping gunzip 880 ms, parse 3515 ms, sort 0 ms, write 0 ms, index 1006 ms: 3 candidates, 65965 repo-hours, 710 releases; waiting 526 ms; commit 0 ms)
2026-11-08T13:38:13Z [load_day 2025-08-31] 2025-08-31 hour 10: 156147 events in 0 files, snapshot none (task 5530 ms: download 3153 ms overlapping gunzip 887 ms, parse 3181 ms, sort 0 ms, write 0 ms, index 741 ms: 4 candidates, 67019 repo-hours, 667 releases; waiting 347 ms; commit 0 ms)
2026-11-08T13:38:14Z [load_day 2025-08-31] 2025-08-31 hour 11: 151863 events in 0 files, snapshot none (task 5244 ms: download 3177 ms overlapping gunzip 773 ms, parse 2970 ms, sort 0 ms, write 0 ms, index 573 ms: 6 candidates, 62467 repo-hours, 610 releases; waiting 571 ms; commit 0 ms)
2026-11-08T13:38:19Z [load_day 2025-08-31] 2025-08-31 hour 12: 163040 events in 0 files, snapshot none (task 5344 ms: download 2936 ms overlapping gunzip 750 ms, parse 3170 ms, sort 0 ms, write 0 ms, index 656 ms: 9 candidates, 90357 repo-hours, 731 releases; waiting 517 ms; commit 0 ms)
2026-11-08T13:38:20Z [load_day 2025-08-31] 2025-08-31 hour 13: 160293 events in 0 files, snapshot none (task 5218 ms: download 2678 ms overlapping gunzip 737 ms, parse 3082 ms, sort 0 ms, write 0 ms, index 740 ms: 12 candidates, 79084 repo-hours, 682 releases; waiting 438 ms; commit 0 ms)
2026-11-08T13:38:24Z [load_day 2025-08-31] 2025-08-31 hour 14: 156792 events in 0 files, snapshot none (task 5055 ms: download 2966 ms overlapping gunzip 780 ms, parse 3214 ms, sort 0 ms, write 0 ms, index 520 ms: 7 candidates, 70504 repo-hours, 736 releases; waiting 302 ms; commit 0 ms)
2026-11-08T13:38:26Z [load_day 2025-08-31] 2025-08-31 hour 15: 152837 events in 0 files, snapshot none (task 4499 ms: download 2210 ms overlapping gunzip 614 ms, parse 2602 ms, sort 0 ms, write 0 ms, index 587 ms: 9 candidates, 68808 repo-hours, 846 releases; waiting 374 ms; commit 0 ms)
2026-11-08T13:38:30Z [load_day 2025-08-31] 2025-08-31 hour 16: 160211 events in 0 files, snapshot none (task 5479 ms: download 3730 ms overlapping gunzip 743 ms, parse 3076 ms, sort 0 ms, write 0 ms, index 532 ms: 10 candidates, 69870 repo-hours, 751 releases; waiting 901 ms; commit 0 ms)
2026-11-08T13:38:31Z [load_day 2025-08-31] 2025-08-31 hour 17: 156910 events in 0 files, snapshot none (task 5050 ms: download 3048 ms overlapping gunzip 727 ms, parse 2952 ms, sort 0 ms, write 0 ms, index 531 ms: 18 candidates, 66001 repo-hours, 669 releases; waiting 595 ms; commit 0 ms)
2026-11-08T13:38:36Z [load_day 2025-08-31] 2025-08-31 hour 18: 156031 events in 0 files, snapshot none (task 4821 ms: download 2909 ms overlapping gunzip 616 ms, parse 2615 ms, sort 0 ms, write 0 ms, index 642 ms: 4 candidates, 73157 repo-hours, 837 releases; waiting 530 ms; commit 0 ms)
2026-11-08T13:38:36Z [load_day 2025-08-31] 2025-08-31 hour 19: 145895 events in 0 files, snapshot none (task 4832 ms: download 3277 ms overlapping gunzip 647 ms, parse 2670 ms, sort 0 ms, write 0 ms, index 454 ms: 3 candidates, 57585 repo-hours, 661 releases; waiting 732 ms; commit 0 ms)
2026-11-08T13:38:43Z [load_day 2025-08-31] 2025-08-31 hour 20: 148316 events in 0 files, snapshot none (task 6874 ms: download 4503 ms overlapping gunzip 891 ms, parse 3637 ms, sort 0 ms, write 0 ms, index 498 ms: 3 candidates, 59368 repo-hours, 763 releases; waiting 1598 ms; commit 0 ms)
2026-11-08T13:38:43Z [load_day 2025-08-31] 2025-08-31 hour 21: 144618 events in 0 files, snapshot none (task 5577 ms: download 3662 ms overlapping gunzip 825 ms, parse 3386 ms, sort 0 ms, write 0 ms, index 430 ms: 5 candidates, 55469 repo-hours, 799 releases; waiting 647 ms; commit 0 ms)
2026-11-08T13:38:51Z [load_day 2025-08-31] 2025-08-31 hour 22: 137354 events in 0 files, snapshot none (task 7114 ms: download 4819 ms overlapping gunzip 755 ms, parse 3123 ms, sort 0 ms, write 0 ms, index 398 ms: 7 candidates, 50867 repo-hours, 790 releases; waiting 2597 ms; commit 0 ms)
2026-11-08T13:38:51Z [load_day 2025-08-31] 2025-08-31 hour 23: 136730 events in 0 files, snapshot none (task 7197 ms: download 4952 ms overlapping gunzip 745 ms, parse 3210 ms, sort 0 ms, write 0 ms, index 380 ms: 7 candidates, 49401 repo-hours, 630 releases; waiting 2560 ms; commit 0 ms)
2026-11-08T13:38:58Z [load_day 2025-08-31] 2025-08-31: repo_hour merged from 24 files to 1 (1532340 rows, 7377 ms)
2026-11-08T13:39:01Z [load_day 2025-08-31] 2025-08-31: index committed in 10457 ms (24 + 1 + 24 files)
2026-11-08T13:39:01Z [load_day 2025-08-31] 2025-08-31: 3524241 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:39:01Z [load_day 2025-08-31] attempt 1 succeeded