orcaLog in

Runs · run 4444

load_day 2025-09-27, attempt 1 succeeded

Host
73ccef5e07c2:385722
Started
2026-11-08T14:00:56Z
Ended
2026-11-08T14:02:30Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
648 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
121.6 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4444/load_day/2025-09-27/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:00:56Z [load_day 2025-09-27] attempt 1 started
2026-11-08T14:00:57Z [load_day 2025-09-27] 2025-09-27: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:01:05Z [load_day 2025-09-27] 2025-09-27 hour 0: 148666 events in 0 files, snapshot none (task 7166 ms: download 4493 ms overlapping gunzip 1006 ms, parse 3855 ms, sort 0 ms, write 0 ms, index 528 ms: 6 candidates, 73463 repo-hours, 1123 releases; waiting 1468 ms; commit 0 ms)
2026-11-08T14:01:05Z [load_day 2025-09-27] 2025-09-27 hour 1: 160243 events in 0 files, snapshot none (task 5309 ms: download 3415 ms overlapping gunzip 666 ms, parse 2850 ms, sort 0 ms, write 0 ms, index 965 ms: 5 candidates, 88562 repo-hours, 740 releases; waiting 504 ms; commit 0 ms)
2026-11-08T14:01:13Z [load_day 2025-09-27] 2025-09-27 hour 2: 143493 events in 0 files, snapshot none (task 7908 ms: download 4995 ms overlapping gunzip 901 ms, parse 3790 ms, sort 0 ms, write 0 ms, index 623 ms: 10 candidates, 65621 repo-hours, 698 releases; waiting 2179 ms; commit 0 ms)
2026-11-08T14:01:13Z [load_day 2025-09-27] 2025-09-27 hour 3: 147825 events in 0 files, snapshot none (task 6570 ms: download 3910 ms overlapping gunzip 855 ms, parse 3622 ms, sort 0 ms, write 0 ms, index 802 ms: 1 candidates, 58193 repo-hours, 1912 releases; waiting 972 ms; commit 0 ms)
2026-11-08T14:01:21Z [load_day 2025-09-27] 2025-09-27 hour 4: 145551 events in 0 files, snapshot none (task 7035 ms: download 3122 ms overlapping gunzip 1080 ms, parse 4489 ms, sort 0 ms, write 0 ms, index 858 ms: 7 candidates, 58084 repo-hours, 576 releases; waiting 203 ms; commit 0 ms)
2026-11-08T14:01:22Z [load_day 2025-09-27] 2025-09-27 hour 5: 148869 events in 0 files, snapshot none (task 7653 ms: download 3907 ms overlapping gunzip 1162 ms, parse 5071 ms, sort 0 ms, write 0 ms, index 623 ms: 4 candidates, 57496 repo-hours, 584 releases; waiting 498 ms; commit 0 ms)
2026-11-08T14:01:27Z [load_day 2025-09-27] 2025-09-27 hour 6: 154874 events in 0 files, snapshot none (task 4787 ms: download 3033 ms overlapping gunzip 619 ms, parse 2654 ms, sort 0 ms, write 0 ms, index 720 ms: 4 candidates, 69032 repo-hours, 747 releases; waiting 563 ms; commit 0 ms)
2026-11-08T14:01:27Z [load_day 2025-09-27] 2025-09-27 hour 7: 153149 events in 0 files, snapshot none (task 5182 ms: download 3121 ms overlapping gunzip 717 ms, parse 2838 ms, sort 0 ms, write 0 ms, index 589 ms: 9 candidates, 62135 repo-hours, 707 releases; waiting 624 ms; commit 0 ms)
2026-11-08T14:01:33Z [load_day 2025-09-27] 2025-09-27 hour 8: 153664 events in 0 files, snapshot none (task 5791 ms: download 3554 ms overlapping gunzip 880 ms, parse 3548 ms, sort 0 ms, write 0 ms, index 468 ms: 2 candidates, 64904 repo-hours, 757 releases; waiting 547 ms; commit 0 ms)
2026-11-08T14:01:34Z [load_day 2025-09-27] 2025-09-27 hour 9: 158451 events in 0 files, snapshot none (task 6075 ms: download 3921 ms overlapping gunzip 910 ms, parse 3785 ms, sort 0 ms, write 0 ms, index 538 ms: 8 candidates, 66826 repo-hours, 923 releases; waiting 503 ms; commit 0 ms)
2026-11-08T14:01:40Z [load_day 2025-09-27] 2025-09-27 hour 10: 156857 events in 0 files, snapshot none (task 6739 ms: download 3657 ms overlapping gunzip 993 ms, parse 4100 ms, sort 0 ms, write 0 ms, index 620 ms: 14 candidates, 68484 repo-hours, 779 releases; waiting 513 ms; commit 0 ms)
2026-11-08T14:01:40Z [load_day 2025-09-27] 2025-09-27 hour 11: 148854 events in 0 files, snapshot none (task 5779 ms: download 3150 ms overlapping gunzip 858 ms, parse 3658 ms, sort 0 ms, write 0 ms, index 498 ms: 9 candidates, 60455 repo-hours, 651 releases; waiting 528 ms; commit 0 ms)
2026-11-08T14:01:47Z [load_day 2025-09-27] 2025-09-27 hour 12: 167494 events in 0 files, snapshot none (task 6388 ms: download 3344 ms overlapping gunzip 861 ms, parse 3934 ms, sort 0 ms, write 0 ms, index 772 ms: 9 candidates, 92337 repo-hours, 685 releases; waiting 525 ms; commit 0 ms)
2026-11-08T14:01:47Z [load_day 2025-09-27] 2025-09-27 hour 13: 165160 events in 0 files, snapshot none (task 6377 ms: download 3604 ms overlapping gunzip 921 ms, parse 3951 ms, sort 0 ms, write 0 ms, index 742 ms: 10 candidates, 81788 repo-hours, 620 releases; waiting 491 ms; commit 0 ms)
2026-11-08T14:01:54Z [load_day 2025-09-27] 2025-09-27 hour 14: 158635 events in 0 files, snapshot none (task 5971 ms: download 3075 ms overlapping gunzip 806 ms, parse 3325 ms, sort 0 ms, write 0 ms, index 961 ms: 6 candidates, 69212 repo-hours, 659 releases; waiting 533 ms; commit 0 ms)
2026-11-08T14:01:54Z [load_day 2025-09-27] 2025-09-27 hour 15: 161203 events in 0 files, snapshot none (task 6002 ms: download 3115 ms overlapping gunzip 884 ms, parse 3608 ms, sort 0 ms, write 0 ms, index 677 ms: 3 candidates, 69888 repo-hours, 807 releases; waiting 515 ms; commit 0 ms)
2026-11-08T14:02:00Z [load_day 2025-09-27] 2025-09-27 hour 16: 160000 events in 0 files, snapshot none (task 5569 ms: download 2660 ms overlapping gunzip 752 ms, parse 2983 ms, sort 0 ms, write 0 ms, index 1140 ms: 5 candidates, 70474 repo-hours, 831 releases; waiting 398 ms; commit 0 ms)
2026-11-08T14:02:00Z [load_day 2025-09-27] 2025-09-27 hour 17: 158336 events in 0 files, snapshot none (task 5630 ms: download 3353 ms overlapping gunzip 768 ms, parse 3116 ms, sort 0 ms, write 0 ms, index 963 ms: 5 candidates, 67843 repo-hours, 796 releases; waiting 517 ms; commit 0 ms)
2026-11-08T14:02:07Z [load_day 2025-09-27] 2025-09-27 hour 18: 159918 events in 0 files, snapshot none (task 6335 ms: download 3498 ms overlapping gunzip 730 ms, parse 3080 ms, sort 0 ms, write 0 ms, index 974 ms: 7 candidates, 72525 repo-hours, 796 releases; waiting 1229 ms; commit 0 ms)
2026-11-08T14:02:07Z [load_day 2025-09-27] 2025-09-27 hour 19: 151517 events in 0 files, snapshot none (task 5102 ms: download 2894 ms overlapping gunzip 712 ms, parse 2878 ms, sort 0 ms, write 0 ms, index 525 ms: 7 candidates, 61578 repo-hours, 598 releases; waiting 600 ms; commit 0 ms)
2026-11-08T14:02:13Z [load_day 2025-09-27] 2025-09-27 hour 20: 153765 events in 0 files, snapshot none (task 5004 ms: download 2670 ms overlapping gunzip 754 ms, parse 3083 ms, sort 0 ms, write 0 ms, index 474 ms: 4 candidates, 62862 repo-hours, 671 releases; waiting 309 ms; commit 0 ms)
2026-11-08T14:02:13Z [load_day 2025-09-27] 2025-09-27 hour 21: 153495 events in 0 files, snapshot none (task 5091 ms: download 2653 ms overlapping gunzip 761 ms, parse 3135 ms, sort 0 ms, write 0 ms, index 487 ms: 8 candidates, 60650 repo-hours, 758 releases; waiting 344 ms; commit 0 ms)
2026-11-08T14:02:20Z [load_day 2025-09-27] 2025-09-27 hour 22: 145525 events in 0 files, snapshot none (task 5648 ms: download 3295 ms overlapping gunzip 874 ms, parse 3544 ms, sort 0 ms, write 0 ms, index 453 ms: 8 candidates, 53116 repo-hours, 757 releases; waiting 511 ms; commit 0 ms)
2026-11-08T14:02:20Z [load_day 2025-09-27] 2025-09-27 hour 23: 137777 events in 0 files, snapshot none (task 5230 ms: download 2925 ms overlapping gunzip 787 ms, parse 3222 ms, sort 0 ms, write 0 ms, index 445 ms: 4 candidates, 49667 repo-hours, 844 releases; waiting 476 ms; commit 0 ms)
2026-11-08T14:02:27Z [load_day 2025-09-27] 2025-09-27: repo_hour merged from 24 files to 1 (1605195 rows, 7814 ms)
2026-11-08T14:02:30Z [load_day 2025-09-27] 2025-09-27: index committed in 10625 ms (24 + 1 + 24 files)
2026-11-08T14:02:30Z [load_day 2025-09-27] 2025-09-27: 3693321 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:02:30Z [load_day 2025-09-27] attempt 1 succeeded