orcaLog in

Runs · run 4137

load_day 2025-07-12, attempt 1 succeeded

Host
73ccef5e07c2:341409
Started
2026-11-08T12:54:11Z
Ended
2026-11-08T12:55:39Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
634 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
112.0 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4137/load_day/2025-07-12/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:54:11Z [load_day 2025-07-12] attempt 1 started
2026-11-08T12:54:12Z [load_day 2025-07-12] 2025-07-12: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:54:19Z [load_day 2025-07-12] 2025-07-12 hour 0: 133304 events in 0 files, snapshot none (task 6043 ms: download 3231 ms overlapping gunzip 886 ms, parse 3695 ms, sort 0 ms, write 0 ms, index 584 ms: 5 candidates, 61007 repo-hours, 975 releases; waiting 554 ms; commit 0 ms)
2026-11-08T12:54:19Z [load_day 2025-07-12] 2025-07-12 hour 1: 148912 events in 0 files, snapshot none (task 6138 ms: download 3241 ms overlapping gunzip 808 ms, parse 3574 ms, sort 0 ms, write 0 ms, index 977 ms: 8 candidates, 85085 repo-hours, 619 releases; waiting 462 ms; commit 0 ms)
2026-11-08T12:54:27Z [load_day 2025-07-12] 2025-07-12 hour 2: 141547 events in 0 files, snapshot none (task 6113 ms: download 3334 ms overlapping gunzip 924 ms, parse 3951 ms, sort 0 ms, write 0 ms, index 510 ms: 2 candidates, 67675 repo-hours, 664 releases; waiting 494 ms; commit 0 ms)
2026-11-08T12:54:27Z [load_day 2025-07-12] 2025-07-12 hour 3: 140770 events in 0 files, snapshot none (task 5993 ms: download 3231 ms overlapping gunzip 843 ms, parse 3426 ms, sort 0 ms, write 0 ms, index 786 ms: 5 candidates, 63215 repo-hours, 1263 releases; waiting 649 ms; commit 0 ms)
2026-11-08T12:54:32Z [load_day 2025-07-12] 2025-07-12 hour 4: 134968 events in 0 files, snapshot none (task 4543 ms: download 2941 ms overlapping gunzip 568 ms, parse 2450 ms, sort 0 ms, write 0 ms, index 679 ms: 4 candidates, 56940 repo-hours, 1471 releases; waiting 609 ms; commit 0 ms)
2026-11-08T12:54:37Z [load_day 2025-07-12] 2025-07-12 hour 5: 142189 events in 0 files, snapshot none (task 8820 ms: download 5526 ms overlapping gunzip 883 ms, parse 3696 ms, sort 0 ms, write 0 ms, index 602 ms: 7 candidates, 58753 repo-hours, 611 releases; waiting 3336 ms; commit 0 ms)
2026-11-08T12:54:38Z [load_day 2025-07-12] 2025-07-12 hour 6: 143884 events in 0 files, snapshot none (task 5232 ms: download 2842 ms overlapping gunzip 767 ms, parse 3236 ms, sort 0 ms, write 0 ms, index 474 ms: 0 candidates, 66932 repo-hours, 770 releases; waiting 436 ms; commit 0 ms)
2026-11-08T12:54:43Z [load_day 2025-07-12] 2025-07-12 hour 7: 144279 events in 0 files, snapshot none (task 5932 ms: download 2499 ms overlapping gunzip 801 ms, parse 3545 ms, sort 0 ms, write 0 ms, index 684 ms: 4 candidates, 60509 repo-hours, 734 releases; waiting 521 ms; commit 0 ms)
2026-11-08T12:54:44Z [load_day 2025-07-12] 2025-07-12 hour 8: 144611 events in 0 files, snapshot none (task 5769 ms: download 3180 ms overlapping gunzip 864 ms, parse 3738 ms, sort 0 ms, write 0 ms, index 467 ms: 4 candidates, 63116 repo-hours, 786 releases; waiting 320 ms; commit 0 ms)
2026-11-08T12:54:49Z [load_day 2025-07-12] 2025-07-12 hour 9: 151887 events in 0 files, snapshot none (task 5806 ms: download 3318 ms overlapping gunzip 849 ms, parse 3239 ms, sort 0 ms, write 0 ms, index 791 ms: 6 candidates, 65777 repo-hours, 894 releases; waiting 600 ms; commit 0 ms)
2026-11-08T12:54:51Z [load_day 2025-07-12] 2025-07-12 hour 10: 148709 events in 0 files, snapshot none (task 5731 ms: download 3214 ms overlapping gunzip 859 ms, parse 3651 ms, sort 0 ms, write 0 ms, index 473 ms: 3 candidates, 64595 repo-hours, 800 releases; waiting 507 ms; commit 0 ms)
2026-11-08T12:54:54Z [load_day 2025-07-12] 2025-07-12 hour 11: 152223 events in 0 files, snapshot none (task 4235 ms: download 2633 ms overlapping gunzip 568 ms, parse 2408 ms, sort 0 ms, write 0 ms, index 525 ms: 6 candidates, 61972 repo-hours, 660 releases; waiting 501 ms; commit 0 ms)
2026-11-08T12:54:56Z [load_day 2025-07-12] 2025-07-12 hour 12: 160957 events in 0 files, snapshot none (task 4350 ms: download 2480 ms overlapping gunzip 529 ms, parse 2301 ms, sort 0 ms, write 0 ms, index 605 ms: 8 candidates, 89074 repo-hours, 703 releases; waiting 522 ms; commit 0 ms)
2026-11-08T12:54:59Z [load_day 2025-07-12] 2025-07-12 hour 13: 155982 events in 0 files, snapshot none (task 4193 ms: download 2327 ms overlapping gunzip 531 ms, parse 2312 ms, sort 0 ms, write 0 ms, index 562 ms: 8 candidates, 80114 repo-hours, 637 releases; waiting 500 ms; commit 0 ms)
2026-11-08T12:55:00Z [load_day 2025-07-12] 2025-07-12 hour 14: 150240 events in 0 files, snapshot none (task 4307 ms: download 2650 ms overlapping gunzip 549 ms, parse 2413 ms, sort 0 ms, write 0 ms, index 523 ms: 8 candidates, 67126 repo-hours, 720 releases; waiting 534 ms; commit 0 ms)
2026-11-08T12:55:04Z [load_day 2025-07-12] 2025-07-12 hour 15: 154907 events in 0 files, snapshot none (task 4377 ms: download 2375 ms overlapping gunzip 592 ms, parse 2540 ms, sort 0 ms, write 0 ms, index 613 ms: 6 candidates, 70569 repo-hours, 839 releases; waiting 269 ms; commit 0 ms)
2026-11-08T12:55:06Z [load_day 2025-07-12] 2025-07-12 hour 16: 149867 events in 0 files, snapshot none (task 5199 ms: download 3088 ms overlapping gunzip 598 ms, parse 2531 ms, sort 0 ms, write 0 ms, index 920 ms: 6 candidates, 67718 repo-hours, 818 releases; waiting 859 ms; commit 0 ms)
2026-11-08T12:55:10Z [load_day 2025-07-12] 2025-07-12 hour 17: 149229 events in 0 files, snapshot none (task 5658 ms: download 2952 ms overlapping gunzip 774 ms, parse 3377 ms, sort 0 ms, write 0 ms, index 723 ms: 2 candidates, 62925 repo-hours, 616 releases; waiting 488 ms; commit 0 ms)
2026-11-08T12:55:12Z [load_day 2025-07-12] 2025-07-12 hour 18: 153943 events in 0 files, snapshot none (task 4672 ms: download 2156 ms overlapping gunzip 654 ms, parse 2792 ms, sort 0 ms, write 0 ms, index 715 ms: 6 candidates, 72298 repo-hours, 825 releases; waiting 238 ms; commit 0 ms)
2026-11-08T12:55:16Z [load_day 2025-07-12] 2025-07-12 hour 19: 146125 events in 0 files, snapshot none (task 5542 ms: download 2747 ms overlapping gunzip 811 ms, parse 3403 ms, sort 0 ms, write 0 ms, index 498 ms: 5 candidates, 57820 repo-hours, 720 releases; waiting 522 ms; commit 0 ms)
2026-11-08T12:55:17Z [load_day 2025-07-12] 2025-07-12 hour 20: 140607 events in 0 files, snapshot none (task 4627 ms: download 2469 ms overlapping gunzip 662 ms, parse 2848 ms, sort 0 ms, write 0 ms, index 416 ms: 1 candidates, 58233 repo-hours, 654 releases; waiting 452 ms; commit 0 ms)
2026-11-08T12:55:22Z [load_day 2025-07-12] 2025-07-12 hour 21: 139937 events in 0 files, snapshot none (task 5337 ms: download 2381 ms overlapping gunzip 762 ms, parse 3251 ms, sort 0 ms, write 0 ms, index 526 ms: 5 candidates, 55678 repo-hours, 791 releases; waiting 514 ms; commit 0 ms)
2026-11-08T12:55:23Z [load_day 2025-07-12] 2025-07-12 hour 22: 129827 events in 0 files, snapshot none (task 5449 ms: download 3448 ms overlapping gunzip 698 ms, parse 3045 ms, sort 0 ms, write 0 ms, index 391 ms: 6 candidates, 49643 repo-hours, 836 releases; waiting 603 ms; commit 0 ms)
2026-11-08T12:55:27Z [load_day 2025-07-12] 2025-07-12 hour 23: 127070 events in 0 files, snapshot none (task 5337 ms: download 3148 ms overlapping gunzip 786 ms, parse 3274 ms, sort 0 ms, write 0 ms, index 416 ms: 3 candidates, 47824 repo-hours, 870 releases; waiting 521 ms; commit 0 ms)
2026-11-08T12:55:35Z [load_day 2025-07-12] 2025-07-12: repo_hour merged from 24 files to 1 (1554598 rows, 7907 ms)
2026-11-08T12:55:39Z [load_day 2025-07-12] 2025-07-12: index committed in 11184 ms (23 + 1 + 24 files)
2026-11-08T12:55:39Z [load_day 2025-07-12] 2025-07-12: 3485974 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:55:39Z [load_day 2025-07-12] attempt 1 succeeded