orcaLog in

Runs · run 3970

load_day 2025-06-01, attempt 1 succeeded

Host
73ccef5e07c2:315410
Started
2026-11-08T12:14:26Z
Ended
2026-11-08T12:15:57Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
625 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
120.2 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3970/load_day/2025-06-01/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:14:26Z [load_day 2025-06-01] attempt 1 started
2026-11-08T12:14:27Z [load_day 2025-06-01] 2025-06-01: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:14:33Z [load_day 2025-06-01] 2025-06-01 hour 0: 126670 events in 0 files, snapshot none (task 4761 ms: download 2598 ms overlapping gunzip 742 ms, parse 2807 ms, sort 0 ms, write 0 ms, index 398 ms: 3 candidates, 55869 repo-hours, 1055 releases; waiting 489 ms; commit 0 ms)
2026-11-08T12:14:33Z [load_day 2025-06-01] 2025-06-01 hour 1: 141935 events in 0 files, snapshot none (task 5174 ms: download 3336 ms overlapping gunzip 676 ms, parse 2819 ms, sort 0 ms, write 0 ms, index 594 ms: 5 candidates, 80007 repo-hours, 905 releases; waiting 810 ms; commit 0 ms)
2026-11-08T12:14:39Z [load_day 2025-06-01] 2025-06-01 hour 2: 134696 events in 0 files, snapshot none (task 6188 ms: download 3489 ms overlapping gunzip 938 ms, parse 3845 ms, sort 0 ms, write 0 ms, index 559 ms: 8 candidates, 66749 repo-hours, 910 releases; waiting 514 ms; commit 0 ms)
2026-11-08T12:14:39Z [load_day 2025-06-01] 2025-06-01 hour 3: 135098 events in 0 files, snapshot none (task 5919 ms: download 3217 ms overlapping gunzip 937 ms, parse 3612 ms, sort 0 ms, write 0 ms, index 460 ms: 8 candidates, 56948 repo-hours, 916 releases; waiting 520 ms; commit 0 ms)
2026-11-08T12:14:46Z [load_day 2025-06-01] 2025-06-01 hour 4: 133331 events in 0 files, snapshot none (task 5804 ms: download 3190 ms overlapping gunzip 871 ms, parse 3350 ms, sort 0 ms, write 0 ms, index 548 ms: 9 candidates, 56434 repo-hours, 2064 releases; waiting 761 ms; commit 0 ms)
2026-11-08T12:14:46Z [load_day 2025-06-01] 2025-06-01 hour 5: 135126 events in 0 files, snapshot none (task 5792 ms: download 3062 ms overlapping gunzip 897 ms, parse 3761 ms, sort 0 ms, write 0 ms, index 558 ms: 7 candidates, 54480 repo-hours, 713 releases; waiting 360 ms; commit 0 ms)
2026-11-08T12:14:51Z [load_day 2025-06-01] 2025-06-01 hour 6: 139594 events in 0 files, snapshot none (task 5203 ms: download 2648 ms overlapping gunzip 753 ms, parse 2949 ms, sort 0 ms, write 0 ms, index 643 ms: 5 candidates, 64896 repo-hours, 747 releases; waiting 545 ms; commit 0 ms)
2026-11-08T12:14:57Z [load_day 2025-06-01] 2025-06-01 hour 7: 141166 events in 0 files, snapshot none (task 11097 ms: download 9895 ms overlapping gunzip 828 ms, parse 3350 ms, sort 0 ms, write 0 ms, index 638 ms: 8 candidates, 58338 repo-hours, 604 releases; waiting 5954 ms; commit 0 ms)
2026-11-08T12:14:57Z [load_day 2025-06-01] 2025-06-01 hour 8: 144514 events in 0 files, snapshot none (task 5454 ms: download 2685 ms overlapping gunzip 753 ms, parse 3141 ms, sort 0 ms, write 0 ms, index 795 ms: 5 candidates, 62681 repo-hours, 699 releases; waiting 513 ms; commit 0 ms)
2026-11-08T12:15:03Z [load_day 2025-06-01] 2025-06-01 hour 9: 148075 events in 0 files, snapshot none (task 5027 ms: download 2660 ms overlapping gunzip 708 ms, parse 2830 ms, sort 0 ms, write 0 ms, index 625 ms: 3 candidates, 64424 repo-hours, 851 releases; waiting 511 ms; commit 0 ms)
2026-11-08T12:15:03Z [load_day 2025-06-01] 2025-06-01 hour 10: 142826 events in 0 files, snapshot none (task 4801 ms: download 3197 ms overlapping gunzip 634 ms, parse 2689 ms, sort 0 ms, write 0 ms, index 545 ms: 1 candidates, 63566 repo-hours, 708 releases; waiting 577 ms; commit 0 ms)
2026-11-08T12:15:09Z [load_day 2025-06-01] 2025-06-01 hour 11: 140649 events in 0 files, snapshot none (task 5244 ms: download 3110 ms overlapping gunzip 751 ms, parse 3048 ms, sort 0 ms, write 0 ms, index 452 ms: 11 candidates, 59881 repo-hours, 635 releases; waiting 602 ms; commit 0 ms)
2026-11-08T12:15:09Z [load_day 2025-06-01] 2025-06-01 hour 12: 158791 events in 0 files, snapshot none (task 5314 ms: download 2811 ms overlapping gunzip 699 ms, parse 2969 ms, sort 0 ms, write 0 ms, index 706 ms: 2 candidates, 89614 repo-hours, 704 releases; waiting 565 ms; commit 0 ms)
2026-11-08T12:15:15Z [load_day 2025-06-01] 2025-06-01 hour 13: 153753 events in 0 files, snapshot none (task 6018 ms: download 3676 ms overlapping gunzip 773 ms, parse 3395 ms, sort 0 ms, write 0 ms, index 648 ms: 12 candidates, 79837 repo-hours, 662 releases; waiting 978 ms; commit 0 ms)
2026-11-08T12:15:17Z [load_day 2025-06-01] 2025-06-01 hour 14: 149665 events in 0 files, snapshot none (task 7193 ms: download 3510 ms overlapping gunzip 871 ms, parse 3545 ms, sort 0 ms, write 0 ms, index 1683 ms: 4 candidates, 69319 repo-hours, 671 releases; waiting 773 ms; commit 0 ms)
2026-11-08T12:15:23Z [load_day 2025-06-01] 2025-06-01 hour 15: 152848 events in 0 files, snapshot none (task 6115 ms: download 3395 ms overlapping gunzip 936 ms, parse 3761 ms, sort 0 ms, write 0 ms, index 590 ms: 5 candidates, 72785 repo-hours, 823 releases; waiting 560 ms; commit 0 ms)
2026-11-08T12:15:24Z [load_day 2025-06-01] 2025-06-01 hour 16: 149888 events in 0 files, snapshot none (task 6168 ms: download 3684 ms overlapping gunzip 934 ms, parse 3941 ms, sort 0 ms, write 0 ms, index 536 ms: 2 candidates, 69667 repo-hours, 731 releases; waiting 518 ms; commit 0 ms)
2026-11-08T12:15:30Z [load_day 2025-06-01] 2025-06-01 hour 17: 148341 events in 0 files, snapshot none (task 6415 ms: download 3980 ms overlapping gunzip 696 ms, parse 2943 ms, sort 0 ms, write 0 ms, index 560 ms: 9 candidates, 66718 repo-hours, 725 releases; waiting 1925 ms; commit 0 ms)
2026-11-08T12:15:30Z [load_day 2025-06-01] 2025-06-01 hour 18: 151814 events in 0 files, snapshot none (task 4937 ms: download 2746 ms overlapping gunzip 689 ms, parse 2846 ms, sort 0 ms, write 0 ms, index 587 ms: 7 candidates, 73369 repo-hours, 779 releases; waiting 513 ms; commit 0 ms)
2026-11-08T12:15:36Z [load_day 2025-06-01] 2025-06-01 hour 19: 148129 events in 0 files, snapshot none (task 6039 ms: download 3699 ms overlapping gunzip 701 ms, parse 2863 ms, sort 0 ms, write 0 ms, index 483 ms: 5 candidates, 62636 repo-hours, 721 releases; waiting 1667 ms; commit 0 ms)
2026-11-08T12:15:36Z [load_day 2025-06-01] 2025-06-01 hour 20: 145876 events in 0 files, snapshot none (task 4364 ms: download 2119 ms overlapping gunzip 653 ms, parse 2793 ms, sort 0 ms, write 0 ms, index 491 ms: 10 candidates, 61299 repo-hours, 729 releases; waiting 173 ms; commit 0 ms)
2026-11-08T12:15:42Z [load_day 2025-06-01] 2025-06-01 hour 21: 139304 events in 0 files, snapshot none (task 4503 ms: download 2938 ms overlapping gunzip 617 ms, parse 2533 ms, sort 0 ms, write 0 ms, index 474 ms: 6 candidates, 59012 repo-hours, 727 releases; waiting 536 ms; commit 0 ms)
2026-11-08T12:15:42Z [load_day 2025-06-01] 2025-06-01 hour 22: 133140 events in 0 files, snapshot none (task 4526 ms: download 2683 ms overlapping gunzip 611 ms, parse 2424 ms, sort 0 ms, write 0 ms, index 400 ms: 10 candidates, 54961 repo-hours, 776 releases; waiting 796 ms; commit 0 ms)
2026-11-08T12:15:47Z [load_day 2025-06-01] 2025-06-01 hour 23: 130244 events in 0 files, snapshot none (task 5032 ms: download 3360 ms overlapping gunzip 699 ms, parse 2828 ms, sort 0 ms, write 0 ms, index 448 ms: 6 candidates, 51811 repo-hours, 775 releases; waiting 726 ms; commit 0 ms)
2026-11-08T12:15:55Z [load_day 2025-06-01] 2025-06-01: repo_hour merged from 24 files to 1 (1555301 rows, 7706 ms)
2026-11-08T12:15:57Z [load_day 2025-06-01] 2025-06-01: index committed in 10451 ms (24 + 1 + 24 files)
2026-11-08T12:15:57Z [load_day 2025-06-01] 2025-06-01: 3425473 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:15:57Z [load_day 2025-06-01] attempt 1 succeeded