orcaLog in

Runs · run 3992

load_day 2025-06-07, attempt 1 succeeded

Host
73ccef5e07c2:318236
Started
2026-11-08T12:19:18Z
Ended
2026-11-08T12:20:43Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
604 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
111.6 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3992/load_day/2025-06-07/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:19:18Z [load_day 2025-06-07] attempt 1 started
2026-11-08T12:19:19Z [load_day 2025-06-07] 2025-06-07: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:19:26Z [load_day 2025-06-07] 2025-06-07 hour 0: 133768 events in 0 files, snapshot none (task 6104 ms: download 3022 ms overlapping gunzip 793 ms, parse 3444 ms, sort 0 ms, write 0 ms, index 643 ms: 8 candidates, 66750 repo-hours, 890 releases; waiting 874 ms; commit 0 ms)
2026-11-08T12:19:26Z [load_day 2025-06-07] 2025-06-07 hour 1: 140384 events in 0 files, snapshot none (task 5035 ms: download 2695 ms overlapping gunzip 666 ms, parse 2930 ms, sort 0 ms, write 0 ms, index 812 ms: 10 candidates, 80753 repo-hours, 657 releases; waiting 294 ms; commit 0 ms)
2026-11-08T12:19:32Z [load_day 2025-06-07] 2025-06-07 hour 2: 129572 events in 0 files, snapshot none (task 5771 ms: download 2790 ms overlapping gunzip 819 ms, parse 3478 ms, sort 0 ms, write 0 ms, index 701 ms: 10 candidates, 61417 repo-hours, 757 releases; waiting 497 ms; commit 0 ms)
2026-11-08T12:19:32Z [load_day 2025-06-07] 2025-06-07 hour 3: 131112 events in 0 files, snapshot none (task 5100 ms: download 2529 ms overlapping gunzip 714 ms, parse 3053 ms, sort 0 ms, write 0 ms, index 680 ms: 5 candidates, 59129 repo-hours, 1917 releases; waiting 293 ms; commit 0 ms)
2026-11-08T12:19:37Z [load_day 2025-06-07] 2025-06-07 hour 4: 127670 events in 0 files, snapshot none (task 4631 ms: download 2681 ms overlapping gunzip 580 ms, parse 2662 ms, sort 0 ms, write 0 ms, index 529 ms: 6 candidates, 51915 repo-hours, 660 releases; waiting 517 ms; commit 0 ms)
2026-11-08T12:19:38Z [load_day 2025-06-07] 2025-06-07 hour 5: 130507 events in 0 files, snapshot none (task 5218 ms: download 2582 ms overlapping gunzip 760 ms, parse 3229 ms, sort 0 ms, write 0 ms, index 433 ms: 4 candidates, 53258 repo-hours, 618 releases; waiting 543 ms; commit 0 ms)
2026-11-08T12:19:43Z [load_day 2025-06-07] 2025-06-07 hour 6: 137418 events in 0 files, snapshot none (task 4804 ms: download 2701 ms overlapping gunzip 667 ms, parse 2657 ms, sort 0 ms, write 0 ms, index 587 ms: 6 candidates, 64505 repo-hours, 787 releases; waiting 600 ms; commit 0 ms)
2026-11-08T12:19:43Z [load_day 2025-06-07] 2025-06-07 hour 7: 137940 events in 0 files, snapshot none (task 4473 ms: download 2527 ms overlapping gunzip 639 ms, parse 2639 ms, sort 0 ms, write 0 ms, index 442 ms: 9 candidates, 56957 repo-hours, 805 releases; waiting 460 ms; commit 0 ms)
2026-11-08T12:19:48Z [load_day 2025-06-07] 2025-06-07 hour 8: 140751 events in 0 files, snapshot none (task 5134 ms: download 3044 ms overlapping gunzip 720 ms, parse 3069 ms, sort 0 ms, write 0 ms, index 483 ms: 10 candidates, 61241 repo-hours, 844 releases; waiting 503 ms; commit 0 ms)
2026-11-08T12:19:49Z [load_day 2025-06-07] 2025-06-07 hour 9: 142320 events in 0 files, snapshot none (task 5471 ms: download 2797 ms overlapping gunzip 774 ms, parse 3239 ms, sort 0 ms, write 0 ms, index 608 ms: 17 candidates, 63470 repo-hours, 851 releases; waiting 518 ms; commit 0 ms)
2026-11-08T12:19:55Z [load_day 2025-06-07] 2025-06-07 hour 10: 137577 events in 0 files, snapshot none (task 5883 ms: download 3119 ms overlapping gunzip 804 ms, parse 3521 ms, sort 0 ms, write 0 ms, index 439 ms: 11 candidates, 61212 repo-hours, 654 releases; waiting 759 ms; commit 0 ms)
2026-11-08T12:19:55Z [load_day 2025-06-07] 2025-06-07 hour 11: 134694 events in 0 files, snapshot none (task 4682 ms: download 2575 ms overlapping gunzip 635 ms, parse 2734 ms, sort 0 ms, write 0 ms, index 513 ms: 9 candidates, 56766 repo-hours, 566 releases; waiting 527 ms; commit 0 ms)
2026-11-08T12:20:01Z [load_day 2025-06-07] 2025-06-07 hour 12: 150416 events in 0 files, snapshot none (task 5479 ms: download 2724 ms overlapping gunzip 732 ms, parse 3286 ms, sort 0 ms, write 0 ms, index 682 ms: 14 candidates, 84399 repo-hours, 569 releases; waiting 484 ms; commit 0 ms)
2026-11-08T12:20:01Z [load_day 2025-06-07] 2025-06-07 hour 13: 147202 events in 0 files, snapshot none (task 5693 ms: download 2792 ms overlapping gunzip 756 ms, parse 3408 ms, sort 0 ms, write 0 ms, index 735 ms: 9 candidates, 74817 repo-hours, 622 releases; waiting 494 ms; commit 0 ms)
2026-11-08T12:20:10Z [load_day 2025-06-07] 2025-06-07 hour 14: 147471 events in 0 files, snapshot none (task 6380 ms: download 3371 ms overlapping gunzip 961 ms, parse 4079 ms, sort 0 ms, write 0 ms, index 586 ms: 10 candidates, 66218 repo-hours, 641 releases; waiting 501 ms; commit 0 ms)
2026-11-08T12:20:10Z [load_day 2025-06-07] 2025-06-07 hour 15: 149041 events in 0 files, snapshot none (task 6321 ms: download 3048 ms overlapping gunzip 936 ms, parse 3885 ms, sort 0 ms, write 0 ms, index 573 ms: 4 candidates, 69597 repo-hours, 788 releases; waiting 520 ms; commit 0 ms)
2026-11-08T12:20:17Z [load_day 2025-06-07] 2025-06-07 hour 16: 147879 events in 0 files, snapshot none (task 6131 ms: download 3253 ms overlapping gunzip 943 ms, parse 3904 ms, sort 0 ms, write 0 ms, index 532 ms: 6 candidates, 66919 repo-hours, 698 releases; waiting 515 ms; commit 0 ms)
2026-11-08T12:20:17Z [load_day 2025-06-07] 2025-06-07 hour 17: 143163 events in 0 files, snapshot none (task 5765 ms: download 2812 ms overlapping gunzip 807 ms, parse 3503 ms, sort 0 ms, write 0 ms, index 569 ms: 12 candidates, 61540 repo-hours, 659 releases; waiting 568 ms; commit 0 ms)
2026-11-08T12:20:23Z [load_day 2025-06-07] 2025-06-07 hour 18: 142295 events in 0 files, snapshot none (task 5511 ms: download 2485 ms overlapping gunzip 778 ms, parse 3246 ms, sort 0 ms, write 0 ms, index 867 ms: 7 candidates, 68694 repo-hours, 662 releases; waiting 326 ms; commit 0 ms)
2026-11-08T12:20:23Z [load_day 2025-06-07] 2025-06-07 hour 19: 138455 events in 0 files, snapshot none (task 5449 ms: download 2427 ms overlapping gunzip 734 ms, parse 3313 ms, sort 0 ms, write 0 ms, index 578 ms: 10 candidates, 56956 repo-hours, 643 releases; waiting 462 ms; commit 0 ms)
2026-11-08T12:20:28Z [load_day 2025-06-07] 2025-06-07 hour 20: 137416 events in 0 files, snapshot none (task 4387 ms: download 2406 ms overlapping gunzip 576 ms, parse 2621 ms, sort 0 ms, write 0 ms, index 429 ms: 17 candidates, 56089 repo-hours, 639 releases; waiting 517 ms; commit 0 ms)
2026-11-08T12:20:28Z [load_day 2025-06-07] 2025-06-07 hour 21: 137293 events in 0 files, snapshot none (task 4710 ms: download 2733 ms overlapping gunzip 674 ms, parse 2862 ms, sort 0 ms, write 0 ms, index 417 ms: 8 candidates, 56275 repo-hours, 780 releases; waiting 470 ms; commit 0 ms)
2026-11-08T12:20:34Z [load_day 2025-06-07] 2025-06-07 hour 22: 125000 events in 0 files, snapshot none (task 5306 ms: download 2988 ms overlapping gunzip 711 ms, parse 3253 ms, sort 0 ms, write 0 ms, index 414 ms: 13 candidates, 49532 repo-hours, 677 releases; waiting 571 ms; commit 0 ms)
2026-11-08T12:20:34Z [load_day 2025-06-07] 2025-06-07 hour 23: 122178 events in 0 files, snapshot none (task 4627 ms: download 2682 ms overlapping gunzip 637 ms, parse 2799 ms, sort 0 ms, write 0 ms, index 358 ms: 5 candidates, 45450 repo-hours, 574 releases; waiting 481 ms; commit 0 ms)
2026-11-08T12:20:40Z [load_day 2025-06-07] 2025-06-07: repo_hour merged from 24 files to 1 (1493859 rows, 6457 ms)
2026-11-08T12:20:43Z [load_day 2025-06-07] 2025-06-07: index committed in 9319 ms (24 + 1 + 24 files)
2026-11-08T12:20:43Z [load_day 2025-06-07] 2025-06-07: 3311522 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:20:43Z [load_day 2025-06-07] attempt 1 succeeded