orcaLog in

Runs · run 4449

load_day 2025-09-28, attempt 1 succeeded

Host
73ccef5e07c2:386786
Started
2026-11-08T14:02:31Z
Ended
2026-11-08T14:03:58Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
649 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
119.0 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4449/load_day/2025-09-28/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:02:31Z [load_day 2025-09-28] attempt 1 started
2026-11-08T14:02:32Z [load_day 2025-09-28] 2025-09-28: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:02:37Z [load_day 2025-09-28] 2025-09-28 hour 0: 140900 events in 0 files, snapshot none (task 4414 ms: download 2906 ms overlapping gunzip 607 ms, parse 2552 ms, sort 0 ms, write 0 ms, index 515 ms: 8 candidates, 67226 repo-hours, 939 releases; waiting 391 ms; commit 0 ms)
2026-11-08T14:02:37Z [load_day 2025-09-28] 2025-09-28 hour 1: 160125 events in 0 files, snapshot none (task 4528 ms: download 2601 ms overlapping gunzip 573 ms, parse 2551 ms, sort 0 ms, write 0 ms, index 610 ms: 3 candidates, 91858 repo-hours, 686 releases; waiting 520 ms; commit 0 ms)
2026-11-08T14:02:42Z [load_day 2025-09-28] 2025-09-28 hour 2: 144227 events in 0 files, snapshot none (task 4998 ms: download 2445 ms overlapping gunzip 702 ms, parse 2825 ms, sort 0 ms, write 0 ms, index 671 ms: 8 candidates, 68521 repo-hours, 771 releases; waiting 523 ms; commit 0 ms)
2026-11-08T14:02:42Z [load_day 2025-09-28] 2025-09-28 hour 3: 146860 events in 0 files, snapshot none (task 4596 ms: download 2455 ms overlapping gunzip 601 ms, parse 2423 ms, sort 0 ms, write 0 ms, index 669 ms: 3 candidates, 63406 repo-hours, 2062 releases; waiting 578 ms; commit 0 ms)
2026-11-08T14:02:48Z [load_day 2025-09-28] 2025-09-28 hour 4: 145492 events in 0 files, snapshot none (task 5270 ms: download 3288 ms overlapping gunzip 678 ms, parse 2894 ms, sort 0 ms, write 0 ms, index 557 ms: 5 candidates, 56576 repo-hours, 622 releases; waiting 825 ms; commit 0 ms)
2026-11-08T14:02:48Z [load_day 2025-09-28] 2025-09-28 hour 5: 151751 events in 0 files, snapshot none (task 5397 ms: download 2685 ms overlapping gunzip 725 ms, parse 2986 ms, sort 0 ms, write 0 ms, index 813 ms: 31 candidates, 60458 repo-hours, 547 releases; waiting 549 ms; commit 0 ms)
2026-11-08T14:02:54Z [load_day 2025-09-28] 2025-09-28 hour 6: 159526 events in 0 files, snapshot none (task 5525 ms: download 3241 ms overlapping gunzip 737 ms, parse 3130 ms, sort 0 ms, write 0 ms, index 822 ms: 9 candidates, 72874 repo-hours, 602 releases; waiting 493 ms; commit 0 ms)
2026-11-08T14:02:54Z [load_day 2025-09-28] 2025-09-28 hour 7: 154640 events in 0 files, snapshot none (task 5983 ms: download 3558 ms overlapping gunzip 679 ms, parse 2959 ms, sort 0 ms, write 0 ms, index 1485 ms: 6 candidates, 64132 repo-hours, 563 releases; waiting 592 ms; commit 0 ms)
2026-11-08T14:03:01Z [load_day 2025-09-28] 2025-09-28 hour 8: 156997 events in 0 files, snapshot none (task 6525 ms: download 3846 ms overlapping gunzip 945 ms, parse 4029 ms, sort 0 ms, write 0 ms, index 637 ms: 9 candidates, 68822 repo-hours, 666 releases; waiting 539 ms; commit 0 ms)
2026-11-08T14:03:01Z [load_day 2025-09-28] 2025-09-28 hour 9: 156926 events in 0 files, snapshot none (task 6285 ms: download 3596 ms overlapping gunzip 947 ms, parse 3941 ms, sort 0 ms, write 0 ms, index 531 ms: 5 candidates, 66148 repo-hours, 747 releases; waiting 549 ms; commit 0 ms)
2026-11-08T14:03:08Z [load_day 2025-09-28] 2025-09-28 hour 10: 157378 events in 0 files, snapshot none (task 6045 ms: download 3491 ms overlapping gunzip 907 ms, parse 3587 ms, sort 0 ms, write 0 ms, index 666 ms: 5 candidates, 66802 repo-hours, 603 releases; waiting 545 ms; commit 0 ms)
2026-11-08T14:03:08Z [load_day 2025-09-28] 2025-09-28 hour 11: 154136 events in 0 files, snapshot none (task 6319 ms: download 3253 ms overlapping gunzip 946 ms, parse 3933 ms, sort 0 ms, write 0 ms, index 614 ms: 9 candidates, 62633 repo-hours, 531 releases; waiting 527 ms; commit 0 ms)
2026-11-08T14:03:14Z [load_day 2025-09-28] 2025-09-28 hour 12: 174023 events in 0 files, snapshot none (task 5838 ms: download 2924 ms overlapping gunzip 768 ms, parse 3350 ms, sort 0 ms, write 0 ms, index 917 ms: 8 candidates, 94786 repo-hours, 639 releases; waiting 499 ms; commit 0 ms)
2026-11-08T14:03:15Z [load_day 2025-09-28] 2025-09-28 hour 13: 171017 events in 0 files, snapshot none (task 6843 ms: download 4162 ms overlapping gunzip 869 ms, parse 4056 ms, sort 0 ms, write 0 ms, index 690 ms: 8 candidates, 82740 repo-hours, 611 releases; waiting 802 ms; commit 0 ms)
2026-11-08T14:03:21Z [load_day 2025-09-28] 2025-09-28 hour 14: 170956 events in 0 files, snapshot none (task 6435 ms: download 2935 ms overlapping gunzip 851 ms, parse 3608 ms, sort 0 ms, write 0 ms, index 1127 ms: 13 candidates, 71900 repo-hours, 657 releases; waiting 518 ms; commit 0 ms)
2026-11-08T14:03:23Z [load_day 2025-09-28] 2025-09-28 hour 15: 174732 events in 0 files, snapshot none (task 6676 ms: download 3051 ms overlapping gunzip 943 ms, parse 4166 ms, sort 0 ms, write 0 ms, index 754 ms: 5 candidates, 71133 repo-hours, 697 releases; waiting 510 ms; commit 0 ms)
2026-11-08T14:03:29Z [load_day 2025-09-28] 2025-09-28 hour 16: 174793 events in 0 files, snapshot none (task 6894 ms: download 3722 ms overlapping gunzip 994 ms, parse 4368 ms, sort 0 ms, write 0 ms, index 655 ms: 7 candidates, 69841 repo-hours, 657 releases; waiting 539 ms; commit 0 ms)
2026-11-08T14:03:30Z [load_day 2025-09-28] 2025-09-28 hour 17: 168132 events in 0 files, snapshot none (task 6461 ms: download 4017 ms overlapping gunzip 976 ms, parse 3903 ms, sort 0 ms, write 0 ms, index 491 ms: 7 candidates, 64488 repo-hours, 617 releases; waiting 755 ms; commit 0 ms)
2026-11-08T14:03:35Z [load_day 2025-09-28] 2025-09-28 hour 18: 169378 events in 0 files, snapshot none (task 5921 ms: download 3016 ms overlapping gunzip 798 ms, parse 3581 ms, sort 0 ms, write 0 ms, index 696 ms: 5 candidates, 70535 repo-hours, 767 releases; waiting 495 ms; commit 0 ms)
2026-11-08T14:03:36Z [load_day 2025-09-28] 2025-09-28 hour 19: 168021 events in 0 files, snapshot none (task 5764 ms: download 3046 ms overlapping gunzip 815 ms, parse 3532 ms, sort 0 ms, write 0 ms, index 484 ms: 14 candidates, 61400 repo-hours, 636 releases; waiting 547 ms; commit 0 ms)
2026-11-08T14:03:40Z [load_day 2025-09-28] 2025-09-28 hour 20: 169889 events in 0 files, snapshot none (task 4367 ms: download 2271 ms overlapping gunzip 596 ms, parse 2712 ms, sort 0 ms, write 0 ms, index 598 ms: 6 candidates, 56088 repo-hours, 530 releases; waiting 220 ms; commit 0 ms)
2026-11-08T14:03:43Z [load_day 2025-09-28] 2025-09-28 hour 21: 166365 events in 0 files, snapshot none (task 6019 ms: download 4065 ms overlapping gunzip 744 ms, parse 3193 ms, sort 0 ms, write 0 ms, index 693 ms: 8 candidates, 53702 repo-hours, 541 releases; waiting 1047 ms; commit 0 ms)
2026-11-08T14:03:46Z [load_day 2025-09-28] 2025-09-28 hour 22: 165149 events in 0 files, snapshot none (task 5376 ms: download 2951 ms overlapping gunzip 816 ms, parse 3574 ms, sort 0 ms, write 0 ms, index 429 ms: 9 candidates, 49868 repo-hours, 628 releases; waiting 227 ms; commit 0 ms)
2026-11-08T14:03:48Z [load_day 2025-09-28] 2025-09-28 hour 23: 166896 events in 0 files, snapshot none (task 4512 ms: download 1996 ms overlapping gunzip 633 ms, parse 2974 ms, sort 0 ms, write 0 ms, index 376 ms: 5 candidates, 46765 repo-hours, 545 releases; waiting 184 ms; commit 0 ms)
2026-11-08T14:03:55Z [load_day 2025-09-28] 2025-09-28: repo_hour merged from 24 files to 1 (1602702 rows, 7630 ms)
2026-11-08T14:03:58Z [load_day 2025-09-28] 2025-09-28: index committed in 10570 ms (24 + 1 + 24 files)
2026-11-08T14:03:58Z [load_day 2025-09-28] 2025-09-28: 3868309 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:03:58Z [load_day 2025-09-28] attempt 1 succeeded