orcaLog in

Runs · run 4285

load_day 2025-08-17, attempt 1 succeeded

Host
73ccef5e07c2:362815
Started
2026-11-08T13:25:23Z
Ended
2026-11-08T13:27:00Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
633 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
120.4 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4285/load_day/2025-08-17/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:25:23Z [load_day 2025-08-17] attempt 1 started
2026-11-08T13:25:24Z [load_day 2025-08-17] 2025-08-17: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:25:30Z [load_day 2025-08-17] 2025-08-17 hour 0: 131317 events in 0 files, snapshot none (task 5945 ms: download 3160 ms overlapping gunzip 715 ms, parse 3062 ms, sort 0 ms, write 0 ms, index 666 ms: 7 candidates, 58664 repo-hours, 1163 releases; waiting 1192 ms; commit 0 ms)
2026-11-08T13:25:30Z [load_day 2025-08-17] 2025-08-17 hour 1: 143225 events in 0 files, snapshot none (task 4808 ms: download 3061 ms overlapping gunzip 557 ms, parse 2392 ms, sort 0 ms, write 0 ms, index 807 ms: 5 candidates, 81352 repo-hours, 761 releases; waiting 625 ms; commit 0 ms)
2026-11-08T13:25:37Z [load_day 2025-08-17] 2025-08-17 hour 2: 142070 events in 0 files, snapshot none (task 6334 ms: download 2966 ms overlapping gunzip 727 ms, parse 2946 ms, sort 0 ms, write 0 ms, index 2018 ms: 4 candidates, 68479 repo-hours, 783 releases; waiting 349 ms; commit 0 ms)
2026-11-08T13:25:39Z [load_day 2025-08-17] 2025-08-17 hour 3: 136425 events in 0 files, snapshot none (task 7993 ms: download 3694 ms overlapping gunzip 1067 ms, parse 3283 ms, sort 0 ms, write 0 ms, index 2732 ms: 3 candidates, 53968 repo-hours, 1232 releases; waiting 373 ms; commit 0 ms)
2026-11-08T13:25:43Z [load_day 2025-08-17] 2025-08-17 hour 4: 141713 events in 0 files, snapshot none (task 5163 ms: download 3867 ms overlapping gunzip 638 ms, parse 2450 ms, sort 0 ms, write 0 ms, index 748 ms: 8 candidates, 55140 repo-hours, 1717 releases; waiting 1040 ms; commit 0 ms)
2026-11-08T13:25:55Z [load_day 2025-08-17] 2025-08-17 hour 5: 139957 events in 0 files, snapshot none (task 8270 ms: download 6560 ms overlapping gunzip 1333 ms, parse 3787 ms, sort 0 ms, write 0 ms, index 445 ms: 4 candidates, 53318 repo-hours, 630 releases; waiting 2129 ms; commit 0 ms)
2026-11-08T13:25:55Z [load_day 2025-08-17] 2025-08-17 hour 6: 146582 events in 0 files, snapshot none (task 5802 ms: download 3313 ms overlapping gunzip 930 ms, parse 3523 ms, sort 0 ms, write 0 ms, index 548 ms: 2 candidates, 63602 repo-hours, 717 releases; waiting 554 ms; commit 0 ms)
2026-11-08T13:26:01Z [load_day 2025-08-17] 2025-08-17 hour 7: 146678 events in 0 files, snapshot none (task 5595 ms: download 3630 ms overlapping gunzip 824 ms, parse 3336 ms, sort 0 ms, write 0 ms, index 520 ms: 3 candidates, 57129 repo-hours, 602 releases; waiting 448 ms; commit 0 ms)
2026-11-08T13:26:02Z [load_day 2025-08-17] 2025-08-17 hour 8: 149289 events in 0 files, snapshot none (task 5830 ms: download 3254 ms overlapping gunzip 940 ms, parse 3558 ms, sort 0 ms, write 0 ms, index 629 ms: 3 candidates, 62569 repo-hours, 639 releases; waiting 420 ms; commit 0 ms)
2026-11-08T13:26:08Z [load_day 2025-08-17] 2025-08-17 hour 9: 148935 events in 0 files, snapshot none (task 6506 ms: download 4305 ms overlapping gunzip 768 ms, parse 3110 ms, sort 0 ms, write 0 ms, index 463 ms: 3 candidates, 61848 repo-hours, 744 releases; waiting 1856 ms; commit 0 ms)
2026-11-08T13:26:08Z [load_day 2025-08-17] 2025-08-17 hour 10: 150065 events in 0 files, snapshot none (task 5627 ms: download 3854 ms overlapping gunzip 785 ms, parse 2950 ms, sort 0 ms, write 0 ms, index 528 ms: 2 candidates, 62203 repo-hours, 646 releases; waiting 1023 ms; commit 0 ms)
2026-11-08T13:26:14Z [load_day 2025-08-17] 2025-08-17 hour 11: 150462 events in 0 files, snapshot none (task 4875 ms: download 3287 ms overlapping gunzip 724 ms, parse 2844 ms, sort 0 ms, write 0 ms, index 458 ms: 3 candidates, 60933 repo-hours, 655 releases; waiting 546 ms; commit 0 ms)
2026-11-08T13:26:14Z [load_day 2025-08-17] 2025-08-17 hour 12: 162539 events in 0 files, snapshot none (task 4607 ms: download 2260 ms overlapping gunzip 647 ms, parse 2658 ms, sort 0 ms, write 0 ms, index 622 ms: 12 candidates, 90653 repo-hours, 653 releases; waiting 356 ms; commit 0 ms)
2026-11-08T13:26:19Z [load_day 2025-08-17] 2025-08-17 hour 13: 158589 events in 0 files, snapshot none (task 4448 ms: download 2906 ms overlapping gunzip 561 ms, parse 2493 ms, sort 0 ms, write 0 ms, index 578 ms: 6 candidates, 79906 repo-hours, 629 releases; waiting 501 ms; commit 0 ms)
2026-11-08T13:26:19Z [load_day 2025-08-17] 2025-08-17 hour 14: 156119 events in 0 files, snapshot none (task 4895 ms: download 2897 ms overlapping gunzip 671 ms, parse 2688 ms, sort 0 ms, write 0 ms, index 515 ms: 5 candidates, 70841 repo-hours, 749 releases; waiting 743 ms; commit 0 ms)
2026-11-08T13:26:25Z [load_day 2025-08-17] 2025-08-17 hour 15: 157948 events in 0 files, snapshot none (task 5287 ms: download 3105 ms overlapping gunzip 810 ms, parse 3123 ms, sort 0 ms, write 0 ms, index 875 ms: 3 candidates, 72840 repo-hours, 763 releases; waiting 183 ms; commit 0 ms)
2026-11-08T13:26:27Z [load_day 2025-08-17] 2025-08-17 hour 16: 155283 events in 0 files, snapshot none (task 5843 ms: download 3181 ms overlapping gunzip 805 ms, parse 3455 ms, sort 0 ms, write 0 ms, index 815 ms: 8 candidates, 71290 repo-hours, 713 releases; waiting 486 ms; commit 0 ms)
2026-11-08T13:26:31Z [load_day 2025-08-17] 2025-08-17 hour 17: 154339 events in 0 files, snapshot none (task 5642 ms: download 2559 ms overlapping gunzip 771 ms, parse 3252 ms, sort 0 ms, write 0 ms, index 1047 ms: 4 candidates, 66302 repo-hours, 744 releases; waiting 288 ms; commit 0 ms)
2026-11-08T13:26:33Z [load_day 2025-08-17] 2025-08-17 hour 18: 155931 events in 0 files, snapshot none (task 5159 ms: download 3111 ms overlapping gunzip 711 ms, parse 3040 ms, sort 0 ms, write 0 ms, index 681 ms: 3 candidates, 74400 repo-hours, 852 releases; waiting 414 ms; commit 0 ms)
2026-11-08T13:26:37Z [load_day 2025-08-17] 2025-08-17 hour 19: 147587 events in 0 files, snapshot none (task 5417 ms: download 2934 ms overlapping gunzip 784 ms, parse 3101 ms, sort 0 ms, write 0 ms, index 739 ms: 6 candidates, 60013 repo-hours, 752 releases; waiting 485 ms; commit 0 ms)
2026-11-08T13:26:39Z [load_day 2025-08-17] 2025-08-17 hour 20: 143734 events in 0 files, snapshot none (task 5663 ms: download 2874 ms overlapping gunzip 862 ms, parse 3382 ms, sort 0 ms, write 0 ms, index 665 ms: 5 candidates, 58523 repo-hours, 763 releases; waiting 358 ms; commit 0 ms)
2026-11-08T13:26:43Z [load_day 2025-08-17] 2025-08-17 hour 21: 146311 events in 0 files, snapshot none (task 5592 ms: download 2662 ms overlapping gunzip 810 ms, parse 3361 ms, sort 0 ms, write 0 ms, index 724 ms: 8 candidates, 57310 repo-hours, 791 releases; waiting 382 ms; commit 0 ms)
2026-11-08T13:26:45Z [load_day 2025-08-17] 2025-08-17 hour 22: 137729 events in 0 files, snapshot none (task 4846 ms: download 3253 ms overlapping gunzip 624 ms, parse 2612 ms, sort 0 ms, write 0 ms, index 593 ms: 2 candidates, 53359 repo-hours, 685 releases; waiting 631 ms; commit 0 ms)
2026-11-08T13:26:48Z [load_day 2025-08-17] 2025-08-17 hour 23: 137952 events in 0 files, snapshot none (task 5014 ms: download 2744 ms overlapping gunzip 818 ms, parse 3250 ms, sort 0 ms, write 0 ms, index 427 ms: 8 candidates, 51104 repo-hours, 576 releases; waiting 199 ms; commit 0 ms)
2026-11-08T13:26:56Z [load_day 2025-08-17] 2025-08-17: repo_hour merged from 24 files to 1 (1545746 rows, 7753 ms)
2026-11-08T13:27:00Z [load_day 2025-08-17] 2025-08-17: index committed in 11297 ms (24 + 1 + 24 files)
2026-11-08T13:27:00Z [load_day 2025-08-17] 2025-08-17: 3540779 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:27:00Z [load_day 2025-08-17] attempt 1 succeeded