orcaLog in

Runs · run 3954

load_day 2025-05-28, attempt 1 succeeded

Host
73ccef5e07c2:312623
Started
2026-11-08T12:10:10Z
Ended
2026-11-08T12:11:48Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
677 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
133.7 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3954/load_day/2025-05-28/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:10:10Z [load_day 2025-05-28] attempt 1 started
2026-11-08T12:10:11Z [load_day 2025-05-28] 2025-05-28: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:10:17Z [load_day 2025-05-28] 2025-05-28 hour 0: 128147 events in 0 files, snapshot none (task 5616 ms: download 2709 ms overlapping gunzip 923 ms, parse 3739 ms, sort 0 ms, write 0 ms, index 543 ms: 15 candidates, 66452 repo-hours, 888 releases; waiting 188 ms; commit 0 ms)
2026-11-08T12:10:18Z [load_day 2025-05-28] 2025-05-28 hour 1: 132712 events in 0 files, snapshot none (task 6278 ms: download 2885 ms overlapping gunzip 919 ms, parse 3855 ms, sort 0 ms, write 0 ms, index 693 ms: 11 candidates, 80879 repo-hours, 595 releases; waiting 517 ms; commit 0 ms)
2026-11-08T12:10:24Z [load_day 2025-05-28] 2025-05-28 hour 2: 132735 events in 0 files, snapshot none (task 6404 ms: download 3426 ms overlapping gunzip 884 ms, parse 3759 ms, sort 0 ms, write 0 ms, index 822 ms: 14 candidates, 67620 repo-hours, 751 releases; waiting 630 ms; commit 0 ms)
2026-11-08T12:10:25Z [load_day 2025-05-28] 2025-05-28 hour 3: 135058 events in 0 files, snapshot none (task 6595 ms: download 3022 ms overlapping gunzip 925 ms, parse 4017 ms, sort 0 ms, write 0 ms, index 844 ms: 22 candidates, 68416 repo-hours, 1852 releases; waiting 560 ms; commit 0 ms)
2026-11-08T12:10:30Z [load_day 2025-05-28] 2025-05-28 hour 4: 131307 events in 0 files, snapshot none (task 4938 ms: download 2333 ms overlapping gunzip 751 ms, parse 3188 ms, sort 0 ms, write 0 ms, index 514 ms: 19 candidates, 61313 repo-hours, 705 releases; waiting 264 ms; commit 0 ms)
2026-11-08T12:10:31Z [load_day 2025-05-28] 2025-05-28 hour 5: 132716 events in 0 files, snapshot none (task 5258 ms: download 3168 ms overlapping gunzip 769 ms, parse 3169 ms, sort 0 ms, write 0 ms, index 491 ms: 15 candidates, 63529 repo-hours, 619 releases; waiting 562 ms; commit 0 ms)
2026-11-08T12:10:37Z [load_day 2025-05-28] 2025-05-28 hour 6: 136146 events in 0 files, snapshot none (task 6547 ms: download 3540 ms overlapping gunzip 1006 ms, parse 4057 ms, sort 0 ms, write 0 ms, index 693 ms: 26 candidates, 73661 repo-hours, 718 releases; waiting 541 ms; commit 0 ms)
2026-11-08T12:10:38Z [load_day 2025-05-28] 2025-05-28 hour 7: 136863 events in 0 files, snapshot none (task 6424 ms: download 3390 ms overlapping gunzip 1001 ms, parse 3960 ms, sort 0 ms, write 0 ms, index 587 ms: 16 candidates, 71601 repo-hours, 645 releases; waiting 499 ms; commit 0 ms)
2026-11-08T12:10:44Z [load_day 2025-05-28] 2025-05-28 hour 8: 131552 events in 0 files, snapshot none (task 6768 ms: download 3578 ms overlapping gunzip 1042 ms, parse 4115 ms, sort 0 ms, write 0 ms, index 753 ms: 15 candidates, 70582 repo-hours, 716 releases; waiting 531 ms; commit 0 ms)
2026-11-08T12:10:45Z [load_day 2025-05-28] 2025-05-28 hour 9: 138093 events in 0 files, snapshot none (task 6817 ms: download 3841 ms overlapping gunzip 985 ms, parse 4167 ms, sort 0 ms, write 0 ms, index 688 ms: 19 candidates, 75418 repo-hours, 803 releases; waiting 490 ms; commit 0 ms)
2026-11-08T12:10:51Z [load_day 2025-05-28] 2025-05-28 hour 10: 138127 events in 0 files, snapshot none (task 6467 ms: download 3236 ms overlapping gunzip 971 ms, parse 3986 ms, sort 0 ms, write 0 ms, index 716 ms: 14 candidates, 72434 repo-hours, 783 releases; waiting 492 ms; commit 0 ms)
2026-11-08T12:10:52Z [load_day 2025-05-28] 2025-05-28 hour 11: 134270 events in 0 files, snapshot none (task 6646 ms: download 3663 ms overlapping gunzip 956 ms, parse 4071 ms, sort 0 ms, write 0 ms, index 632 ms: 13 candidates, 70177 repo-hours, 707 releases; waiting 641 ms; commit 0 ms)
2026-11-08T12:10:57Z [load_day 2025-05-28] 2025-05-28 hour 12: 132906 events in 0 files, snapshot none (task 5294 ms: download 2537 ms overlapping gunzip 772 ms, parse 3164 ms, sort 0 ms, write 0 ms, index 812 ms: 7 candidates, 82526 repo-hours, 682 releases; waiting 272 ms; commit 0 ms)
2026-11-08T12:10:58Z [load_day 2025-05-28] 2025-05-28 hour 13: 130914 events in 0 files, snapshot none (task 5682 ms: download 2901 ms overlapping gunzip 880 ms, parse 3532 ms, sort 0 ms, write 0 ms, index 700 ms: 7 candidates, 79370 repo-hours, 639 releases; waiting 306 ms; commit 0 ms)
2026-11-08T12:11:04Z [load_day 2025-05-28] 2025-05-28 hour 14: 158532 events in 0 files, snapshot none (task 6551 ms: download 3407 ms overlapping gunzip 954 ms, parse 3840 ms, sort 0 ms, write 0 ms, index 914 ms: 11 candidates, 84851 repo-hours, 915 releases; waiting 514 ms; commit 0 ms)
2026-11-08T12:11:06Z [load_day 2025-05-28] 2025-05-28 hour 15: 160989 events in 0 files, snapshot none (task 6803 ms: download 4129 ms overlapping gunzip 918 ms, parse 3685 ms, sort 0 ms, write 0 ms, index 749 ms: 7 candidates, 86101 repo-hours, 858 releases; waiting 1069 ms; commit 0 ms)
2026-11-08T12:11:12Z [load_day 2025-05-28] 2025-05-28 hour 16: 163966 events in 0 files, snapshot none (task 6958 ms: download 3489 ms overlapping gunzip 1012 ms, parse 4006 ms, sort 0 ms, write 0 ms, index 1163 ms: 7 candidates, 84344 repo-hours, 784 releases; waiting 494 ms; commit 0 ms)
2026-11-08T12:11:13Z [load_day 2025-05-28] 2025-05-28 hour 17: 159963 events in 0 files, snapshot none (task 6617 ms: download 3686 ms overlapping gunzip 1052 ms, parse 4422 ms, sort 0 ms, write 0 ms, index 601 ms: 10 candidates, 80057 repo-hours, 821 releases; waiting 204 ms; commit 0 ms)
2026-11-08T12:11:19Z [load_day 2025-05-28] 2025-05-28 hour 18: 160833 events in 0 files, snapshot none (task 7038 ms: download 3295 ms overlapping gunzip 1044 ms, parse 4606 ms, sort 0 ms, write 0 ms, index 653 ms: 12 candidates, 83919 repo-hours, 841 releases; waiting 510 ms; commit 0 ms)
2026-11-08T12:11:20Z [load_day 2025-05-28] 2025-05-28 hour 19: 159143 events in 0 files, snapshot none (task 6974 ms: download 4099 ms overlapping gunzip 1034 ms, parse 4458 ms, sort 0 ms, write 0 ms, index 655 ms: 5 candidates, 74708 repo-hours, 754 releases; waiting 527 ms; commit 0 ms)
2026-11-08T12:11:27Z [load_day 2025-05-28] 2025-05-28 hour 20: 152955 events in 0 files, snapshot none (task 6699 ms: download 3741 ms overlapping gunzip 976 ms, parse 4112 ms, sort 0 ms, write 0 ms, index 694 ms: 12 candidates, 72011 repo-hours, 751 releases; waiting 503 ms; commit 0 ms)
2026-11-08T12:11:27Z [load_day 2025-05-28] 2025-05-28 hour 21: 156339 events in 0 files, snapshot none (task 6344 ms: download 3420 ms overlapping gunzip 982 ms, parse 3850 ms, sort 0 ms, write 0 ms, index 709 ms: 6 candidates, 69891 repo-hours, 835 releases; waiting 242 ms; commit 0 ms)
2026-11-08T12:11:33Z [load_day 2025-05-28] 2025-05-28 hour 22: 142974 events in 0 files, snapshot none (task 6351 ms: download 3328 ms overlapping gunzip 863 ms, parse 3493 ms, sort 0 ms, write 0 ms, index 1105 ms: 6 candidates, 61402 repo-hours, 741 releases; waiting 513 ms; commit 0 ms)
2026-11-08T12:11:33Z [load_day 2025-05-28] 2025-05-28 hour 23: 136538 events in 0 files, snapshot none (task 5308 ms: download 2894 ms overlapping gunzip 757 ms, parse 3220 ms, sort 0 ms, write 0 ms, index 471 ms: 5 candidates, 59622 repo-hours, 751 releases; waiting 532 ms; commit 0 ms)
2026-11-08T12:11:45Z [load_day 2025-05-28] 2025-05-28: repo_hour merged from 24 files to 1 (1760884 rows, 11735 ms)
2026-11-08T12:11:48Z [load_day 2025-05-28] 2025-05-28: index committed in 14368 ms (24 + 1 + 24 files)
2026-11-08T12:11:48Z [load_day 2025-05-28] 2025-05-28: 3423778 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:11:48Z [load_day 2025-05-28] attempt 1 succeeded