orcaLog in

Runs · run 4104

load_day 2025-07-03, attempt 1 succeeded

Host
73ccef5e07c2:336672
Started
2026-11-08T12:47:00Z
Ended
2026-11-08T12:48:40Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
698 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
142.3 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4104/load_day/2025-07-03/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:47:00Z [load_day 2025-07-03] attempt 1 started
2026-11-08T12:47:01Z [load_day 2025-07-03] 2025-07-03: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:47:08Z [load_day 2025-07-03] 2025-07-03 hour 0: 147449 events in 0 files, snapshot none (task 6221 ms: download 3623 ms overlapping gunzip 957 ms, parse 3707 ms, sort 0 ms, write 0 ms, index 652 ms: 12 candidates, 73768 repo-hours, 1140 releases; waiting 615 ms; commit 0 ms)
2026-11-08T12:47:08Z [load_day 2025-07-03] 2025-07-03 hour 1: 150886 events in 0 files, snapshot none (task 5351 ms: download 2606 ms overlapping gunzip 794 ms, parse 3371 ms, sort 0 ms, write 0 ms, index 712 ms: 5 candidates, 87534 repo-hours, 670 releases; waiting 181 ms; commit 0 ms)
2026-11-08T12:47:15Z [load_day 2025-07-03] 2025-07-03 hour 2: 147492 events in 0 files, snapshot none (task 7123 ms: download 3393 ms overlapping gunzip 1110 ms, parse 4280 ms, sort 0 ms, write 0 ms, index 984 ms: 8 candidates, 73935 repo-hours, 740 releases; waiting 446 ms; commit 0 ms)
2026-11-08T12:47:19Z [load_day 2025-07-03] 2025-07-03 hour 3: 148819 events in 0 files, snapshot none (task 10785 ms: download 7283 ms overlapping gunzip 1137 ms, parse 4898 ms, sort 0 ms, write 0 ms, index 674 ms: 2 candidates, 69944 repo-hours, 1363 releases; waiting 3802 ms; commit 0 ms)
2026-11-08T12:47:22Z [load_day 2025-07-03] 2025-07-03 hour 4: 143065 events in 0 files, snapshot none (task 5925 ms: download 3155 ms overlapping gunzip 904 ms, parse 3569 ms, sort 0 ms, write 0 ms, index 631 ms: 7 candidates, 65976 repo-hours, 1353 releases; waiting 506 ms; commit 0 ms)
2026-11-08T12:47:26Z [load_day 2025-07-03] 2025-07-03 hour 5: 149262 events in 0 files, snapshot none (task 6018 ms: download 4211 ms overlapping gunzip 931 ms, parse 3586 ms, sort 0 ms, write 0 ms, index 714 ms: 11 candidates, 67982 repo-hours, 658 releases; waiting 497 ms; commit 0 ms)
2026-11-08T12:47:30Z [load_day 2025-07-03] 2025-07-03 hour 6: 158863 events in 0 files, snapshot none (task 6976 ms: download 3639 ms overlapping gunzip 983 ms, parse 4110 ms, sort 0 ms, write 0 ms, index 1078 ms: 7 candidates, 79612 repo-hours, 902 releases; waiting 510 ms; commit 0 ms)
2026-11-08T12:47:33Z [load_day 2025-07-03] 2025-07-03 hour 7: 160097 events in 0 files, snapshot none (task 7052 ms: download 3642 ms overlapping gunzip 1071 ms, parse 4443 ms, sort 0 ms, write 0 ms, index 1098 ms: 3 candidates, 77638 repo-hours, 866 releases; waiting 194 ms; commit 0 ms)
2026-11-08T12:47:38Z [load_day 2025-07-03] 2025-07-03 hour 8: 159303 events in 0 files, snapshot none (task 7795 ms: download 4018 ms overlapping gunzip 1184 ms, parse 4877 ms, sort 0 ms, write 0 ms, index 933 ms: 5 candidates, 79483 repo-hours, 861 releases; waiting 512 ms; commit 0 ms)
2026-11-08T12:47:40Z [load_day 2025-07-03] 2025-07-03 hour 9: 160330 events in 0 files, snapshot none (task 6496 ms: download 3910 ms overlapping gunzip 933 ms, parse 4045 ms, sort 0 ms, write 0 ms, index 633 ms: 10 candidates, 81107 repo-hours, 959 releases; waiting 514 ms; commit 0 ms)
2026-11-08T12:47:44Z [load_day 2025-07-03] 2025-07-03 hour 10: 157932 events in 0 files, snapshot none (task 5598 ms: download 3282 ms overlapping gunzip 821 ms, parse 3344 ms, sort 0 ms, write 0 ms, index 812 ms: 7 candidates, 78262 repo-hours, 810 releases; waiting 417 ms; commit 0 ms)
2026-11-08T12:47:46Z [load_day 2025-07-03] 2025-07-03 hour 11: 160913 events in 0 files, snapshot none (task 5271 ms: download 2896 ms overlapping gunzip 819 ms, parse 3360 ms, sort 0 ms, write 0 ms, index 542 ms: 6 candidates, 77249 repo-hours, 812 releases; waiting 279 ms; commit 0 ms)
2026-11-08T12:47:50Z [load_day 2025-07-03] 2025-07-03 hour 12: 165557 events in 0 files, snapshot none (task 5478 ms: download 3032 ms overlapping gunzip 763 ms, parse 3198 ms, sort 0 ms, write 0 ms, index 703 ms: 12 candidates, 95912 repo-hours, 890 releases; waiting 549 ms; commit 0 ms)
2026-11-08T12:47:52Z [load_day 2025-07-03] 2025-07-03 hour 13: 161367 events in 0 files, snapshot none (task 5541 ms: download 3103 ms overlapping gunzip 773 ms, parse 3189 ms, sort 0 ms, write 0 ms, index 704 ms: 9 candidates, 90522 repo-hours, 855 releases; waiting 522 ms; commit 0 ms)
2026-11-08T12:47:58Z [load_day 2025-07-03] 2025-07-03 hour 14: 160498 events in 0 files, snapshot none (task 6790 ms: download 3409 ms overlapping gunzip 1057 ms, parse 4289 ms, sort 0 ms, write 0 ms, index 722 ms: 6 candidates, 81796 repo-hours, 932 releases; waiting 396 ms; commit 0 ms)
2026-11-08T12:47:59Z [load_day 2025-07-03] 2025-07-03 hour 15: 160772 events in 0 files, snapshot none (task 6571 ms: download 4201 ms overlapping gunzip 1050 ms, parse 4349 ms, sort 0 ms, write 0 ms, index 589 ms: 11 candidates, 83039 repo-hours, 857 releases; waiting 295 ms; commit 0 ms)
2026-11-08T12:48:05Z [load_day 2025-07-03] 2025-07-03 hour 16: 165618 events in 0 files, snapshot none (task 7243 ms: download 4006 ms overlapping gunzip 1067 ms, parse 4421 ms, sort 0 ms, write 0 ms, index 751 ms: 12 candidates, 82452 repo-hours, 818 releases; waiting 745 ms; commit 0 ms)
2026-11-08T12:48:07Z [load_day 2025-07-03] 2025-07-03 hour 17: 163034 events in 0 files, snapshot none (task 6691 ms: download 4234 ms overlapping gunzip 989 ms, parse 4264 ms, sort 0 ms, write 0 ms, index 572 ms: 9 candidates, 75442 repo-hours, 783 releases; waiting 559 ms; commit 0 ms)
2026-11-08T12:48:13Z [load_day 2025-07-03] 2025-07-03 hour 18: 161062 events in 0 files, snapshot none (task 6852 ms: download 4172 ms overlapping gunzip 1065 ms, parse 4358 ms, sort 0 ms, write 0 ms, index 608 ms: 13 candidates, 82050 repo-hours, 837 releases; waiting 560 ms; commit 0 ms)
2026-11-08T12:48:14Z [load_day 2025-07-03] 2025-07-03 hour 19: 155109 events in 0 files, snapshot none (task 6403 ms: download 3739 ms overlapping gunzip 958 ms, parse 4039 ms, sort 0 ms, write 0 ms, index 536 ms: 14 candidates, 69356 repo-hours, 836 releases; waiting 520 ms; commit 0 ms)
2026-11-08T12:48:20Z [load_day 2025-07-03] 2025-07-03 hour 20: 154513 events in 0 files, snapshot none (task 7327 ms: download 4689 ms overlapping gunzip 1124 ms, parse 4793 ms, sort 0 ms, write 0 ms, index 689 ms: 3 candidates, 70224 repo-hours, 907 releases; waiting 504 ms; commit 0 ms)
2026-11-08T12:48:21Z [load_day 2025-07-03] 2025-07-03 hour 21: 145975 events in 0 files, snapshot none (task 6822 ms: download 4047 ms overlapping gunzip 954 ms, parse 4155 ms, sort 0 ms, write 0 ms, index 846 ms: 9 candidates, 65715 repo-hours, 863 releases; waiting 527 ms; commit 0 ms)
2026-11-08T12:48:28Z [load_day 2025-07-03] 2025-07-03 hour 22: 144466 events in 0 files, snapshot none (task 7183 ms: download 4486 ms overlapping gunzip 1088 ms, parse 4765 ms, sort 0 ms, write 0 ms, index 531 ms: 10 candidates, 59204 repo-hours, 910 releases; waiting 498 ms; commit 0 ms)
2026-11-08T12:48:28Z [load_day 2025-07-03] 2025-07-03 hour 23: 136458 events in 0 files, snapshot none (task 6699 ms: download 3757 ms overlapping gunzip 1109 ms, parse 4558 ms, sort 0 ms, write 0 ms, index 443 ms: 4 candidates, 55999 repo-hours, 950 releases; waiting 212 ms; commit 0 ms)
2026-11-08T12:48:38Z [load_day 2025-07-03] 2025-07-03: repo_hour merged from 24 files to 1 (1824201 rows, 9145 ms)
2026-11-08T12:48:40Z [load_day 2025-07-03] 2025-07-03: index committed in 11931 ms (24 + 1 + 24 files)
2026-11-08T12:48:40Z [load_day 2025-07-03] 2025-07-03: 3718840 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:48:40Z [load_day 2025-07-03] attempt 1 succeeded