orcaLog in

Runs · run 4181

load_day 2025-07-23, attempt 1 succeeded

Host
73ccef5e07c2:347340
Started
2026-11-08T13:03:12Z
Ended
2026-11-08T13:05:01Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
689 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
151.8 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4181/load_day/2025-07-23/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:03:12Z [load_day 2025-07-23] attempt 1 started
2026-11-08T13:03:13Z [load_day 2025-07-23] 2025-07-23: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:03:21Z [load_day 2025-07-23] 2025-07-23 hour 0: 145246 events in 0 files, snapshot none (task 7150 ms: download 4204 ms overlapping gunzip 1087 ms, parse 4719 ms, sort 0 ms, write 0 ms, index 598 ms: 4 candidates, 65962 repo-hours, 1066 releases; waiting 502 ms; commit 0 ms)
2026-11-08T13:03:21Z [load_day 2025-07-23] 2025-07-23 hour 1: 156147 events in 0 files, snapshot none (task 6951 ms: download 3689 ms overlapping gunzip 1012 ms, parse 4603 ms, sort 0 ms, write 0 ms, index 603 ms: 3 candidates, 86169 repo-hours, 786 releases; waiting 506 ms; commit 0 ms)
2026-11-08T13:03:28Z [load_day 2025-07-23] 2025-07-23 hour 2: 148458 events in 0 files, snapshot none (task 6444 ms: download 3470 ms overlapping gunzip 1010 ms, parse 4004 ms, sort 0 ms, write 0 ms, index 771 ms: 4 candidates, 74537 repo-hours, 845 releases; waiting 336 ms; commit 0 ms)
2026-11-08T13:03:28Z [load_day 2025-07-23] 2025-07-23 hour 3: 150384 events in 0 files, snapshot none (task 6771 ms: download 3814 ms overlapping gunzip 1033 ms, parse 4271 ms, sort 0 ms, write 0 ms, index 640 ms: 5 candidates, 64286 repo-hours, 899 releases; waiting 560 ms; commit 0 ms)
2026-11-08T13:03:35Z [load_day 2025-07-23] 2025-07-23 hour 4: 147839 events in 0 files, snapshot none (task 6452 ms: download 3832 ms overlapping gunzip 960 ms, parse 4120 ms, sort 0 ms, write 0 ms, index 587 ms: 2 candidates, 66345 repo-hours, 1794 releases; waiting 497 ms; commit 0 ms)
2026-11-08T13:03:35Z [load_day 2025-07-23] 2025-07-23 hour 5: 153770 events in 0 files, snapshot none (task 6490 ms: download 3797 ms overlapping gunzip 1040 ms, parse 4111 ms, sort 0 ms, write 0 ms, index 520 ms: 4 candidates, 66634 repo-hours, 716 releases; waiting 487 ms; commit 0 ms)
2026-11-08T13:03:43Z [load_day 2025-07-23] 2025-07-23 hour 6: 161269 events in 0 files, snapshot none (task 7726 ms: download 4320 ms overlapping gunzip 1155 ms, parse 4831 ms, sort 0 ms, write 0 ms, index 887 ms: 6 candidates, 79313 repo-hours, 869 releases; waiting 530 ms; commit 0 ms)
2026-11-08T13:03:43Z [load_day 2025-07-23] 2025-07-23 hour 7: 157708 events in 0 files, snapshot none (task 8107 ms: download 5067 ms overlapping gunzip 1283 ms, parse 5183 ms, sort 0 ms, write 0 ms, index 693 ms: 3 candidates, 73847 repo-hours, 786 releases; waiting 588 ms; commit 0 ms)
2026-11-08T13:03:52Z [load_day 2025-07-23] 2025-07-23 hour 8: 159943 events in 0 files, snapshot none (task 8682 ms: download 5531 ms overlapping gunzip 1360 ms, parse 5726 ms, sort 0 ms, write 0 ms, index 777 ms: 8 candidates, 78811 repo-hours, 858 releases; waiting 519 ms; commit 0 ms)
2026-11-08T13:03:52Z [load_day 2025-07-23] 2025-07-23 hour 9: 163165 events in 0 files, snapshot none (task 8424 ms: download 5834 ms overlapping gunzip 1405 ms, parse 5646 ms, sort 0 ms, write 0 ms, index 663 ms: 3 candidates, 81020 repo-hours, 900 releases; waiting 457 ms; commit 0 ms)
2026-11-08T13:04:01Z [load_day 2025-07-23] 2025-07-23 hour 10: 160947 events in 0 files, snapshot none (task 8274 ms: download 5584 ms overlapping gunzip 1339 ms, parse 5381 ms, sort 0 ms, write 0 ms, index 626 ms: 5 candidates, 77677 repo-hours, 825 releases; waiting 581 ms; commit 0 ms)
2026-11-08T13:04:01Z [load_day 2025-07-23] 2025-07-23 hour 11: 163329 events in 0 files, snapshot none (task 8083 ms: download 5273 ms overlapping gunzip 1228 ms, parse 5230 ms, sort 0 ms, write 0 ms, index 664 ms: 7 candidates, 75971 repo-hours, 893 releases; waiting 496 ms; commit 0 ms)
2026-11-08T13:04:08Z [load_day 2025-07-23] 2025-07-23 hour 12: 163714 events in 0 files, snapshot none (task 6230 ms: download 3664 ms overlapping gunzip 892 ms, parse 3832 ms, sort 0 ms, write 0 ms, index 679 ms: 7 candidates, 94244 repo-hours, 921 releases; waiting 520 ms; commit 0 ms)
2026-11-08T13:04:08Z [load_day 2025-07-23] 2025-07-23 hour 13: 169707 events in 0 files, snapshot none (task 6993 ms: download 4235 ms overlapping gunzip 1033 ms, parse 4264 ms, sort 0 ms, write 0 ms, index 706 ms: 5 candidates, 92836 repo-hours, 884 releases; waiting 517 ms; commit 0 ms)
2026-11-08T13:04:15Z [load_day 2025-07-23] 2025-07-23 hour 14: 165497 events in 0 files, snapshot none (task 6726 ms: download 4424 ms overlapping gunzip 989 ms, parse 4060 ms, sort 0 ms, write 0 ms, index 661 ms: 7 candidates, 84527 repo-hours, 1035 releases; waiting 741 ms; commit 0 ms)
2026-11-08T13:04:15Z [load_day 2025-07-23] 2025-07-23 hour 15: 164238 events in 0 files, snapshot none (task 6700 ms: download 4285 ms overlapping gunzip 1001 ms, parse 4097 ms, sort 0 ms, write 0 ms, index 688 ms: 11 candidates, 84507 repo-hours, 1093 releases; waiting 653 ms; commit 0 ms)
2026-11-08T13:04:23Z [load_day 2025-07-23] 2025-07-23 hour 16: 162942 events in 0 files, snapshot none (task 7401 ms: download 4234 ms overlapping gunzip 1045 ms, parse 4401 ms, sort 0 ms, write 0 ms, index 1096 ms: 12 candidates, 81599 repo-hours, 904 releases; waiting 499 ms; commit 0 ms)
2026-11-08T13:04:24Z [load_day 2025-07-23] 2025-07-23 hour 17: 162092 events in 0 files, snapshot none (task 7745 ms: download 4547 ms overlapping gunzip 1213 ms, parse 4695 ms, sort 0 ms, write 0 ms, index 1004 ms: 9 candidates, 78185 repo-hours, 854 releases; waiting 593 ms; commit 0 ms)
2026-11-08T13:04:32Z [load_day 2025-07-23] 2025-07-23 hour 18: 165495 events in 0 files, snapshot none (task 8421 ms: download 5513 ms overlapping gunzip 1271 ms, parse 5379 ms, sort 0 ms, write 0 ms, index 975 ms: 9 candidates, 82545 repo-hours, 891 releases; waiting 500 ms; commit 0 ms)
2026-11-08T13:04:32Z [load_day 2025-07-23] 2025-07-23 hour 19: 158769 events in 0 files, snapshot none (task 8113 ms: download 5014 ms overlapping gunzip 1260 ms, parse 5148 ms, sort 0 ms, write 0 ms, index 897 ms: 6 candidates, 70383 repo-hours, 782 releases; waiting 459 ms; commit 0 ms)
2026-11-08T13:04:40Z [load_day 2025-07-23] 2025-07-23 hour 20: 154437 events in 0 files, snapshot none (task 7281 ms: download 4200 ms overlapping gunzip 1072 ms, parse 4475 ms, sort 0 ms, write 0 ms, index 874 ms: 11 candidates, 69662 repo-hours, 809 releases; waiting 556 ms; commit 0 ms)
2026-11-08T13:04:40Z [load_day 2025-07-23] 2025-07-23 hour 21: 152447 events in 0 files, snapshot none (task 7196 ms: download 4337 ms overlapping gunzip 1094 ms, parse 4653 ms, sort 0 ms, write 0 ms, index 629 ms: 5 candidates, 65771 repo-hours, 963 releases; waiting 511 ms; commit 0 ms)
2026-11-08T13:04:48Z [load_day 2025-07-23] 2025-07-23 hour 22: 146039 events in 0 files, snapshot none (task 7394 ms: download 4208 ms overlapping gunzip 1119 ms, parse 4577 ms, sort 0 ms, write 0 ms, index 727 ms: 11 candidates, 59690 repo-hours, 985 releases; waiting 634 ms; commit 0 ms)
2026-11-08T13:04:48Z [load_day 2025-07-23] 2025-07-23 hour 23: 140564 events in 0 files, snapshot none (task 7582 ms: download 3870 ms overlapping gunzip 1125 ms, parse 4647 ms, sort 0 ms, write 0 ms, index 936 ms: 8 candidates, 56347 repo-hours, 1023 releases; waiting 499 ms; commit 0 ms)
2026-11-08T13:04:57Z [load_day 2025-07-23] 2025-07-23: repo_hour merged from 24 files to 1 (1810868 rows, 8838 ms)
2026-11-08T13:05:01Z [load_day 2025-07-23] 2025-07-23: index committed in 12870 ms (24 + 1 + 24 files)
2026-11-08T13:05:01Z [load_day 2025-07-23] 2025-07-23: 3774146 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:05:01Z [load_day 2025-07-23] attempt 1 succeeded