orcaLog in

Runs · run 4277

load_day 2025-08-15, attempt 1 succeeded

Host
73ccef5e07c2:361647
Started
2026-11-08T13:23:45Z
Ended
2026-11-08T13:25:22Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
648 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
143.4 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4277/load_day/2025-08-15/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:23:45Z [load_day 2025-08-15] attempt 1 started
2026-11-08T13:23:46Z [load_day 2025-08-15] 2025-08-15: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:23:54Z [load_day 2025-08-15] 2025-08-15 hour 0: 144051 events in 0 files, snapshot none (task 7162 ms: download 4149 ms overlapping gunzip 1108 ms, parse 4550 ms, sort 0 ms, write 0 ms, index 596 ms: 5 candidates, 69904 repo-hours, 1123 releases; waiting 521 ms; commit 0 ms)
2026-11-08T13:23:54Z [load_day 2025-08-15] 2025-08-15 hour 1: 156114 events in 0 files, snapshot none (task 6840 ms: download 3448 ms overlapping gunzip 1010 ms, parse 4010 ms, sort 0 ms, write 0 ms, index 901 ms: 2 candidates, 86674 repo-hours, 818 releases; waiting 560 ms; commit 0 ms)
2026-11-08T13:24:01Z [load_day 2025-08-15] 2025-08-15 hour 2: 152493 events in 0 files, snapshot none (task 6830 ms: download 3722 ms overlapping gunzip 1069 ms, parse 4286 ms, sort 0 ms, write 0 ms, index 834 ms: 8 candidates, 70649 repo-hours, 937 releases; waiting 196 ms; commit 0 ms)
2026-11-08T13:24:01Z [load_day 2025-08-15] 2025-08-15 hour 3: 148340 events in 0 files, snapshot none (task 6400 ms: download 2816 ms overlapping gunzip 1019 ms, parse 4108 ms, sort 0 ms, write 0 ms, index 704 ms: 5 candidates, 61911 repo-hours, 1613 releases; waiting 182 ms; commit 0 ms)
2026-11-08T13:24:08Z [load_day 2025-08-15] 2025-08-15 hour 4: 146359 events in 0 files, snapshot none (task 6317 ms: download 3829 ms overlapping gunzip 879 ms, parse 3665 ms, sort 0 ms, write 0 ms, index 649 ms: 7 candidates, 62854 repo-hours, 1288 releases; waiting 819 ms; commit 0 ms)
2026-11-08T13:24:08Z [load_day 2025-08-15] 2025-08-15 hour 5: 144098 events in 0 files, snapshot none (task 6830 ms: download 3730 ms overlapping gunzip 911 ms, parse 3473 ms, sort 0 ms, write 0 ms, index 600 ms: 5 candidates, 60707 repo-hours, 738 releases; waiting 1539 ms; commit 0 ms)
2026-11-08T13:24:14Z [load_day 2025-08-15] 2025-08-15 hour 6: 151305 events in 0 files, snapshot none (task 5295 ms: download 3161 ms overlapping gunzip 753 ms, parse 3091 ms, sort 0 ms, write 0 ms, index 570 ms: 6 candidates, 72709 repo-hours, 862 releases; waiting 534 ms; commit 0 ms)
2026-11-08T13:24:15Z [load_day 2025-08-15] 2025-08-15 hour 7: 152378 events in 0 files, snapshot none (task 6105 ms: download 3414 ms overlapping gunzip 916 ms, parse 3699 ms, sort 0 ms, write 0 ms, index 589 ms: 6 candidates, 68552 repo-hours, 720 releases; waiting 579 ms; commit 0 ms)
2026-11-08T13:24:22Z [load_day 2025-08-15] 2025-08-15 hour 8: 151847 events in 0 files, snapshot none (task 7070 ms: download 4260 ms overlapping gunzip 1039 ms, parse 4036 ms, sort 0 ms, write 0 ms, index 965 ms: 6 candidates, 72807 repo-hours, 817 releases; waiting 638 ms; commit 0 ms)
2026-11-08T13:24:22Z [load_day 2025-08-15] 2025-08-15 hour 9: 160663 events in 0 files, snapshot none (task 6572 ms: download 3943 ms overlapping gunzip 1088 ms, parse 4017 ms, sort 0 ms, write 0 ms, index 600 ms: 4 candidates, 73158 repo-hours, 966 releases; waiting 525 ms; commit 0 ms)
2026-11-08T13:24:29Z [load_day 2025-08-15] 2025-08-15 hour 10: 157576 events in 0 files, snapshot none (task 6596 ms: download 4271 ms overlapping gunzip 1262 ms, parse 4566 ms, sort 0 ms, write 0 ms, index 557 ms: 4 candidates, 71651 repo-hours, 824 releases; waiting 20 ms; commit 0 ms)
2026-11-08T13:24:29Z [load_day 2025-08-15] 2025-08-15 hour 11: 151428 events in 0 files, snapshot none (task 5840 ms: download 3532 ms overlapping gunzip 1050 ms, parse 4055 ms, sort 0 ms, write 0 ms, index 497 ms: 6 candidates, 66063 repo-hours, 714 releases; waiting 21 ms; commit 0 ms)
2026-11-08T13:24:35Z [load_day 2025-08-15] 2025-08-15 hour 12: 168873 events in 0 files, snapshot none (task 5662 ms: download 3212 ms overlapping gunzip 933 ms, parse 3811 ms, sort 0 ms, write 0 ms, index 713 ms: 4 candidates, 92649 repo-hours, 854 releases; waiting 14 ms; commit 0 ms)
2026-11-08T13:24:35Z [load_day 2025-08-15] 2025-08-15 hour 13: 167186 events in 0 files, snapshot none (task 5407 ms: download 3034 ms overlapping gunzip 876 ms, parse 3634 ms, sort 0 ms, write 0 ms, index 656 ms: 4 candidates, 84987 repo-hours, 814 releases; waiting 26 ms; commit 0 ms)
2026-11-08T13:24:42Z [load_day 2025-08-15] 2025-08-15 hour 14: 165948 events in 0 files, snapshot none (task 5839 ms: download 3282 ms overlapping gunzip 979 ms, parse 3890 ms, sort 0 ms, write 0 ms, index 738 ms: 5 candidates, 78640 repo-hours, 930 releases; waiting 18 ms; commit 0 ms)
2026-11-08T13:24:42Z [load_day 2025-08-15] 2025-08-15 hour 15: 160405 events in 0 files, snapshot none (task 5740 ms: download 3170 ms overlapping gunzip 949 ms, parse 3921 ms, sort 0 ms, write 0 ms, index 641 ms: 7 candidates, 78094 repo-hours, 1068 releases; waiting 20 ms; commit 0 ms)
2026-11-08T13:24:50Z [load_day 2025-08-15] 2025-08-15 hour 16: 160205 events in 0 files, snapshot none (task 8086 ms: download 5360 ms overlapping gunzip 1355 ms, parse 5605 ms, sort 0 ms, write 0 ms, index 576 ms: 7 candidates, 76155 repo-hours, 937 releases; waiting 231 ms; commit 0 ms)
2026-11-08T13:24:50Z [load_day 2025-08-15] 2025-08-15 hour 17: 156156 events in 0 files, snapshot none (task 8062 ms: download 5068 ms overlapping gunzip 1369 ms, parse 5869 ms, sort 0 ms, write 0 ms, index 606 ms: 8 candidates, 70855 repo-hours, 834 releases; waiting 18 ms; commit 0 ms)
2026-11-08T13:24:59Z [load_day 2025-08-15] 2025-08-15 hour 18: 161013 events in 0 files, snapshot none (task 7825 ms: download 5362 ms overlapping gunzip 1381 ms, parse 5312 ms, sort 0 ms, write 0 ms, index 851 ms: 6 candidates, 79001 repo-hours, 882 releases; waiting 47 ms; commit 0 ms)
2026-11-08T13:24:59Z [load_day 2025-08-15] 2025-08-15 hour 19: 155103 events in 0 files, snapshot none (task 7177 ms: download 4560 ms overlapping gunzip 1287 ms, parse 5058 ms, sort 0 ms, write 0 ms, index 594 ms: 7 candidates, 65595 repo-hours, 763 releases; waiting 32 ms; commit 0 ms)
2026-11-08T13:25:05Z [load_day 2025-08-15] 2025-08-15 hour 20: 153517 events in 0 files, snapshot none (task 6223 ms: download 3792 ms overlapping gunzip 1111 ms, parse 4296 ms, sort 0 ms, write 0 ms, index 594 ms: 5 candidates, 65266 repo-hours, 784 releases; waiting 16 ms; commit 0 ms)
2026-11-08T13:25:06Z [load_day 2025-08-15] 2025-08-15 hour 21: 147362 events in 0 files, snapshot none (task 6525 ms: download 4139 ms overlapping gunzip 1101 ms, parse 4507 ms, sort 0 ms, write 0 ms, index 691 ms: 9 candidates, 60980 repo-hours, 790 releases; waiting 19 ms; commit 0 ms)
2026-11-08T13:25:12Z [load_day 2025-08-15] 2025-08-15 hour 22: 143892 events in 0 files, snapshot none (task 5821 ms: download 3494 ms overlapping gunzip 1065 ms, parse 4004 ms, sort 0 ms, write 0 ms, index 501 ms: 6 candidates, 56717 repo-hours, 801 releases; waiting 21 ms; commit 0 ms)
2026-11-08T13:25:12Z [load_day 2025-08-15] 2025-08-15 hour 23: 139087 events in 0 files, snapshot none (task 5502 ms: download 3122 ms overlapping gunzip 1031 ms, parse 3658 ms, sort 0 ms, write 0 ms, index 581 ms: 2 candidates, 52690 repo-hours, 794 releases; waiting 20 ms; commit 0 ms)
2026-11-08T13:25:20Z [load_day 2025-08-15] 2025-08-15: repo_hour merged from 24 files to 1 (1699268 rows, 7949 ms)
2026-11-08T13:25:22Z [load_day 2025-08-15] 2025-08-15: index committed in 10507 ms (24 + 1 + 24 files)
2026-11-08T13:25:22Z [load_day 2025-08-15] 2025-08-15: 3695399 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:25:22Z [load_day 2025-08-15] attempt 1 succeeded