orcaLog in

Runs · run 4147

load_day 2025-07-14, attempt 1 succeeded

Host
73ccef5e07c2:342459
Started
2026-11-08T12:55:39Z
Ended
2026-11-08T12:57:26Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
712 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
156.4 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4147/load_day/2025-07-14/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:55:39Z [load_day 2025-07-14] attempt 1 started
2026-11-08T12:55:40Z [load_day 2025-07-14] 2025-07-14: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:55:47Z [load_day 2025-07-14] 2025-07-14 hour 0: 143620 events in 0 files, snapshot none (task 6381 ms: download 3870 ms overlapping gunzip 1051 ms, parse 4120 ms, sort 0 ms, write 0 ms, index 466 ms: 6 candidates, 62210 repo-hours, 1176 releases; waiting 247 ms; commit 0 ms)
2026-11-08T12:55:48Z [load_day 2025-07-14] 2025-07-14 hour 1: 151096 events in 0 files, snapshot none (task 6599 ms: download 3894 ms overlapping gunzip 1012 ms, parse 4198 ms, sort 0 ms, write 0 ms, index 606 ms: 6 candidates, 83779 repo-hours, 692 releases; waiting 501 ms; commit 0 ms)
2026-11-08T12:55:54Z [load_day 2025-07-14] 2025-07-14 hour 2: 148807 events in 0 files, snapshot none (task 6235 ms: download 3754 ms overlapping gunzip 983 ms, parse 3947 ms, sort 0 ms, write 0 ms, index 558 ms: 7 candidates, 73587 repo-hours, 770 releases; waiting 497 ms; commit 0 ms)
2026-11-08T12:55:54Z [load_day 2025-07-14] 2025-07-14 hour 3: 148257 events in 0 files, snapshot none (task 6266 ms: download 3863 ms overlapping gunzip 1002 ms, parse 3945 ms, sort 0 ms, write 0 ms, index 544 ms: 3 candidates, 66110 repo-hours, 868 releases; waiting 419 ms; commit 0 ms)
2026-11-08T12:56:01Z [load_day 2025-07-14] 2025-07-14 hour 4: 148607 events in 0 files, snapshot none (task 5981 ms: download 3748 ms overlapping gunzip 920 ms, parse 3825 ms, sort 0 ms, write 0 ms, index 461 ms: 3 candidates, 65252 repo-hours, 1905 releases; waiting 514 ms; commit 0 ms)
2026-11-08T12:56:02Z [load_day 2025-07-14] 2025-07-14 hour 5: 152322 events in 0 files, snapshot none (task 6868 ms: download 4477 ms overlapping gunzip 1155 ms, parse 4364 ms, sort 0 ms, write 0 ms, index 615 ms: 10 candidates, 66439 repo-hours, 641 releases; waiting 459 ms; commit 0 ms)
2026-11-08T12:56:07Z [load_day 2025-07-14] 2025-07-14 hour 6: 163852 events in 0 files, snapshot none (task 6343 ms: download 3902 ms overlapping gunzip 1032 ms, parse 4224 ms, sort 0 ms, write 0 ms, index 630 ms: 6 candidates, 80398 repo-hours, 841 releases; waiting 179 ms; commit 0 ms)
2026-11-08T12:56:09Z [load_day 2025-07-14] 2025-07-14 hour 7: 164164 events in 0 files, snapshot none (task 6609 ms: download 3677 ms overlapping gunzip 1064 ms, parse 3958 ms, sort 0 ms, write 0 ms, index 899 ms: 5 candidates, 77303 repo-hours, 760 releases; waiting 401 ms; commit 0 ms)
2026-11-08T12:56:15Z [load_day 2025-07-14] 2025-07-14 hour 8: 160113 events in 0 files, snapshot none (task 7195 ms: download 3973 ms overlapping gunzip 1079 ms, parse 4404 ms, sort 0 ms, write 0 ms, index 865 ms: 7 candidates, 79906 repo-hours, 840 releases; waiting 555 ms; commit 0 ms)
2026-11-08T12:56:17Z [load_day 2025-07-14] 2025-07-14 hour 9: 164199 events in 0 files, snapshot none (task 7267 ms: download 5653 ms overlapping gunzip 1173 ms, parse 4565 ms, sort 0 ms, write 0 ms, index 621 ms: 4 candidates, 80278 repo-hours, 909 releases; waiting 552 ms; commit 0 ms)
2026-11-08T12:56:24Z [load_day 2025-07-14] 2025-07-14 hour 10: 159646 events in 0 files, snapshot none (task 7835 ms: download 5421 ms overlapping gunzip 918 ms, parse 3776 ms, sort 0 ms, write 0 ms, index 582 ms: 10 candidates, 77649 repo-hours, 1006 releases; waiting 2228 ms; commit 0 ms)
2026-11-08T12:56:24Z [load_day 2025-07-14] 2025-07-14 hour 11: 163768 events in 0 files, snapshot none (task 6715 ms: download 4274 ms overlapping gunzip 1018 ms, parse 3991 ms, sort 0 ms, write 0 ms, index 556 ms: 13 candidates, 76342 repo-hours, 858 releases; waiting 763 ms; commit 0 ms)
2026-11-08T12:56:32Z [load_day 2025-07-14] 2025-07-14 hour 12: 167074 events in 0 files, snapshot none (task 7919 ms: download 4549 ms overlapping gunzip 1041 ms, parse 4110 ms, sort 0 ms, write 0 ms, index 1409 ms: 8 candidates, 95811 repo-hours, 852 releases; waiting 1051 ms; commit 0 ms)
2026-11-08T12:56:33Z [load_day 2025-07-14] 2025-07-14 hour 13: 168361 events in 0 files, snapshot none (task 8037 ms: download 4152 ms overlapping gunzip 1186 ms, parse 4901 ms, sort 0 ms, write 0 ms, index 1158 ms: 10 candidates, 93153 repo-hours, 822 releases; waiting 498 ms; commit 0 ms)
2026-11-08T12:56:41Z [load_day 2025-07-14] 2025-07-14 hour 14: 164947 events in 0 files, snapshot none (task 7889 ms: download 4224 ms overlapping gunzip 1200 ms, parse 4758 ms, sort 0 ms, write 0 ms, index 1268 ms: 11 candidates, 82907 repo-hours, 901 releases; waiting 342 ms; commit 0 ms)
2026-11-08T12:56:43Z [load_day 2025-07-14] 2025-07-14 hour 15: 168883 events in 0 files, snapshot none (task 9709 ms: download 6451 ms overlapping gunzip 1246 ms, parse 5365 ms, sort 0 ms, write 0 ms, index 945 ms: 12 candidates, 86321 repo-hours, 936 releases; waiting 1661 ms; commit 0 ms)
2026-11-08T12:56:48Z [load_day 2025-07-14] 2025-07-14 hour 16: 160297 events in 0 files, snapshot none (task 7133 ms: download 3453 ms overlapping gunzip 1121 ms, parse 4584 ms, sort 0 ms, write 0 ms, index 846 ms: 10 candidates, 80494 repo-hours, 993 releases; waiting 203 ms; commit 0 ms)
2026-11-08T12:56:51Z [load_day 2025-07-14] 2025-07-14 hour 17: 164992 events in 0 files, snapshot none (task 6970 ms: download 4385 ms overlapping gunzip 1115 ms, parse 4491 ms, sort 0 ms, write 0 ms, index 687 ms: 21 candidates, 79201 repo-hours, 835 releases; waiting 371 ms; commit 0 ms)
2026-11-08T12:56:57Z [load_day 2025-07-14] 2025-07-14 hour 18: 160869 events in 0 files, snapshot none (task 8052 ms: download 3913 ms overlapping gunzip 1321 ms, parse 5214 ms, sort 0 ms, write 0 ms, index 709 ms: 8 candidates, 82197 repo-hours, 1038 releases; waiting 480 ms; commit 0 ms)
2026-11-08T12:56:59Z [load_day 2025-07-14] 2025-07-14 hour 19: 156680 events in 0 files, snapshot none (task 7123 ms: download 4559 ms overlapping gunzip 1268 ms, parse 4710 ms, sort 0 ms, write 0 ms, index 661 ms: 10 candidates, 71590 repo-hours, 854 releases; waiting 253 ms; commit 0 ms)
2026-11-08T12:57:05Z [load_day 2025-07-14] 2025-07-14 hour 20: 160282 events in 0 files, snapshot none (task 7660 ms: download 3970 ms overlapping gunzip 1234 ms, parse 5037 ms, sort 0 ms, write 0 ms, index 632 ms: 6 candidates, 75096 repo-hours, 847 releases; waiting 531 ms; commit 0 ms)
2026-11-08T12:57:06Z [load_day 2025-07-14] 2025-07-14 hour 21: 155471 events in 0 files, snapshot none (task 7146 ms: download 4700 ms overlapping gunzip 1163 ms, parse 4546 ms, sort 0 ms, write 0 ms, index 588 ms: 12 candidates, 72139 repo-hours, 1005 releases; waiting 601 ms; commit 0 ms)
2026-11-08T12:57:13Z [load_day 2025-07-14] 2025-07-14 hour 22: 146527 events in 0 files, snapshot none (task 7481 ms: download 4487 ms overlapping gunzip 1145 ms, parse 4436 ms, sort 0 ms, write 0 ms, index 607 ms: 4 candidates, 65836 repo-hours, 909 releases; waiting 900 ms; commit 0 ms)
2026-11-08T12:57:14Z [load_day 2025-07-14] 2025-07-14 hour 23: 149468 events in 0 files, snapshot none (task 7046 ms: download 4495 ms overlapping gunzip 1153 ms, parse 4563 ms, sort 0 ms, write 0 ms, index 502 ms: 8 candidates, 66390 repo-hours, 1044 releases; waiting 540 ms; commit 0 ms)
2026-11-08T12:57:23Z [load_day 2025-07-14] 2025-07-14: repo_hour merged from 24 files to 1 (1840388 rows, 8709 ms)
2026-11-08T12:57:26Z [load_day 2025-07-14] 2025-07-14: index committed in 11670 ms (24 + 1 + 24 files)
2026-11-08T12:57:26Z [load_day 2025-07-14] 2025-07-14: 3792302 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:57:26Z [load_day 2025-07-14] attempt 1 succeeded