orcaLog in

Runs · run 3474

load_day 2025-01-24, attempt 1 succeeded

Host
73ccef5e07c2:243111
Started
2026-11-08T09:58:53Z
Ended
2026-11-08T10:00:51Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
726 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
191.0 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3474/load_day/2025-01-24/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:58:53Z [load_day 2025-01-24] attempt 1 started
2026-11-08T09:58:54Z [load_day 2025-01-24] 2025-01-24: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:59:03Z [load_day 2025-01-24] 2025-01-24 hour 0: 203619 events in 0 files, snapshot none (task 8415 ms: download 5454 ms overlapping gunzip 1304 ms, parse 6079 ms, sort 0 ms, write 0 ms, index 796 ms: 11 candidates, 95233 repo-hours, 1369 releases; waiting 14 ms; commit 0 ms)
2026-11-08T09:59:03Z [load_day 2025-01-24] 2025-01-24 hour 1: 215981 events in 0 files, snapshot none (task 8225 ms: download 4711 ms overlapping gunzip 1272 ms, parse 5822 ms, sort 0 ms, write 0 ms, index 908 ms: 15 candidates, 110559 repo-hours, 967 releases; waiting 12 ms; commit 0 ms)
2026-11-08T09:59:10Z [load_day 2025-01-24] 2025-01-24 hour 2: 190812 events in 0 files, snapshot none (task 6400 ms: download 3156 ms overlapping gunzip 1088 ms, parse 4187 ms, sort 0 ms, write 0 ms, index 886 ms: 11 candidates, 79905 repo-hours, 824 releases; waiting 20 ms; commit 0 ms)
2026-11-08T09:59:11Z [load_day 2025-01-24] 2025-01-24 hour 3: 202249 events in 0 files, snapshot none (task 7166 ms: download 3892 ms overlapping gunzip 1186 ms, parse 4975 ms, sort 0 ms, write 0 ms, index 757 ms: 7 candidates, 78252 repo-hours, 3834 releases; waiting 26 ms; commit 0 ms)
2026-11-08T09:59:17Z [load_day 2025-01-24] 2025-01-24 hour 4: 187487 events in 0 files, snapshot none (task 6284 ms: download 3617 ms overlapping gunzip 1010 ms, parse 4427 ms, sort 0 ms, write 0 ms, index 646 ms: 6 candidates, 66665 repo-hours, 732 releases; waiting 5 ms; commit 0 ms)
2026-11-08T09:59:19Z [load_day 2025-01-24] 2025-01-24 hour 5: 193720 events in 0 files, snapshot none (task 7036 ms: download 3841 ms overlapping gunzip 1099 ms, parse 4790 ms, sort 0 ms, write 0 ms, index 921 ms: 4 candidates, 70968 repo-hours, 804 releases; waiting 11 ms; commit 0 ms)
2026-11-08T09:59:25Z [load_day 2025-01-24] 2025-01-24 hour 6: 212906 events in 0 files, snapshot none (task 8154 ms: download 5425 ms overlapping gunzip 1362 ms, parse 5827 ms, sort 0 ms, write 0 ms, index 747 ms: 9 candidates, 92890 repo-hours, 930 releases; waiting 15 ms; commit 0 ms)
2026-11-08T09:59:26Z [load_day 2025-01-24] 2025-01-24 hour 7: 211792 events in 0 files, snapshot none (task 6826 ms: download 4367 ms overlapping gunzip 1117 ms, parse 4848 ms, sort 0 ms, write 0 ms, index 638 ms: 3 candidates, 80314 repo-hours, 919 releases; waiting 18 ms; commit 0 ms)
2026-11-08T09:59:32Z [load_day 2025-01-24] 2025-01-24 hour 8: 223148 events in 0 files, snapshot none (task 6452 ms: download 4041 ms overlapping gunzip 1092 ms, parse 4450 ms, sort 0 ms, write 0 ms, index 694 ms: 7 candidates, 89195 repo-hours, 929 releases; waiting 18 ms; commit 0 ms)
2026-11-08T09:59:34Z [load_day 2025-01-24] 2025-01-24 hour 9: 241535 events in 0 files, snapshot none (task 7120 ms: download 4752 ms overlapping gunzip 1230 ms, parse 4990 ms, sort 0 ms, write 0 ms, index 681 ms: 4 candidates, 98609 repo-hours, 1276 releases; waiting 20 ms; commit 0 ms)
2026-11-08T09:59:40Z [load_day 2025-01-24] 2025-01-24 hour 10: 232972 events in 0 files, snapshot none (task 7195 ms: download 4642 ms overlapping gunzip 1107 ms, parse 4608 ms, sort 0 ms, write 0 ms, index 723 ms: 7 candidates, 93763 repo-hours, 1280 releases; waiting 528 ms; commit 0 ms)
2026-11-08T09:59:41Z [load_day 2025-01-24] 2025-01-24 hour 11: 227760 events in 0 files, snapshot none (task 6994 ms: download 4497 ms overlapping gunzip 1070 ms, parse 4463 ms, sort 0 ms, write 0 ms, index 688 ms: 7 candidates, 86118 repo-hours, 1179 releases; waiting 510 ms; commit 0 ms)
2026-11-08T09:59:51Z [load_day 2025-01-24] 2025-01-24 hour 12: 272313 events in 0 files, snapshot none (task 10333 ms: download 6891 ms overlapping gunzip 1511 ms, parse 6560 ms, sort 0 ms, write 0 ms, index 1349 ms: 8 candidates, 131656 repo-hours, 1258 releases; waiting 582 ms; commit 0 ms)
2026-11-08T09:59:52Z [load_day 2025-01-24] 2025-01-24 hour 13: 260139 events in 0 files, snapshot none (task 10313 ms: download 7148 ms overlapping gunzip 1674 ms, parse 6992 ms, sort 0 ms, write 0 ms, index 874 ms: 12 candidates, 112461 repo-hours, 1083 releases; waiting 447 ms; commit 0 ms)
2026-11-08T10:00:01Z [load_day 2025-01-24] 2025-01-24 hour 14: 252597 events in 0 files, snapshot none (task 9999 ms: download 7178 ms overlapping gunzip 1612 ms, parse 6690 ms, sort 0 ms, write 0 ms, index 899 ms: 10 candidates, 101314 repo-hours, 1351 releases; waiting 524 ms; commit 0 ms)
2026-11-08T10:00:02Z [load_day 2025-01-24] 2025-01-24 hour 15: 253122 events in 0 files, snapshot none (task 10128 ms: download 7297 ms overlapping gunzip 1642 ms, parse 6941 ms, sort 0 ms, write 0 ms, index 810 ms: 12 candidates, 107643 repo-hours, 1360 releases; waiting 462 ms; commit 0 ms)
2026-11-08T10:00:12Z [load_day 2025-01-24] 2025-01-24 hour 16: 248137 events in 0 files, snapshot none (task 9867 ms: download 6576 ms overlapping gunzip 1521 ms, parse 6408 ms, sort 0 ms, write 0 ms, index 1079 ms: 15 candidates, 101352 repo-hours, 1197 releases; waiting 569 ms; commit 0 ms)
2026-11-08T10:00:14Z [load_day 2025-01-24] 2025-01-24 hour 17: 236758 events in 0 files, snapshot none (task 10790 ms: download 8046 ms overlapping gunzip 1362 ms, parse 5923 ms, sort 0 ms, write 0 ms, index 899 ms: 9 candidates, 94446 repo-hours, 1107 releases; waiting 2312 ms; commit 0 ms)
2026-11-08T10:00:21Z [load_day 2025-01-24] 2025-01-24 hour 18: 235972 events in 0 files, snapshot none (task 8456 ms: download 5648 ms overlapping gunzip 1363 ms, parse 5568 ms, sort 0 ms, write 0 ms, index 792 ms: 12 candidates, 103076 repo-hours, 1172 releases; waiting 504 ms; commit 0 ms)
2026-11-08T10:00:23Z [load_day 2025-01-24] 2025-01-24 hour 19: 217419 events in 0 files, snapshot none (task 8385 ms: download 5200 ms overlapping gunzip 1243 ms, parse 5238 ms, sort 0 ms, write 0 ms, index 1198 ms: 11 candidates, 81344 repo-hours, 1118 releases; waiting 439 ms; commit 0 ms)
2026-11-08T10:00:29Z [load_day 2025-01-24] 2025-01-24 hour 20: 215423 events in 0 files, snapshot none (task 8108 ms: download 5011 ms overlapping gunzip 1241 ms, parse 5087 ms, sort 0 ms, write 0 ms, index 887 ms: 8 candidates, 81811 repo-hours, 1000 releases; waiting 628 ms; commit 0 ms)
2026-11-08T10:00:31Z [load_day 2025-01-24] 2025-01-24 hour 21: 210960 events in 0 files, snapshot none (task 7722 ms: download 5033 ms overlapping gunzip 1144 ms, parse 5076 ms, sort 0 ms, write 0 ms, index 698 ms: 6 candidates, 82889 repo-hours, 1347 releases; waiting 508 ms; commit 0 ms)
2026-11-08T10:00:38Z [load_day 2025-01-24] 2025-01-24 hour 22: 191352 events in 0 files, snapshot none (task 8093 ms: download 4924 ms overlapping gunzip 1241 ms, parse 5192 ms, sort 0 ms, write 0 ms, index 732 ms: 6 candidates, 71248 repo-hours, 1213 releases; waiting 643 ms; commit 0 ms)
2026-11-08T10:00:39Z [load_day 2025-01-24] 2025-01-24 hour 23: 177803 events in 0 files, snapshot none (task 7691 ms: download 5049 ms overlapping gunzip 1250 ms, parse 5174 ms, sort 0 ms, write 0 ms, index 486 ms: 9 candidates, 63789 repo-hours, 1164 releases; waiting 455 ms; commit 0 ms)
2026-11-08T10:00:49Z [load_day 2025-01-24] 2025-01-24: repo_hour merged from 24 files to 1 (2175500 rows, 9475 ms)
2026-11-08T10:00:51Z [load_day 2025-01-24] 2025-01-24: index committed in 11890 ms (24 + 1 + 24 files)
2026-11-08T10:00:51Z [load_day 2025-01-24] 2025-01-24: 5315976 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:00:51Z [load_day 2025-01-24] attempt 1 succeeded