orcaLog in

Runs · run 3501

load_day 2025-01-31, attempt 1 succeeded

Host
73ccef5e07c2:246772
Started
2026-11-08T10:05:30Z
Ended
2026-11-08T10:07:41Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
904 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
183.4 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3501/load_day/2025-01-31/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:05:30Z [load_day 2025-01-31] attempt 1 started
2026-11-08T10:05:31Z [load_day 2025-01-31] 2025-01-31: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:05:39Z [load_day 2025-01-31] 2025-01-31 hour 0: 192484 events in 0 files, snapshot none (task 7218 ms: download 3873 ms overlapping gunzip 1043 ms, parse 4420 ms, sort 0 ms, write 0 ms, index 914 ms: 6 candidates, 96923 repo-hours, 1429 releases; waiting 208 ms; commit 0 ms)
2026-11-08T10:05:39Z [load_day 2025-01-31] 2025-01-31 hour 1: 200273 events in 0 files, snapshot none (task 6800 ms: download 3978 ms overlapping gunzip 956 ms, parse 4127 ms, sort 0 ms, write 0 ms, index 956 ms: 11 candidates, 109813 repo-hours, 1008 releases; waiting 501 ms; commit 0 ms)
2026-11-08T10:05:46Z [load_day 2025-01-31] 2025-01-31 hour 2: 164230 events in 0 files, snapshot none (task 6443 ms: download 3345 ms overlapping gunzip 947 ms, parse 3978 ms, sort 0 ms, write 0 ms, index 663 ms: 6 candidates, 72484 repo-hours, 924 releases; waiting 498 ms; commit 0 ms)
2026-11-08T10:05:47Z [load_day 2025-01-31] 2025-01-31 hour 3: 176999 events in 0 files, snapshot none (task 6840 ms: download 3970 ms overlapping gunzip 963 ms, parse 4318 ms, sort 0 ms, write 0 ms, index 638 ms: 3 candidates, 70729 repo-hours, 3852 releases; waiting 492 ms; commit 0 ms)
2026-11-08T10:05:55Z [load_day 2025-01-31] 2025-01-31 hour 4: 171345 events in 0 files, snapshot none (task 7136 ms: download 3750 ms overlapping gunzip 1096 ms, parse 4545 ms, sort 0 ms, write 0 ms, index 721 ms: 7 candidates, 64004 repo-hours, 871 releases; waiting 504 ms; commit 0 ms)
2026-11-08T10:05:55Z [load_day 2025-01-31] 2025-01-31 hour 5: 184784 events in 0 files, snapshot none (task 7325 ms: download 4283 ms overlapping gunzip 1094 ms, parse 4653 ms, sort 0 ms, write 0 ms, index 784 ms: 6 candidates, 69048 repo-hours, 980 releases; waiting 502 ms; commit 0 ms)
2026-11-08T10:06:02Z [load_day 2025-01-31] 2025-01-31 hour 6: 199381 events in 0 files, snapshot none (task 6781 ms: download 3428 ms overlapping gunzip 973 ms, parse 4151 ms, sort 0 ms, write 0 ms, index 880 ms: 4 candidates, 84749 repo-hours, 1036 releases; waiting 528 ms; commit 0 ms)
2026-11-08T10:06:04Z [load_day 2025-01-31] 2025-01-31 hour 7: 198319 events in 0 files, snapshot none (task 7901 ms: download 4739 ms overlapping gunzip 1144 ms, parse 4885 ms, sort 0 ms, write 0 ms, index 870 ms: 6 candidates, 74504 repo-hours, 883 releases; waiting 742 ms; commit 0 ms)
2026-11-08T10:06:11Z [load_day 2025-01-31] 2025-01-31 hour 8: 209982 events in 0 files, snapshot none (task 7926 ms: download 4593 ms overlapping gunzip 1255 ms, parse 5116 ms, sort 0 ms, write 0 ms, index 958 ms: 10 candidates, 83697 repo-hours, 1097 releases; waiting 344 ms; commit 0 ms)
2026-11-08T10:06:12Z [load_day 2025-01-31] 2025-01-31 hour 9: 228121 events in 0 files, snapshot none (task 7845 ms: download 5188 ms overlapping gunzip 1190 ms, parse 5096 ms, sort 0 ms, write 0 ms, index 713 ms: 5 candidates, 94647 repo-hours, 1398 releases; waiting 576 ms; commit 0 ms)
2026-11-08T10:06:25Z [load_day 2025-01-31] 2025-01-31 hour 10: 222588 events in 0 files, snapshot none (task 6907 ms: download 4284 ms overlapping gunzip 1020 ms, parse 4329 ms, sort 0 ms, write 0 ms, index 695 ms: 9 candidates, 92320 repo-hours, 1319 releases; waiting 518 ms; commit 0 ms)
2026-11-08T10:06:25Z [load_day 2025-01-31] 2025-01-31 hour 11: 219072 events in 0 files, snapshot none (task 6463 ms: download 3967 ms overlapping gunzip 964 ms, parse 4047 ms, sort 0 ms, write 0 ms, index 649 ms: 4 candidates, 86460 repo-hours, 1311 releases; waiting 533 ms; commit 0 ms)
2026-11-08T10:06:33Z [load_day 2025-01-31] 2025-01-31 hour 12: 266162 events in 0 files, snapshot none (task 7487 ms: download 4612 ms overlapping gunzip 1097 ms, parse 4817 ms, sort 0 ms, write 0 ms, index 975 ms: 10 candidates, 133115 repo-hours, 1290 releases; waiting 373 ms; commit 0 ms)
2026-11-08T10:06:33Z [load_day 2025-01-31] 2025-01-31 hour 13: 250658 events in 0 files, snapshot none (task 7244 ms: download 4589 ms overlapping gunzip 1097 ms, parse 4666 ms, sort 0 ms, write 0 ms, index 820 ms: 9 candidates, 114461 repo-hours, 1379 releases; waiting 375 ms; commit 0 ms)
2026-11-08T10:06:44Z [load_day 2025-01-31] 2025-01-31 hour 14: 247942 events in 0 files, snapshot none (task 10726 ms: download 7294 ms overlapping gunzip 1769 ms, parse 7546 ms, sort 0 ms, write 0 ms, index 992 ms: 6 candidates, 102429 repo-hours, 1443 releases; waiting 175 ms; commit 0 ms)
2026-11-08T10:06:45Z [load_day 2025-01-31] 2025-01-31 hour 15: 254645 events in 0 files, snapshot none (task 12109 ms: download 8675 ms overlapping gunzip 1982 ms, parse 8448 ms, sort 0 ms, write 0 ms, index 867 ms: 5 candidates, 110093 repo-hours, 1736 releases; waiting 397 ms; commit 0 ms)
2026-11-08T10:06:53Z [load_day 2025-01-31] 2025-01-31 hour 16: 246204 events in 0 files, snapshot none (task 8916 ms: download 6189 ms overlapping gunzip 1505 ms, parse 6235 ms, sort 0 ms, write 0 ms, index 766 ms: 8 candidates, 102024 repo-hours, 1626 releases; waiting 191 ms; commit 0 ms)
2026-11-08T10:06:55Z [load_day 2025-01-31] 2025-01-31 hour 17: 236451 events in 0 files, snapshot none (task 9141 ms: download 6388 ms overlapping gunzip 1490 ms, parse 6078 ms, sort 0 ms, write 0 ms, index 886 ms: 11 candidates, 94215 repo-hours, 1468 releases; waiting 459 ms; commit 0 ms)
2026-11-08T10:07:04Z [load_day 2025-01-31] 2025-01-31 hour 18: 236129 events in 0 files, snapshot none (task 9919 ms: download 5995 ms overlapping gunzip 1463 ms, parse 6229 ms, sort 0 ms, write 0 ms, index 1441 ms: 4 candidates, 104723 repo-hours, 1372 releases; waiting 483 ms; commit 0 ms)
2026-11-08T10:07:04Z [load_day 2025-01-31] 2025-01-31 hour 19: 210137 events in 0 files, snapshot none (task 8487 ms: download 5036 ms overlapping gunzip 1353 ms, parse 5664 ms, sort 0 ms, write 0 ms, index 708 ms: 9 candidates, 80694 repo-hours, 1275 releases; waiting 457 ms; commit 0 ms)
2026-11-08T10:07:13Z [load_day 2025-01-31] 2025-01-31 hour 20: 206815 events in 0 files, snapshot none (task 8467 ms: download 5154 ms overlapping gunzip 1404 ms, parse 5808 ms, sort 0 ms, write 0 ms, index 759 ms: 7 candidates, 81619 repo-hours, 1120 releases; waiting 243 ms; commit 0 ms)
2026-11-08T10:07:13Z [load_day 2025-01-31] 2025-01-31 hour 21: 205084 events in 0 files, snapshot none (task 8585 ms: download 5798 ms overlapping gunzip 1367 ms, parse 5901 ms, sort 0 ms, write 0 ms, index 627 ms: 4 candidates, 81861 repo-hours, 1286 releases; waiting 402 ms; commit 0 ms)
2026-11-08T10:07:21Z [load_day 2025-01-31] 2025-01-31 hour 22: 187271 events in 0 files, snapshot none (task 7863 ms: download 5554 ms overlapping gunzip 1355 ms, parse 5335 ms, sort 0 ms, write 0 ms, index 540 ms: 6 candidates, 70635 repo-hours, 1332 releases; waiting 390 ms; commit 0 ms)
2026-11-08T10:07:22Z [load_day 2025-01-31] 2025-01-31 hour 23: 173874 events in 0 files, snapshot none (task 8465 ms: download 6029 ms overlapping gunzip 1148 ms, parse 5292 ms, sort 0 ms, write 0 ms, index 507 ms: 10 candidates, 63746 repo-hours, 1084 releases; waiting 1274 ms; commit 0 ms)
2026-11-08T10:07:32Z [load_day 2025-01-31] 2025-01-31: repo_hour merged from 24 files to 1 (2138993 rows, 10006 ms)
2026-11-08T10:07:41Z [load_day 2025-01-31] 2025-01-31: index committed in 19363 ms (24 + 1 + 24 files)
2026-11-08T10:07:41Z [load_day 2025-01-31] 2025-01-31: 5088950 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:07:41Z [load_day 2025-01-31] attempt 1 succeeded