orcaLog in

Runs · run 3456

load_day 2025-01-20, attempt 1 succeeded

Host
73ccef5e07c2:240595
Started
2026-11-08T09:54:27Z
Ended
2026-11-08T09:56:44Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
789 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
211.2 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3456/load_day/2025-01-20/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:54:27Z [load_day 2025-01-20] attempt 1 started
2026-11-08T09:54:28Z [load_day 2025-01-20] 2025-01-20: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:54:36Z [load_day 2025-01-20] 2025-01-20 hour 0: 187617 events in 0 files, snapshot none (task 7805 ms: download 4960 ms overlapping gunzip 1224 ms, parse 5111 ms, sort 0 ms, write 0 ms, index 714 ms: 6 candidates, 87854 repo-hours, 1183 releases; waiting 492 ms; commit 0 ms)
2026-11-08T09:54:36Z [load_day 2025-01-20] 2025-01-20 hour 1: 215449 events in 0 files, snapshot none (task 8079 ms: download 5391 ms overlapping gunzip 1265 ms, parse 5194 ms, sort 0 ms, write 0 ms, index 847 ms: 7 candidates, 110059 repo-hours, 904 releases; waiting 503 ms; commit 0 ms)
2026-11-08T09:54:44Z [load_day 2025-01-20] 2025-01-20 hour 2: 190150 events in 0 files, snapshot none (task 8132 ms: download 5233 ms overlapping gunzip 1294 ms, parse 5303 ms, sort 0 ms, write 0 ms, index 645 ms: 12 candidates, 78841 repo-hours, 823 releases; waiting 503 ms; commit 0 ms)
2026-11-08T09:54:44Z [load_day 2025-01-20] 2025-01-20 hour 3: 202110 events in 0 files, snapshot none (task 7568 ms: download 5008 ms overlapping gunzip 1258 ms, parse 4949 ms, sort 0 ms, write 0 ms, index 578 ms: 4 candidates, 76097 repo-hours, 3884 releases; waiting 526 ms; commit 0 ms)
2026-11-08T09:54:54Z [load_day 2025-01-20] 2025-01-20 hour 4: 186430 events in 0 files, snapshot none (task 9051 ms: download 5373 ms overlapping gunzip 1563 ms, parse 6143 ms, sort 0 ms, write 0 ms, index 853 ms: 2 candidates, 65455 repo-hours, 762 releases; waiting 242 ms; commit 0 ms)
2026-11-08T09:54:56Z [load_day 2025-01-20] 2025-01-20 hour 5: 197494 events in 0 files, snapshot none (task 11265 ms: download 7744 ms overlapping gunzip 1644 ms, parse 6845 ms, sort 0 ms, write 0 ms, index 934 ms: 3 candidates, 72877 repo-hours, 734 releases; waiting 1598 ms; commit 0 ms)
2026-11-08T09:55:03Z [load_day 2025-01-20] 2025-01-20 hour 6: 223257 events in 0 files, snapshot none (task 8876 ms: download 5465 ms overlapping gunzip 1389 ms, parse 5913 ms, sort 0 ms, write 0 ms, index 826 ms: 7 candidates, 91749 repo-hours, 1016 releases; waiting 470 ms; commit 0 ms)
2026-11-08T09:55:05Z [load_day 2025-01-20] 2025-01-20 hour 7: 232501 events in 0 files, snapshot none (task 8603 ms: download 6089 ms overlapping gunzip 1416 ms, parse 5664 ms, sort 0 ms, write 0 ms, index 764 ms: 7 candidates, 81469 repo-hours, 884 releases; waiting 481 ms; commit 0 ms)
2026-11-08T09:55:13Z [load_day 2025-01-20] 2025-01-20 hour 8: 248846 events in 0 files, snapshot none (task 9064 ms: download 6490 ms overlapping gunzip 1493 ms, parse 6142 ms, sort 0 ms, write 0 ms, index 679 ms: 6 candidates, 92519 repo-hours, 1086 releases; waiting 498 ms; commit 0 ms)
2026-11-08T09:55:16Z [load_day 2025-01-20] 2025-01-20 hour 9: 264552 events in 0 files, snapshot none (task 9717 ms: download 7135 ms overlapping gunzip 1611 ms, parse 6510 ms, sort 0 ms, write 0 ms, index 823 ms: 11 candidates, 102084 repo-hours, 1354 releases; waiting 511 ms; commit 0 ms)
2026-11-08T09:55:22Z [load_day 2025-01-20] 2025-01-20 hour 10: 259949 events in 0 files, snapshot none (task 8597 ms: download 6162 ms overlapping gunzip 1478 ms, parse 5671 ms, sort 0 ms, write 0 ms, index 687 ms: 8 candidates, 96345 repo-hours, 1196 releases; waiting 539 ms; commit 0 ms)
2026-11-08T09:55:24Z [load_day 2025-01-20] 2025-01-20 hour 11: 251940 events in 0 files, snapshot none (task 8064 ms: download 5610 ms overlapping gunzip 1347 ms, parse 5256 ms, sort 0 ms, write 0 ms, index 650 ms: 5 candidates, 91052 repo-hours, 1049 releases; waiting 487 ms; commit 0 ms)
2026-11-08T09:55:33Z [load_day 2025-01-20] 2025-01-20 hour 12: 278646 events in 0 files, snapshot none (task 10331 ms: download 7183 ms overlapping gunzip 1650 ms, parse 7070 ms, sort 0 ms, write 0 ms, index 1078 ms: 9 candidates, 135410 repo-hours, 1300 releases; waiting 280 ms; commit 0 ms)
2026-11-08T09:55:35Z [load_day 2025-01-20] 2025-01-20 hour 13: 261240 events in 0 files, snapshot none (task 10195 ms: download 7251 ms overlapping gunzip 1663 ms, parse 6877 ms, sort 0 ms, write 0 ms, index 1077 ms: 6 candidates, 117762 repo-hours, 1215 releases; waiting 310 ms; commit 0 ms)
2026-11-08T09:55:45Z [load_day 2025-01-20] 2025-01-20 hour 14: 257962 events in 0 files, snapshot none (task 11533 ms: download 7773 ms overlapping gunzip 1911 ms, parse 7839 ms, sort 0 ms, write 0 ms, index 987 ms: 6 candidates, 105509 repo-hours, 1315 releases; waiting 498 ms; commit 0 ms)
2026-11-08T09:55:46Z [load_day 2025-01-20] 2025-01-20 hour 15: 260534 events in 0 files, snapshot none (task 10855 ms: download 7837 ms overlapping gunzip 1895 ms, parse 7395 ms, sort 0 ms, write 0 ms, index 788 ms: 6 candidates, 110687 repo-hours, 1479 releases; waiting 476 ms; commit 0 ms)
2026-11-08T09:55:57Z [load_day 2025-01-20] 2025-01-20 hour 16: 250829 events in 0 files, snapshot none (task 12063 ms: download 9140 ms overlapping gunzip 1968 ms, parse 8297 ms, sort 0 ms, write 0 ms, index 800 ms: 8 candidates, 103297 repo-hours, 1324 releases; waiting 675 ms; commit 0 ms)
2026-11-08T09:55:58Z [load_day 2025-01-20] 2025-01-20 hour 17: 242600 events in 0 files, snapshot none (task 10870 ms: download 8332 ms overlapping gunzip 1897 ms, parse 7546 ms, sort 0 ms, write 0 ms, index 700 ms: 15 candidates, 95449 repo-hours, 1092 releases; waiting 451 ms; commit 0 ms)
2026-11-08T09:56:09Z [load_day 2025-01-20] 2025-01-20 hour 18: 249478 events in 0 files, snapshot none (task 10473 ms: download 7791 ms overlapping gunzip 1920 ms, parse 7261 ms, sort 0 ms, write 0 ms, index 751 ms: 5 candidates, 112609 repo-hours, 1097 releases; waiting 286 ms; commit 0 ms)
2026-11-08T09:56:09Z [load_day 2025-01-20] 2025-01-20 hour 19: 222695 events in 0 files, snapshot none (task 9266 ms: download 6433 ms overlapping gunzip 1542 ms, parse 6345 ms, sort 0 ms, write 0 ms, index 618 ms: 16 candidates, 83081 repo-hours, 1111 releases; waiting 509 ms; commit 0 ms)
2026-11-08T09:56:21Z [load_day 2025-01-20] 2025-01-20 hour 20: 218986 events in 0 files, snapshot none (task 11985 ms: download 9435 ms overlapping gunzip 1434 ms, parse 6010 ms, sort 0 ms, write 0 ms, index 780 ms: 5 candidates, 84185 repo-hours, 1057 releases; waiting 3529 ms; commit 0 ms)
2026-11-08T09:56:21Z [load_day 2025-01-20] 2025-01-20 hour 21: 216482 events in 0 files, snapshot none (task 8984 ms: download 6270 ms overlapping gunzip 1371 ms, parse 5994 ms, sort 0 ms, write 0 ms, index 767 ms: 11 candidates, 84051 repo-hours, 1223 releases; waiting 530 ms; commit 0 ms)
2026-11-08T09:56:30Z [load_day 2025-01-20] 2025-01-20 hour 22: 194241 events in 0 files, snapshot none (task 8743 ms: download 6180 ms overlapping gunzip 1515 ms, parse 6073 ms, sort 0 ms, write 0 ms, index 541 ms: 11 candidates, 70929 repo-hours, 1131 releases; waiting 322 ms; commit 0 ms)
2026-11-08T09:56:31Z [load_day 2025-01-20] 2025-01-20 hour 23: 183138 events in 0 files, snapshot none (task 9127 ms: download 6504 ms overlapping gunzip 1505 ms, parse 6428 ms, sort 0 ms, write 0 ms, index 505 ms: 10 candidates, 65969 repo-hours, 931 releases; waiting 214 ms; commit 0 ms)
2026-11-08T09:56:41Z [load_day 2025-01-20] 2025-01-20: repo_hour merged from 24 files to 1 (2215339 rows, 9964 ms)
2026-11-08T09:56:44Z [load_day 2025-01-20] 2025-01-20: index committed in 12915 ms (24 + 1 + 24 files)
2026-11-08T09:56:44Z [load_day 2025-01-20] 2025-01-20: 5497126 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:56:44Z [load_day 2025-01-20] attempt 1 succeeded