orcaLog in

Runs · run 3609

load_day 2025-02-26, attempt 1 succeeded

Host
73ccef5e07c2:261979
Started
2026-11-08T10:32:55Z
Ended
2026-11-08T10:35:12Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
918 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
209.5 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3609/load_day/2025-02-26/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:32:55Z [load_day 2025-02-26] attempt 1 started
2026-11-08T10:32:56Z [load_day 2025-02-26] 2025-02-26: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:33:06Z [load_day 2025-02-26] 2025-02-26 hour 0: 219035 events in 0 files, snapshot none (task 8996 ms: download 5259 ms overlapping gunzip 1389 ms, parse 5805 ms, sort 0 ms, write 0 ms, index 830 ms: 12 candidates, 103409 repo-hours, 1308 releases; waiting 501 ms; commit 0 ms)
2026-11-08T10:33:06Z [load_day 2025-02-26] 2025-02-26 hour 1: 239972 events in 0 files, snapshot none (task 8002 ms: download 4478 ms overlapping gunzip 1078 ms, parse 4963 ms, sort 0 ms, write 0 ms, index 1430 ms: 13 candidates, 126551 repo-hours, 1098 releases; waiting 321 ms; commit 0 ms)
2026-11-08T10:33:14Z [load_day 2025-02-26] 2025-02-26 hour 2: 215125 events in 0 files, snapshot none (task 8435 ms: download 4916 ms overlapping gunzip 1210 ms, parse 5203 ms, sort 0 ms, write 0 ms, index 1130 ms: 12 candidates, 94565 repo-hours, 978 releases; waiting 504 ms; commit 0 ms)
2026-11-08T10:33:15Z [load_day 2025-02-26] 2025-02-26 hour 3: 227928 events in 0 files, snapshot none (task 9007 ms: download 5147 ms overlapping gunzip 1361 ms, parse 5962 ms, sort 0 ms, write 0 ms, index 925 ms: 11 candidates, 92200 repo-hours, 3905 releases; waiting 522 ms; commit 0 ms)
2026-11-08T10:33:22Z [load_day 2025-02-26] 2025-02-26 hour 4: 203669 events in 0 files, snapshot none (task 7229 ms: download 4282 ms overlapping gunzip 1099 ms, parse 4894 ms, sort 0 ms, write 0 ms, index 719 ms: 11 candidates, 78083 repo-hours, 737 releases; waiting 235 ms; commit 0 ms)
2026-11-08T10:33:23Z [load_day 2025-02-26] 2025-02-26 hour 5: 209593 events in 0 files, snapshot none (task 7279 ms: download 4493 ms overlapping gunzip 1252 ms, parse 4767 ms, sort 0 ms, write 0 ms, index 637 ms: 12 candidates, 81289 repo-hours, 870 releases; waiting 281 ms; commit 0 ms)
2026-11-08T10:33:32Z [load_day 2025-02-26] 2025-02-26 hour 6: 237762 events in 0 files, snapshot none (task 9188 ms: download 6134 ms overlapping gunzip 1379 ms, parse 6186 ms, sort 0 ms, write 0 ms, index 813 ms: 10 candidates, 103058 repo-hours, 1181 releases; waiting 509 ms; commit 0 ms)
2026-11-08T10:33:33Z [load_day 2025-02-26] 2025-02-26 hour 7: 234178 events in 0 files, snapshot none (task 9622 ms: download 6965 ms overlapping gunzip 1595 ms, parse 6406 ms, sort 0 ms, write 0 ms, index 850 ms: 17 candidates, 93357 repo-hours, 1018 releases; waiting 506 ms; commit 0 ms)
2026-11-08T10:33:42Z [load_day 2025-02-26] 2025-02-26 hour 8: 251628 events in 0 files, snapshot none (task 9666 ms: download 6854 ms overlapping gunzip 1540 ms, parse 6647 ms, sort 0 ms, write 0 ms, index 805 ms: 15 candidates, 105110 repo-hours, 1102 releases; waiting 457 ms; commit 0 ms)
2026-11-08T10:33:44Z [load_day 2025-02-26] 2025-02-26 hour 9: 268119 events in 0 files, snapshot none (task 9893 ms: download 7303 ms overlapping gunzip 1521 ms, parse 6801 ms, sort 0 ms, write 0 ms, index 830 ms: 15 candidates, 112344 repo-hours, 1503 releases; waiting 502 ms; commit 0 ms)
2026-11-08T10:33:51Z [load_day 2025-02-26] 2025-02-26 hour 10: 261869 events in 0 files, snapshot none (task 8390 ms: download 5741 ms overlapping gunzip 1286 ms, parse 5243 ms, sort 0 ms, write 0 ms, index 769 ms: 15 candidates, 107718 repo-hours, 1379 releases; waiting 807 ms; commit 0 ms)
2026-11-08T10:33:52Z [load_day 2025-02-26] 2025-02-26 hour 11: 258663 events in 0 files, snapshot none (task 8066 ms: download 5360 ms overlapping gunzip 1250 ms, parse 5227 ms, sort 0 ms, write 0 ms, index 819 ms: 14 candidates, 102657 repo-hours, 1366 releases; waiting 507 ms; commit 0 ms)
2026-11-08T10:34:00Z [load_day 2025-02-26] 2025-02-26 hour 12: 288757 events in 0 files, snapshot none (task 9140 ms: download 5462 ms overlapping gunzip 1252 ms, parse 5306 ms, sort 0 ms, write 0 ms, index 1822 ms: 19 candidates, 144350 repo-hours, 1586 releases; waiting 493 ms; commit 0 ms)
2026-11-08T10:34:02Z [load_day 2025-02-26] 2025-02-26 hour 13: 282336 events in 0 files, snapshot none (task 9049 ms: download 5260 ms overlapping gunzip 1265 ms, parse 5388 ms, sort 0 ms, write 0 ms, index 1660 ms: 14 candidates, 127537 repo-hours, 1472 releases; waiting 514 ms; commit 0 ms)
2026-11-08T10:34:14Z [load_day 2025-02-26] 2025-02-26 hour 14: 278390 events in 0 files, snapshot none (task 13025 ms: download 9790 ms overlapping gunzip 1906 ms, parse 7898 ms, sort 0 ms, write 0 ms, index 978 ms: 9 candidates, 115236 repo-hours, 1614 releases; waiting 1990 ms; commit 0 ms)
2026-11-08T10:34:14Z [load_day 2025-02-26] 2025-02-26 hour 15: 279414 events in 0 files, snapshot none (task 10891 ms: download 7365 ms overlapping gunzip 1737 ms, parse 7321 ms, sort 0 ms, write 0 ms, index 1393 ms: 12 candidates, 123494 repo-hours, 1662 releases; waiting 206 ms; commit 0 ms)
2026-11-08T10:34:26Z [load_day 2025-02-26] 2025-02-26 hour 16: 273188 events in 0 files, snapshot none (task 11118 ms: download 8125 ms overlapping gunzip 1768 ms, parse 7850 ms, sort 0 ms, write 0 ms, index 993 ms: 13 candidates, 115991 repo-hours, 1349 releases; waiting 250 ms; commit 0 ms)
2026-11-08T10:34:26Z [load_day 2025-02-26] 2025-02-26 hour 17: 264582 events in 0 files, snapshot none (task 11245 ms: download 8375 ms overlapping gunzip 1684 ms, parse 7881 ms, sort 0 ms, write 0 ms, index 853 ms: 19 candidates, 107309 repo-hours, 1300 releases; waiting 521 ms; commit 0 ms)
2026-11-08T10:34:37Z [load_day 2025-02-26] 2025-02-26 hour 18: 268619 events in 0 files, snapshot none (task 10255 ms: download 7376 ms overlapping gunzip 1543 ms, parse 6892 ms, sort 0 ms, write 0 ms, index 1049 ms: 17 candidates, 120032 repo-hours, 1566 releases; waiting 545 ms; commit 0 ms)
2026-11-08T10:34:37Z [load_day 2025-02-26] 2025-02-26 hour 19: 249703 events in 0 files, snapshot none (task 9985 ms: download 7158 ms overlapping gunzip 1614 ms, parse 6711 ms, sort 0 ms, write 0 ms, index 887 ms: 14 candidates, 97161 repo-hours, 1221 releases; waiting 431 ms; commit 0 ms)
2026-11-08T10:34:47Z [load_day 2025-02-26] 2025-02-26 hour 20: 242211 events in 0 files, snapshot none (task 10046 ms: download 7028 ms overlapping gunzip 1495 ms, parse 6781 ms, sort 0 ms, write 0 ms, index 1024 ms: 16 candidates, 95626 repo-hours, 1367 releases; waiting 439 ms; commit 0 ms)
2026-11-08T10:34:47Z [load_day 2025-02-26] 2025-02-26 hour 21: 241102 events in 0 files, snapshot none (task 8778 ms: download 6296 ms overlapping gunzip 1387 ms, parse 6022 ms, sort 0 ms, write 0 ms, index 674 ms: 17 candidates, 93941 repo-hours, 1345 releases; waiting 462 ms; commit 0 ms)
2026-11-08T10:34:58Z [load_day 2025-02-26] 2025-02-26 hour 22: 221329 events in 0 files, snapshot none (task 10044 ms: download 7081 ms overlapping gunzip 1443 ms, parse 5993 ms, sort 0 ms, write 0 ms, index 738 ms: 13 candidates, 83472 repo-hours, 1332 releases; waiting 1515 ms; commit 0 ms)
2026-11-08T10:34:58Z [load_day 2025-02-26] 2025-02-26 hour 23: 206549 events in 0 files, snapshot none (task 8287 ms: download 5423 ms overlapping gunzip 1273 ms, parse 5439 ms, sort 0 ms, write 0 ms, index 744 ms: 8 candidates, 77533 repo-hours, 1062 releases; waiting 459 ms; commit 0 ms)
2026-11-08T10:35:09Z [load_day 2025-02-26] 2025-02-26: repo_hour merged from 24 files to 1 (2502023 rows, 10772 ms)
2026-11-08T10:35:12Z [load_day 2025-02-26] 2025-02-26: index committed in 14073 ms (24 + 1 + 24 files)
2026-11-08T10:35:12Z [load_day 2025-02-26] 2025-02-26: 5923721 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:35:12Z [load_day 2025-02-26] attempt 1 succeeded