orcaLog in

Runs · run 3399

load_day 2025-01-05, attempt 1 succeeded

Host
73ccef5e07c2:232966
Started
2026-11-08T09:40:28Z
Ended
2026-11-08T09:41:55Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
648 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
116.9 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3399/load_day/2025-01-05/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:40:28Z [load_day 2025-01-05] attempt 1 started
2026-11-08T09:40:29Z [load_day 2025-01-05] 2025-01-05: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:40:35Z [load_day 2025-01-05] 2025-01-05 hour 0: 153358 events in 0 files, snapshot none (task 5313 ms: download 2691 ms overlapping gunzip 766 ms, parse 3284 ms, sort 0 ms, write 0 ms, index 538 ms: 7 candidates, 72812 repo-hours, 1232 releases; waiting 515 ms; commit 0 ms)
2026-11-08T09:40:36Z [load_day 2025-01-05] 2025-01-05 hour 1: 175169 events in 0 files, snapshot none (task 5704 ms: download 2764 ms overlapping gunzip 769 ms, parse 3512 ms, sort 0 ms, write 0 ms, index 665 ms: 2 candidates, 98863 repo-hours, 901 releases; waiting 452 ms; commit 0 ms)
2026-11-08T09:40:40Z [load_day 2025-01-05] 2025-01-05 hour 2: 131335 events in 0 files, snapshot none (task 4849 ms: download 1980 ms overlapping gunzip 665 ms, parse 2797 ms, sort 0 ms, write 0 ms, index 526 ms: 4 candidates, 58136 repo-hours, 814 releases; waiting 574 ms; commit 0 ms)
2026-11-08T09:40:41Z [load_day 2025-01-05] 2025-01-05 hour 3: 151812 events in 0 files, snapshot none (task 4889 ms: download 2833 ms overlapping gunzip 691 ms, parse 3076 ms, sort 0 ms, write 0 ms, index 500 ms: 2 candidates, 59093 repo-hours, 3980 releases; waiting 382 ms; commit 0 ms)
2026-11-08T09:40:46Z [load_day 2025-01-05] 2025-01-05 hour 4: 137405 events in 0 files, snapshot none (task 4719 ms: download 2391 ms overlapping gunzip 664 ms, parse 2817 ms, sort 0 ms, write 0 ms, index 392 ms: 7 candidates, 49708 repo-hours, 593 releases; waiting 565 ms; commit 0 ms)
2026-11-08T09:40:46Z [load_day 2025-01-05] 2025-01-05 hour 5: 143848 events in 0 files, snapshot none (task 4886 ms: download 2455 ms overlapping gunzip 741 ms, parse 2905 ms, sort 0 ms, write 0 ms, index 448 ms: 4 candidates, 52001 repo-hours, 637 releases; waiting 514 ms; commit 0 ms)
2026-11-08T09:40:50Z [load_day 2025-01-05] 2025-01-05 hour 6: 160816 events in 0 files, snapshot none (task 4131 ms: download 2073 ms overlapping gunzip 513 ms, parse 2296 ms, sort 0 ms, write 0 ms, index 548 ms: 3 candidates, 69619 repo-hours, 824 releases; waiting 507 ms; commit 0 ms)
2026-11-08T09:40:50Z [load_day 2025-01-05] 2025-01-05 hour 7: 152365 events in 0 files, snapshot none (task 3750 ms: download 2123 ms overlapping gunzip 493 ms, parse 2098 ms, sort 0 ms, write 0 ms, index 399 ms: 2 candidates, 55361 repo-hours, 573 releases; waiting 509 ms; commit 0 ms)
2026-11-08T09:40:55Z [load_day 2025-01-05] 2025-01-05 hour 8: 156845 events in 0 files, snapshot none (task 4142 ms: download 1797 ms overlapping gunzip 557 ms, parse 2386 ms, sort 0 ms, write 0 ms, index 430 ms: 4 candidates, 59433 repo-hours, 696 releases; waiting 473 ms; commit 0 ms)
2026-11-08T09:40:55Z [load_day 2025-01-05] 2025-01-05 hour 9: 170006 events in 0 files, snapshot none (task 4683 ms: download 2343 ms overlapping gunzip 634 ms, parse 2736 ms, sort 0 ms, write 0 ms, index 526 ms: 6 candidates, 67090 repo-hours, 839 releases; waiting 524 ms; commit 0 ms)
2026-11-08T09:41:00Z [load_day 2025-01-05] 2025-01-05 hour 10: 169867 events in 0 files, snapshot none (task 4293 ms: download 2206 ms overlapping gunzip 553 ms, parse 2428 ms, sort 0 ms, write 0 ms, index 441 ms: 6 candidates, 64784 repo-hours, 793 releases; waiting 632 ms; commit 0 ms)
2026-11-08T09:41:00Z [load_day 2025-01-05] 2025-01-05 hour 11: 172721 events in 0 files, snapshot none (task 4550 ms: download 2525 ms overlapping gunzip 563 ms, parse 2475 ms, sort 0 ms, write 0 ms, index 482 ms: 1 candidates, 63622 repo-hours, 883 releases; waiting 764 ms; commit 0 ms)
2026-11-08T09:41:07Z [load_day 2025-01-05] 2025-01-05 hour 12: 236022 events in 0 files, snapshot none (task 6675 ms: download 3527 ms overlapping gunzip 939 ms, parse 4193 ms, sort 0 ms, write 0 ms, index 834 ms: 4 candidates, 115571 repo-hours, 1021 releases; waiting 478 ms; commit 0 ms)
2026-11-08T09:41:07Z [load_day 2025-01-05] 2025-01-05 hour 13: 211012 events in 0 files, snapshot none (task 6872 ms: download 4325 ms overlapping gunzip 1054 ms, parse 4394 ms, sort 0 ms, write 0 ms, index 704 ms: 5 candidates, 96645 repo-hours, 847 releases; waiting 483 ms; commit 0 ms)
2026-11-08T09:41:14Z [load_day 2025-01-05] 2025-01-05 hour 14: 198419 events in 0 files, snapshot none (task 6241 ms: download 3194 ms overlapping gunzip 932 ms, parse 4059 ms, sort 0 ms, write 0 ms, index 614 ms: 6 candidates, 81294 repo-hours, 1027 releases; waiting 333 ms; commit 0 ms)
2026-11-08T09:41:14Z [load_day 2025-01-05] 2025-01-05 hour 15: 205140 events in 0 files, snapshot none (task 6251 ms: download 3675 ms overlapping gunzip 888 ms, parse 3960 ms, sort 0 ms, write 0 ms, index 650 ms: 6 candidates, 84881 repo-hours, 1170 releases; waiting 501 ms; commit 0 ms)
2026-11-08T09:41:21Z [load_day 2025-01-05] 2025-01-05 hour 16: 195184 events in 0 files, snapshot none (task 6611 ms: download 3084 ms overlapping gunzip 975 ms, parse 4016 ms, sort 0 ms, write 0 ms, index 846 ms: 5 candidates, 78147 repo-hours, 935 releases; waiting 495 ms; commit 0 ms)
2026-11-08T09:41:21Z [load_day 2025-01-05] 2025-01-05 hour 17: 186667 events in 0 files, snapshot none (task 6381 ms: download 3137 ms overlapping gunzip 900 ms, parse 3981 ms, sort 0 ms, write 0 ms, index 664 ms: 6 candidates, 72436 repo-hours, 899 releases; waiting 218 ms; commit 0 ms)
2026-11-08T09:41:29Z [load_day 2025-01-05] 2025-01-05 hour 18: 197299 events in 0 files, snapshot none (task 7507 ms: download 2842 ms overlapping gunzip 886 ms, parse 3779 ms, sort 0 ms, write 0 ms, index 2123 ms: 4 candidates, 86422 repo-hours, 1045 releases; waiting 497 ms; commit 0 ms)
2026-11-08T09:41:29Z [load_day 2025-01-05] 2025-01-05 hour 19: 175386 events in 0 files, snapshot none (task 6161 ms: download 2861 ms overlapping gunzip 870 ms, parse 3841 ms, sort 0 ms, write 0 ms, index 621 ms: 6 candidates, 63293 repo-hours, 835 releases; waiting 521 ms; commit 0 ms)
2026-11-08T09:41:39Z [load_day 2025-01-05] 2025-01-05 hour 20: 172898 events in 0 files, snapshot none (task 6514 ms: download 3097 ms overlapping gunzip 1027 ms, parse 4091 ms, sort 0 ms, write 0 ms, index 627 ms: 8 candidates, 65043 repo-hours, 854 releases; waiting 520 ms; commit 0 ms)
2026-11-08T09:41:39Z [load_day 2025-01-05] 2025-01-05 hour 21: 174143 events in 0 files, snapshot none (task 6792 ms: download 3493 ms overlapping gunzip 994 ms, parse 4285 ms, sort 0 ms, write 0 ms, index 680 ms: 4 candidates, 66523 repo-hours, 999 releases; waiting 524 ms; commit 0 ms)
2026-11-08T09:41:44Z [load_day 2025-01-05] 2025-01-05 hour 22: 158274 events in 0 files, snapshot none (task 4580 ms: download 2559 ms overlapping gunzip 629 ms, parse 2730 ms, sort 0 ms, write 0 ms, index 446 ms: 8 candidates, 56435 repo-hours, 1068 releases; waiting 526 ms; commit 0 ms)
2026-11-08T09:41:44Z [load_day 2025-01-05] 2025-01-05 hour 23: 149655 events in 0 files, snapshot none (task 4969 ms: download 2744 ms overlapping gunzip 691 ms, parse 2778 ms, sort 0 ms, write 0 ms, index 486 ms: 2 candidates, 54446 repo-hours, 862 releases; waiting 513 ms; commit 0 ms)
2026-11-08T09:41:52Z [load_day 2025-01-05] 2025-01-05: repo_hour merged from 24 files to 1 (1691658 rows, 7383 ms)
2026-11-08T09:41:55Z [load_day 2025-01-05] 2025-01-05: index committed in 10378 ms (24 + 1 + 24 files)
2026-11-08T09:41:55Z [load_day 2025-01-05] 2025-01-05: 4135646 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:41:55Z [load_day 2025-01-05] attempt 1 succeeded