orcaLog in

Runs · run 4587

load_day 2025-11-07, attempt 1 succeeded

Host
73ccef5e07c2:401907
Started
2026-11-08T14:24:57Z
Ended
2026-11-08T14:25:59Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
686 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
72.7 s, up to 2.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4587/load_day/2025-11-07/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:24:57Z [load_day 2025-11-07] attempt 1 started
2026-11-08T14:24:58Z [load_day 2025-11-07] 2025-11-07: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:25:02Z [load_day 2025-11-07] 2025-11-07 hour 0: 145364 events in 0 files, snapshot none (task 3931 ms: download 2567 ms overlapping gunzip 612 ms, parse 1850 ms, sort 0 ms, write 0 ms, index 558 ms: 6 candidates, 72755 repo-hours, 740 releases; waiting 599 ms; commit 0 ms)
2026-11-08T14:25:02Z [load_day 2025-11-07] 2025-11-07 hour 1: 151619 events in 0 files, snapshot none (task 3745 ms: download 2428 ms overlapping gunzip 499 ms, parse 1557 ms, sort 0 ms, write 0 ms, index 701 ms: 2 candidates, 91397 repo-hours, 735 releases; waiting 645 ms; commit 0 ms)
2026-11-08T14:25:06Z [load_day 2025-11-07] 2025-11-07 hour 2: 142940 events in 0 files, snapshot none (task 3653 ms: download 2237 ms overlapping gunzip 543 ms, parse 1615 ms, sort 0 ms, write 0 ms, index 584 ms: 12 candidates, 70374 repo-hours, 697 releases; waiting 572 ms; commit 0 ms)
2026-11-08T14:25:06Z [load_day 2025-11-07] 2025-11-07 hour 3: 145286 events in 0 files, snapshot none (task 3629 ms: download 2462 ms overlapping gunzip 484 ms, parse 1509 ms, sort 0 ms, write 0 ms, index 543 ms: 6 candidates, 70654 repo-hours, 1566 releases; waiting 802 ms; commit 0 ms)
2026-11-08T14:25:11Z [load_day 2025-11-07] 2025-11-07 hour 4: 144085 events in 0 files, snapshot none (task 3752 ms: download 2124 ms overlapping gunzip 510 ms, parse 1528 ms, sort 0 ms, write 0 ms, index 534 ms: 4 candidates, 63335 repo-hours, 621 releases; waiting 563 ms; commit 0 ms)
2026-11-08T14:25:11Z [load_day 2025-11-07] 2025-11-07 hour 5: 142493 events in 0 files, snapshot none (task 3796 ms: download 1789 ms overlapping gunzip 556 ms, parse 1874 ms, sort 0 ms, write 0 ms, index 502 ms: 3 candidates, 62872 repo-hours, 528 releases; waiting 569 ms; commit 0 ms)
2026-11-08T14:25:15Z [load_day 2025-11-07] 2025-11-07 hour 6: 146744 events in 0 files, snapshot none (task 3828 ms: download 2162 ms overlapping gunzip 593 ms, parse 1868 ms, sort 0 ms, write 0 ms, index 556 ms: 5 candidates, 73790 repo-hours, 630 releases; waiting 523 ms; commit 0 ms)
2026-11-08T14:25:15Z [load_day 2025-11-07] 2025-11-07 hour 7: 145434 events in 0 files, snapshot none (task 3588 ms: download 2342 ms overlapping gunzip 583 ms, parse 1631 ms, sort 0 ms, write 0 ms, index 533 ms: 5 candidates, 69749 repo-hours, 540 releases; waiting 541 ms; commit 0 ms)
2026-11-08T14:25:19Z [load_day 2025-11-07] 2025-11-07 hour 8: 144266 events in 0 files, snapshot none (task 3517 ms: download 2093 ms overlapping gunzip 566 ms, parse 1625 ms, sort 0 ms, write 0 ms, index 570 ms: 4 candidates, 73653 repo-hours, 644 releases; waiting 412 ms; commit 0 ms)
2026-11-08T14:25:20Z [load_day 2025-11-07] 2025-11-07 hour 9: 147517 events in 0 files, snapshot none (task 3861 ms: download 2206 ms overlapping gunzip 669 ms, parse 1965 ms, sort 0 ms, write 0 ms, index 578 ms: 5 candidates, 74940 repo-hours, 907 releases; waiting 274 ms; commit 0 ms)
2026-11-08T14:25:23Z [load_day 2025-11-07] 2025-11-07 hour 10: 147388 events in 0 files, snapshot none (task 3629 ms: download 2015 ms overlapping gunzip 551 ms, parse 1699 ms, sort 0 ms, write 0 ms, index 550 ms: 2 candidates, 75260 repo-hours, 719 releases; waiting 544 ms; commit 0 ms)
2026-11-08T14:25:24Z [load_day 2025-11-07] 2025-11-07 hour 11: 146438 events in 0 files, snapshot none (task 3610 ms: download 2498 ms overlapping gunzip 515 ms, parse 1488 ms, sort 0 ms, write 0 ms, index 561 ms: 7 candidates, 73313 repo-hours, 661 releases; waiting 626 ms; commit 0 ms)
2026-11-08T14:25:27Z [load_day 2025-11-07] 2025-11-07 hour 12: 159270 events in 0 files, snapshot none (task 3118 ms: download 1505 ms overlapping gunzip 341 ms, parse 1059 ms, sort 0 ms, write 0 ms, index 641 ms: 5 candidates, 96923 repo-hours, 478 releases; waiting 722 ms; commit 0 ms)
2026-11-08T14:25:27Z [load_day 2025-11-07] 2025-11-07 hour 13: 152033 events in 0 files, snapshot none (task 3149 ms: download 1928 ms overlapping gunzip 402 ms, parse 1248 ms, sort 0 ms, write 0 ms, index 629 ms: 4 candidates, 88018 repo-hours, 627 releases; waiting 516 ms; commit 0 ms)
2026-11-08T14:25:31Z [load_day 2025-11-07] 2025-11-07 hour 14: 148012 events in 0 files, snapshot none (task 3105 ms: download 2169 ms overlapping gunzip 384 ms, parse 1179 ms, sort 0 ms, write 0 ms, index 577 ms: 7 candidates, 78503 repo-hours, 682 releases; waiting 664 ms; commit 0 ms)
2026-11-08T14:25:32Z [load_day 2025-11-07] 2025-11-07 hour 15: 147087 events in 0 files, snapshot none (task 3842 ms: download 2448 ms overlapping gunzip 405 ms, parse 1183 ms, sort 0 ms, write 0 ms, index 597 ms: 9 candidates, 77744 repo-hours, 704 releases; waiting 1394 ms; commit 0 ms)
2026-11-08T14:25:35Z [load_day 2025-11-07] 2025-11-07 hour 16: 146014 events in 0 files, snapshot none (task 3535 ms: download 2199 ms overlapping gunzip 395 ms, parse 1216 ms, sort 0 ms, write 0 ms, index 635 ms: 5 candidates, 75434 repo-hours, 537 releases; waiting 953 ms; commit 0 ms)
2026-11-08T14:25:36Z [load_day 2025-11-07] 2025-11-07 hour 17: 145061 events in 0 files, snapshot none (task 3470 ms: download 2239 ms overlapping gunzip 390 ms, parse 1186 ms, sort 0 ms, write 0 ms, index 559 ms: 11 candidates, 73252 repo-hours, 592 releases; waiting 1017 ms; commit 0 ms)
2026-11-08T14:25:38Z [load_day 2025-11-07] 2025-11-07 hour 18: 149882 events in 0 files, snapshot none (task 3124 ms: download 1858 ms overlapping gunzip 373 ms, parse 1135 ms, sort 0 ms, write 0 ms, index 736 ms: 7 candidates, 78720 repo-hours, 607 releases; waiting 603 ms; commit 0 ms)
2026-11-08T14:25:40Z [load_day 2025-11-07] 2025-11-07 hour 19: 147933 events in 0 files, snapshot none (task 3465 ms: download 2358 ms overlapping gunzip 462 ms, parse 1436 ms, sort 0 ms, write 0 ms, index 576 ms: 10 candidates, 69493 repo-hours, 608 releases; waiting 679 ms; commit 0 ms)
2026-11-08T14:25:43Z [load_day 2025-11-07] 2025-11-07 hour 20: 144564 events in 0 files, snapshot none (task 3502 ms: download 1978 ms overlapping gunzip 436 ms, parse 1329 ms, sort 0 ms, write 0 ms, index 683 ms: 12 candidates, 67860 repo-hours, 619 releases; waiting 715 ms; commit 0 ms)
2026-11-08T14:25:44Z [load_day 2025-11-07] 2025-11-07 hour 21: 144682 events in 0 files, snapshot none (task 3913 ms: download 2856 ms overlapping gunzip 455 ms, parse 1341 ms, sort 0 ms, write 0 ms, index 445 ms: 7 candidates, 64851 repo-hours, 737 releases; waiting 1371 ms; commit 0 ms)
2026-11-08T14:25:46Z [load_day 2025-11-07] 2025-11-07 hour 22: 144764 events in 0 files, snapshot none (task 2879 ms: download 1779 ms overlapping gunzip 352 ms, parse 1092 ms, sort 0 ms, write 0 ms, index 617 ms: 9 candidates, 64366 repo-hours, 679 releases; waiting 497 ms; commit 0 ms)
2026-11-08T14:25:48Z [load_day 2025-11-07] 2025-11-07 hour 23: 140868 events in 0 files, snapshot none (task 3020 ms: download 2041 ms overlapping gunzip 379 ms, parse 1255 ms, sort 0 ms, write 0 ms, index 431 ms: 5 candidates, 61147 repo-hours, 698 releases; waiting 626 ms; commit 0 ms)
2026-11-08T14:25:56Z [load_day 2025-11-07] 2025-11-07: repo_hour merged from 24 files to 1 (1768403 rows, 7973 ms)
2026-11-08T14:25:59Z [load_day 2025-11-07] 2025-11-07: index committed in 11087 ms (24 + 1 + 24 files)
2026-11-08T14:25:59Z [load_day 2025-11-07] 2025-11-07: 3519744 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:25:59Z [load_day 2025-11-07] attempt 1 succeeded