orcaLog in

Runs · run 4528

load_day 2025-10-21, attempt 1 succeeded

Host
73ccef5e07c2:395686
Started
2026-11-08T14:16:17Z
Ended
2026-11-08T14:17:21Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
706 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
70.5 s, up to 2.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4528/load_day/2025-10-21/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:16:17Z [load_day 2025-10-21] attempt 1 started
2026-11-08T14:16:18Z [load_day 2025-10-21] 2025-10-21: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:16:22Z [load_day 2025-10-21] 2025-10-21 hour 0: 147022 events in 0 files, snapshot none (task 2938 ms: download 1956 ms overlapping gunzip 386 ms, parse 1212 ms, sort 0 ms, write 0 ms, index 544 ms: 1 candidates, 75934 repo-hours, 641 releases; waiting 524 ms; commit 0 ms)
2026-11-08T14:16:22Z [load_day 2025-10-21] 2025-10-21 hour 1: 151242 events in 0 files, snapshot none (task 3371 ms: download 2179 ms overlapping gunzip 413 ms, parse 1223 ms, sort 0 ms, write 0 ms, index 614 ms: 3 candidates, 91065 repo-hours, 527 releases; waiting 699 ms; commit 0 ms)
2026-11-08T14:16:25Z [load_day 2025-10-21] 2025-10-21 hour 2: 144113 events in 0 files, snapshot none (task 2917 ms: download 1876 ms overlapping gunzip 397 ms, parse 1227 ms, sort 0 ms, write 0 ms, index 517 ms: 5 candidates, 69218 repo-hours, 484 releases; waiting 419 ms; commit 0 ms)
2026-11-08T14:16:26Z [load_day 2025-10-21] 2025-10-21 hour 3: 146524 events in 0 files, snapshot none (task 3050 ms: download 1740 ms overlapping gunzip 399 ms, parse 1266 ms, sort 0 ms, write 0 ms, index 498 ms: 5 candidates, 67679 repo-hours, 1333 releases; waiting 553 ms; commit 0 ms)
2026-11-08T14:16:30Z [load_day 2025-10-21] 2025-10-21 hour 4: 141471 events in 0 files, snapshot none (task 3904 ms: download 2557 ms overlapping gunzip 487 ms, parse 1411 ms, sort 0 ms, write 0 ms, index 597 ms: 2 candidates, 60605 repo-hours, 406 releases; waiting 1044 ms; commit 0 ms)
2026-11-08T14:16:30Z [load_day 2025-10-21] 2025-10-21 hour 5: 143661 events in 0 files, snapshot none (task 3577 ms: download 2321 ms overlapping gunzip 474 ms, parse 1629 ms, sort 0 ms, write 0 ms, index 572 ms: 4 candidates, 62109 repo-hours, 498 releases; waiting 531 ms; commit 0 ms)
2026-11-08T14:16:34Z [load_day 2025-10-21] 2025-10-21 hour 6: 142204 events in 0 files, snapshot none (task 3785 ms: download 2524 ms overlapping gunzip 544 ms, parse 1643 ms, sort 0 ms, write 0 ms, index 757 ms: 2 candidates, 72553 repo-hours, 547 releases; waiting 611 ms; commit 0 ms)
2026-11-08T14:16:35Z [load_day 2025-10-21] 2025-10-21 hour 7: 144411 events in 0 files, snapshot none (task 4535 ms: download 2483 ms overlapping gunzip 685 ms, parse 2126 ms, sort 0 ms, write 0 ms, index 535 ms: 7 candidates, 71139 repo-hours, 562 releases; waiting 584 ms; commit 0 ms)
2026-11-08T14:16:38Z [load_day 2025-10-21] 2025-10-21 hour 8: 141569 events in 0 files, snapshot none (task 3751 ms: download 2504 ms overlapping gunzip 509 ms, parse 1525 ms, sort 0 ms, write 0 ms, index 664 ms: 6 candidates, 72719 repo-hours, 550 releases; waiting 728 ms; commit 0 ms)
2026-11-08T14:16:39Z [load_day 2025-10-21] 2025-10-21 hour 9: 145234 events in 0 files, snapshot none (task 3956 ms: download 2758 ms overlapping gunzip 611 ms, parse 1889 ms, sort 0 ms, write 0 ms, index 566 ms: 5 candidates, 72997 repo-hours, 613 releases; waiting 621 ms; commit 0 ms)
2026-11-08T14:16:43Z [load_day 2025-10-21] 2025-10-21 hour 10: 145567 events in 0 files, snapshot none (task 3877 ms: download 2435 ms overlapping gunzip 501 ms, parse 1537 ms, sort 0 ms, write 0 ms, index 780 ms: 7 candidates, 72278 repo-hours, 510 releases; waiting 772 ms; commit 0 ms)
2026-11-08T14:16:43Z [load_day 2025-10-21] 2025-10-21 hour 11: 145909 events in 0 files, snapshot none (task 3625 ms: download 2461 ms overlapping gunzip 524 ms, parse 1578 ms, sort 0 ms, write 0 ms, index 535 ms: 6 candidates, 71959 repo-hours, 549 releases; waiting 640 ms; commit 0 ms)
2026-11-08T14:16:47Z [load_day 2025-10-21] 2025-10-21 hour 12: 155691 events in 0 files, snapshot none (task 3577 ms: download 2148 ms overlapping gunzip 474 ms, parse 1391 ms, sort 0 ms, write 0 ms, index 824 ms: 3 candidates, 94451 repo-hours, 365 releases; waiting 591 ms; commit 0 ms)
2026-11-08T14:16:47Z [load_day 2025-10-21] 2025-10-21 hour 13: 145737 events in 0 files, snapshot none (task 3298 ms: download 2077 ms overlapping gunzip 417 ms, parse 1272 ms, sort 0 ms, write 0 ms, index 816 ms: 2 candidates, 84949 repo-hours, 382 releases; waiting 510 ms; commit 0 ms)
2026-11-08T14:16:52Z [load_day 2025-10-21] 2025-10-21 hour 14: 142518 events in 0 files, snapshot none (task 4445 ms: download 3020 ms overlapping gunzip 550 ms, parse 1682 ms, sort 0 ms, write 0 ms, index 733 ms: 5 candidates, 75705 repo-hours, 559 releases; waiting 1152 ms; commit 0 ms)
2026-11-08T14:16:52Z [load_day 2025-10-21] 2025-10-21 hour 15: 143661 events in 0 files, snapshot none (task 4296 ms: download 2690 ms overlapping gunzip 614 ms, parse 1691 ms, sort 0 ms, write 0 ms, index 641 ms: 6 candidates, 78064 repo-hours, 592 releases; waiting 1117 ms; commit 0 ms)
2026-11-08T14:16:57Z [load_day 2025-10-21] 2025-10-21 hour 16: 144609 events in 0 files, snapshot none (task 3937 ms: download 2225 ms overlapping gunzip 569 ms, parse 1723 ms, sort 0 ms, write 0 ms, index 864 ms: 7 candidates, 75887 repo-hours, 562 releases; waiting 529 ms; commit 0 ms)
2026-11-08T14:16:57Z [load_day 2025-10-21] 2025-10-21 hour 17: 145546 events in 0 files, snapshot none (task 3970 ms: download 2337 ms overlapping gunzip 599 ms, parse 1821 ms, sort 0 ms, write 0 ms, index 639 ms: 5 candidates, 72580 repo-hours, 493 releases; waiting 480 ms; commit 0 ms)
2026-11-08T14:17:01Z [load_day 2025-10-21] 2025-10-21 hour 18: 147860 events in 0 files, snapshot none (task 3701 ms: download 2420 ms overlapping gunzip 534 ms, parse 1655 ms, sort 0 ms, write 0 ms, index 619 ms: 3 candidates, 76383 repo-hours, 572 releases; waiting 649 ms; commit 0 ms)
2026-11-08T14:17:01Z [load_day 2025-10-21] 2025-10-21 hour 19: 142404 events in 0 files, snapshot none (task 3867 ms: download 2473 ms overlapping gunzip 516 ms, parse 1702 ms, sort 0 ms, write 0 ms, index 623 ms: 3 candidates, 67196 repo-hours, 631 releases; waiting 710 ms; commit 0 ms)
2026-11-08T14:17:05Z [load_day 2025-10-21] 2025-10-21 hour 20: 145357 events in 0 files, snapshot none (task 4014 ms: download 2397 ms overlapping gunzip 619 ms, parse 1858 ms, sort 0 ms, write 0 ms, index 596 ms: 3 candidates, 69754 repo-hours, 613 releases; waiting 561 ms; commit 0 ms)
2026-11-08T14:17:05Z [load_day 2025-10-21] 2025-10-21 hour 21: 144188 events in 0 files, snapshot none (task 3849 ms: download 2130 ms overlapping gunzip 613 ms, parse 1879 ms, sort 0 ms, write 0 ms, index 600 ms: 3 candidates, 66311 repo-hours, 640 releases; waiting 439 ms; commit 0 ms)
2026-11-08T14:17:10Z [load_day 2025-10-21] 2025-10-21 hour 22: 143702 events in 0 files, snapshot none (task 3655 ms: download 2173 ms overlapping gunzip 570 ms, parse 1663 ms, sort 0 ms, write 0 ms, index 573 ms: 6 candidates, 61440 repo-hours, 645 releases; waiting 553 ms; commit 0 ms)
2026-11-08T14:17:10Z [load_day 2025-10-21] 2025-10-21 hour 23: 142934 events in 0 files, snapshot none (task 3953 ms: download 2382 ms overlapping gunzip 598 ms, parse 2035 ms, sort 0 ms, write 0 ms, index 527 ms: 3 candidates, 58974 repo-hours, 626 releases; waiting 539 ms; commit 0 ms)
2026-11-08T14:17:18Z [load_day 2025-10-21] 2025-10-21: repo_hour merged from 24 files to 1 (1741949 rows, 7948 ms)
2026-11-08T14:17:21Z [load_day 2025-10-21] 2025-10-21: index committed in 11183 ms (24 + 1 + 24 files)
2026-11-08T14:17:21Z [load_day 2025-10-21] 2025-10-21: 3483134 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:17:21Z [load_day 2025-10-21] attempt 1 succeeded