orcaLog in

Runs · run 4557

load_day 2025-10-30, attempt 1 succeeded

Host
73ccef5e07c2:398527
Started
2026-11-08T14:20:37Z
Ended
2026-11-08T14:21:46Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
683 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
71.3 s, up to 2.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4557/load_day/2025-10-30/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:20:37Z [load_day 2025-10-30] attempt 1 started
2026-11-08T14:20:38Z [load_day 2025-10-30] 2025-10-30: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:20:42Z [load_day 2025-10-30] 2025-10-30 hour 0: 145280 events in 0 files, snapshot none (task 3119 ms: download 1831 ms overlapping gunzip 402 ms, parse 1311 ms, sort 0 ms, write 0 ms, index 614 ms: 6 candidates, 73782 repo-hours, 733 releases; waiting 414 ms; commit 0 ms)
2026-11-08T14:20:42Z [load_day 2025-10-30] 2025-10-30 hour 1: 147424 events in 0 files, snapshot none (task 3335 ms: download 2191 ms overlapping gunzip 430 ms, parse 1295 ms, sort 0 ms, write 0 ms, index 659 ms: 4 candidates, 87434 repo-hours, 681 releases; waiting 637 ms; commit 0 ms)
2026-11-08T14:20:48Z [load_day 2025-10-30] 2025-10-30 hour 2: 145214 events in 0 files, snapshot none (task 5607 ms: download 4522 ms overlapping gunzip 373 ms, parse 1186 ms, sort 0 ms, write 0 ms, index 540 ms: 5 candidates, 71061 repo-hours, 751 releases; waiting 3029 ms; commit 0 ms)
2026-11-08T14:20:48Z [load_day 2025-10-30] 2025-10-30 hour 3: 144667 events in 0 files, snapshot none (task 3293 ms: download 2042 ms overlapping gunzip 367 ms, parse 1193 ms, sort 0 ms, write 0 ms, index 595 ms: 10 candidates, 69607 repo-hours, 1618 releases; waiting 831 ms; commit 0 ms)
2026-11-08T14:20:52Z [load_day 2025-10-30] 2025-10-30 hour 4: 144882 events in 0 files, snapshot none (task 3152 ms: download 2177 ms overlapping gunzip 360 ms, parse 1117 ms, sort 0 ms, write 0 ms, index 503 ms: 3 candidates, 64587 repo-hours, 620 releases; waiting 844 ms; commit 0 ms)
2026-11-08T14:20:52Z [load_day 2025-10-30] 2025-10-30 hour 5: 145606 events in 0 files, snapshot none (task 3149 ms: download 1993 ms overlapping gunzip 399 ms, parse 1266 ms, sort 0 ms, write 0 ms, index 513 ms: 5 candidates, 67212 repo-hours, 686 releases; waiting 745 ms; commit 0 ms)
2026-11-08T14:20:56Z [load_day 2025-10-30] 2025-10-30 hour 6: 147650 events in 0 files, snapshot none (task 4078 ms: download 2371 ms overlapping gunzip 402 ms, parse 1260 ms, sort 0 ms, write 0 ms, index 849 ms: 3 candidates, 74020 repo-hours, 911 releases; waiting 1105 ms; commit 0 ms)
2026-11-08T14:20:58Z [load_day 2025-10-30] 2025-10-30 hour 7: 142707 events in 0 files, snapshot none (task 5741 ms: download 3189 ms overlapping gunzip 522 ms, parse 1435 ms, sort 0 ms, write 0 ms, index 1672 ms: 3 candidates, 70123 repo-hours, 569 releases; waiting 1813 ms; commit 0 ms)
2026-11-08T14:21:03Z [load_day 2025-10-30] 2025-10-30 hour 8: 144752 events in 0 files, snapshot none (task 3923 ms: download 2537 ms overlapping gunzip 590 ms, parse 1748 ms, sort 0 ms, write 0 ms, index 709 ms: 8 candidates, 74930 repo-hours, 634 releases; waiting 531 ms; commit 0 ms)
2026-11-08T14:21:03Z [load_day 2025-10-30] 2025-10-30 hour 9: 142963 events in 0 files, snapshot none (task 3850 ms: download 1972 ms overlapping gunzip 615 ms, parse 1781 ms, sort 0 ms, write 0 ms, index 584 ms: 3 candidates, 74899 repo-hours, 753 releases; waiting 568 ms; commit 0 ms)
2026-11-08T14:21:08Z [load_day 2025-10-30] 2025-10-30 hour 10: 147931 events in 0 files, snapshot none (task 4597 ms: download 3257 ms overlapping gunzip 620 ms, parse 1875 ms, sort 0 ms, write 0 ms, index 560 ms: 5 candidates, 74447 repo-hours, 646 releases; waiting 1163 ms; commit 0 ms)
2026-11-08T14:21:08Z [load_day 2025-10-30] 2025-10-30 hour 11: 146937 events in 0 files, snapshot none (task 3766 ms: download 2214 ms overlapping gunzip 569 ms, parse 1661 ms, sort 0 ms, write 0 ms, index 617 ms: 6 candidates, 72100 repo-hours, 582 releases; waiting 582 ms; commit 0 ms)
2026-11-08T14:21:13Z [load_day 2025-10-30] 2025-10-30 hour 12: 157469 events in 0 files, snapshot none (task 3990 ms: download 2115 ms overlapping gunzip 531 ms, parse 1699 ms, sort 0 ms, write 0 ms, index 858 ms: 12 candidates, 95559 repo-hours, 385 releases; waiting 540 ms; commit 0 ms)
2026-11-08T14:21:13Z [load_day 2025-10-30] 2025-10-30 hour 13: 148041 events in 0 files, snapshot none (task 4115 ms: download 2581 ms overlapping gunzip 558 ms, parse 1769 ms, sort 0 ms, write 0 ms, index 764 ms: 7 candidates, 87256 repo-hours, 417 releases; waiting 733 ms; commit 0 ms)
2026-11-08T14:21:17Z [load_day 2025-10-30] 2025-10-30 hour 14: 144711 events in 0 files, snapshot none (task 4356 ms: download 2544 ms overlapping gunzip 649 ms, parse 2059 ms, sort 0 ms, write 0 ms, index 824 ms: 7 candidates, 78184 repo-hours, 638 releases; waiting 550 ms; commit 0 ms)
2026-11-08T14:21:17Z [load_day 2025-10-30] 2025-10-30 hour 15: 147995 events in 0 files, snapshot none (task 4197 ms: download 2077 ms overlapping gunzip 639 ms, parse 1984 ms, sort 0 ms, write 0 ms, index 683 ms: 6 candidates, 80249 repo-hours, 538 releases; waiting 516 ms; commit 0 ms)
2026-11-08T14:21:22Z [load_day 2025-10-30] 2025-10-30 hour 16: 147623 events in 0 files, snapshot none (task 3915 ms: download 2334 ms overlapping gunzip 531 ms, parse 1498 ms, sort 0 ms, write 0 ms, index 724 ms: 4 candidates, 79543 repo-hours, 609 releases; waiting 811 ms; commit 0 ms)
2026-11-08T14:21:22Z [load_day 2025-10-30] 2025-10-30 hour 17: 143892 events in 0 files, snapshot none (task 3679 ms: download 1787 ms overlapping gunzip 523 ms, parse 1630 ms, sort 0 ms, write 0 ms, index 667 ms: 9 candidates, 75585 repo-hours, 511 releases; waiting 562 ms; commit 0 ms)
2026-11-08T14:21:26Z [load_day 2025-10-30] 2025-10-30 hour 18: 145964 events in 0 files, snapshot none (task 3661 ms: download 2625 ms overlapping gunzip 407 ms, parse 1256 ms, sort 0 ms, write 0 ms, index 620 ms: 9 candidates, 78782 repo-hours, 610 releases; waiting 1064 ms; commit 0 ms)
2026-11-08T14:21:26Z [load_day 2025-10-30] 2025-10-30 hour 19: 141201 events in 0 files, snapshot none (task 2740 ms: download 1735 ms overlapping gunzip 376 ms, parse 1168 ms, sort 0 ms, write 0 ms, index 517 ms: 4 candidates, 68497 repo-hours, 674 releases; waiting 379 ms; commit 0 ms)
2026-11-08T14:21:30Z [load_day 2025-10-30] 2025-10-30 hour 20: 143558 events in 0 files, snapshot none (task 3196 ms: download 2034 ms overlapping gunzip 378 ms, parse 1160 ms, sort 0 ms, write 0 ms, index 617 ms: 8 candidates, 70007 repo-hours, 700 releases; waiting 652 ms; commit 0 ms)
2026-11-08T14:21:31Z [load_day 2025-10-30] 2025-10-30 hour 21: 144904 events in 0 files, snapshot none (task 4363 ms: download 3071 ms overlapping gunzip 371 ms, parse 1189 ms, sort 0 ms, write 0 ms, index 547 ms: 7 candidates, 68739 repo-hours, 736 releases; waiting 1921 ms; commit 0 ms)
2026-11-08T14:21:34Z [load_day 2025-10-30] 2025-10-30 hour 22: 142336 events in 0 files, snapshot none (task 3532 ms: download 2218 ms overlapping gunzip 435 ms, parse 1393 ms, sort 0 ms, write 0 ms, index 636 ms: 7 candidates, 65924 repo-hours, 650 releases; waiting 708 ms; commit 0 ms)
2026-11-08T14:21:35Z [load_day 2025-10-30] 2025-10-30 hour 23: 137510 events in 0 files, snapshot none (task 3402 ms: download 2097 ms overlapping gunzip 519 ms, parse 1485 ms, sort 0 ms, write 0 ms, index 484 ms: 3 candidates, 61898 repo-hours, 668 releases; waiting 545 ms; commit 0 ms)
2026-11-08T14:21:43Z [load_day 2025-10-30] 2025-10-30: repo_hour merged from 24 files to 1 (1784425 rows, 8125 ms)
2026-11-08T14:21:46Z [load_day 2025-10-30] 2025-10-30: index committed in 11281 ms (24 + 1 + 24 files)
2026-11-08T14:21:46Z [load_day 2025-10-30] 2025-10-30: 3491217 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:21:46Z [load_day 2025-10-30] attempt 1 succeeded