orcaLog in

Runs · run 4367

load_day 2025-09-08, attempt 1 succeeded

Host
73ccef5e07c2:375269
Started
2026-11-08T13:44:23Z
Ended
2026-11-08T13:46:37Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
636 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
132.1 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4367/load_day/2025-09-08/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:44:23Z [load_day 2025-09-08] attempt 1 started
2026-11-08T13:44:24Z [load_day 2025-09-08] 2025-09-08: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:44:33Z [load_day 2025-09-08] 2025-09-08 hour 0: 147123 events in 0 files, snapshot none (task 7809 ms: download 5327 ms overlapping gunzip 1395 ms, parse 4821 ms, sort 0 ms, write 0 ms, index 529 ms: 8 candidates, 71759 repo-hours, 1125 releases; waiting 546 ms; commit 0 ms)
2026-11-08T13:44:33Z [load_day 2025-09-08] 2025-09-08 hour 1: 157536 events in 0 files, snapshot none (task 6964 ms: download 4449 ms overlapping gunzip 1189 ms, parse 4322 ms, sort 0 ms, write 0 ms, index 620 ms: 6 candidates, 92541 repo-hours, 786 releases; waiting 566 ms; commit 0 ms)
2026-11-08T13:44:41Z [load_day 2025-09-08] 2025-09-08 hour 2: 147854 events in 0 files, snapshot none (task 7643 ms: download 4820 ms overlapping gunzip 1388 ms, parse 4867 ms, sort 0 ms, write 0 ms, index 538 ms: 4 candidates, 71079 repo-hours, 769 releases; waiting 541 ms; commit 0 ms)
2026-11-08T13:44:41Z [load_day 2025-09-08] 2025-09-08 hour 3: 149915 events in 0 files, snapshot none (task 7219 ms: download 4248 ms overlapping gunzip 1240 ms, parse 4487 ms, sort 0 ms, write 0 ms, index 731 ms: 10 candidates, 68053 repo-hours, 1972 releases; waiting 515 ms; commit 0 ms)
2026-11-08T13:44:50Z [load_day 2025-09-08] 2025-09-08 hour 4: 154890 events in 0 files, snapshot none (task 8091 ms: download 5464 ms overlapping gunzip 1473 ms, parse 5394 ms, sort 0 ms, write 0 ms, index 537 ms: 7 candidates, 65650 repo-hours, 561 releases; waiting 312 ms; commit 0 ms)
2026-11-08T13:44:50Z [load_day 2025-09-08] 2025-09-08 hour 5: 156131 events in 0 files, snapshot none (task 8390 ms: download 6025 ms overlapping gunzip 1287 ms, parse 4823 ms, sort 0 ms, write 0 ms, index 549 ms: 13 candidates, 66943 repo-hours, 612 releases; waiting 1381 ms; commit 0 ms)
2026-11-08T13:44:58Z [load_day 2025-09-08] 2025-09-08 hour 6: 159727 events in 0 files, snapshot none (task 8228 ms: download 5607 ms overlapping gunzip 1410 ms, parse 5258 ms, sort 0 ms, write 0 ms, index 722 ms: 8 candidates, 80086 repo-hours, 722 releases; waiting 505 ms; commit 0 ms)
2026-11-08T13:44:59Z [load_day 2025-09-08] 2025-09-08 hour 7: 163427 events in 0 files, snapshot none (task 8572 ms: download 6218 ms overlapping gunzip 1533 ms, parse 5637 ms, sort 0 ms, write 0 ms, index 669 ms: 5 candidates, 76806 repo-hours, 719 releases; waiting 509 ms; commit 0 ms)
2026-11-08T13:45:11Z [load_day 2025-09-08] 2025-09-08 hour 8: 166089 events in 0 files, snapshot none (task 12142 ms: download 9727 ms overlapping gunzip 1415 ms, parse 5166 ms, sort 0 ms, write 0 ms, index 647 ms: 8 candidates, 81092 repo-hours, 816 releases; waiting 4629 ms; commit 0 ms)
2026-11-08T13:45:11Z [load_day 2025-09-08] 2025-09-08 hour 9: 161512 events in 0 files, snapshot none (task 11817 ms: download 9488 ms overlapping gunzip 1543 ms, parse 5588 ms, sort 0 ms, write 0 ms, index 599 ms: 12 candidates, 79855 repo-hours, 868 releases; waiting 3782 ms; commit 0 ms)
2026-11-08T13:45:19Z [load_day 2025-09-08] 2025-09-08 hour 10: 164653 events in 0 files, snapshot none (task 7186 ms: download 4949 ms overlapping gunzip 1210 ms, parse 4234 ms, sort 0 ms, write 0 ms, index 629 ms: 10 candidates, 78829 repo-hours, 715 releases; waiting 791 ms; commit 0 ms)
2026-11-08T13:46:01Z [load_day 2025-09-08] 2025-09-08 hour 11: 165005 events in 0 files, snapshot none (task 49807 ms: download 48824 ms overlapping gunzip 1615 ms, parse 6300 ms, sort 0 ms, write 0 ms, index 631 ms: 9 candidates, 78158 repo-hours, 698 releases; waiting 40922 ms; commit 0 ms)
2026-11-08T13:46:01Z [load_day 2025-09-08] 2025-09-08 hour 12: 164874 events in 0 files, snapshot none (task 8163 ms: download 4856 ms overlapping gunzip 1255 ms, parse 4994 ms, sort 0 ms, write 0 ms, index 1067 ms: 11 candidates, 96477 repo-hours, 705 releases; waiting 596 ms; commit 0 ms)
2026-11-08T13:46:12Z [load_day 2025-09-08] 2025-09-08 hour 13: 165671 events in 0 files, snapshot none (task 9720 ms: download 6361 ms overlapping gunzip 1543 ms, parse 6144 ms, sort 0 ms, write 0 ms, index 1227 ms: 10 candidates, 91661 repo-hours, 726 releases; waiting 561 ms; commit 0 ms)
2026-11-08T13:46:12Z [load_day 2025-09-08] 2025-09-08 hour 14: 166646 events in 0 files, snapshot none (task 9424 ms: download 6117 ms overlapping gunzip 1448 ms, parse 5742 ms, sort 0 ms, write 0 ms, index 1363 ms: 10 candidates, 85898 repo-hours, 799 releases; waiting 493 ms; commit 0 ms)
2026-11-08T13:46:20Z [load_day 2025-09-08] 2025-09-08 hour 15: 132019 events in 0 files, snapshot none (task 7549 ms: download 5214 ms overlapping gunzip 1141 ms, parse 4214 ms, sort 0 ms, write 0 ms, index 601 ms: 6 candidates, 71136 repo-hours, 693 releases; waiting 1343 ms; commit 0 ms)
2026-11-08T13:46:20Z [load_day 2025-09-08] 2025-09-08 hour 16: 59235 events in 0 files, snapshot none (task 4292 ms: download 2173 ms overlapping gunzip 511 ms, parse 2175 ms, sort 0 ms, write 0 ms, index 524 ms: 3 candidates, 33803 repo-hours, 296 releases; waiting 761 ms; commit 0 ms)
2026-11-08T13:46:23Z [load_day 2025-09-08] 2025-09-08 hour 17: 37196 events in 0 files, snapshot none (task 2709 ms: download 1484 ms overlapping gunzip 330 ms, parse 1246 ms, sort 0 ms, write 0 ms, index 258 ms: 3 candidates, 23248 repo-hours, 194 releases; waiting 580 ms; commit 0 ms)
2026-11-08T13:46:23Z [load_day 2025-09-08] 2025-09-08 hour 18: 988 events in 0 files, snapshot none (task 704 ms: download 347 ms overlapping gunzip 7 ms, parse 19 ms, sort 0 ms, write 0 ms, index 29 ms: 0 candidates, 823 repo-hours, 4 releases; waiting 349 ms; commit 0 ms)
2026-11-08T13:46:24Z [load_day 2025-09-08] 2025-09-08 hour 19: 1089 events in 0 files, snapshot none (task 485 ms: download 235 ms overlapping gunzip 3 ms, parse 22 ms, sort 0 ms, write 0 ms, index 15 ms: 0 candidates, 935 repo-hours, 0 releases; waiting 223 ms; commit 0 ms)
2026-11-08T13:46:24Z [load_day 2025-09-08] 2025-09-08 hour 20: 1551 events in 0 files, snapshot none (task 748 ms: download 393 ms overlapping gunzip 5 ms, parse 18 ms, sort 0 ms, write 0 ms, index 38 ms: 0 candidates, 1394 repo-hours, 2 releases; waiting 389 ms; commit 0 ms)
2026-11-08T13:46:25Z [load_day 2025-09-08] 2025-09-08 hour 21: 526 events in 0 files, snapshot none (task 572 ms: download 264 ms overlapping gunzip 1 ms, parse 9 ms, sort 0 ms, write 0 ms, index 25 ms: 0 candidates, 456 repo-hours, 4 releases; waiting 264 ms; commit 0 ms)
2026-11-08T13:46:25Z [load_day 2025-09-08] 2025-09-08 hour 22: 680 events in 0 files, snapshot none (task 578 ms: download 225 ms overlapping gunzip 2 ms, parse 7 ms, sort 0 ms, write 0 ms, index 35 ms: 0 candidates, 539 repo-hours, 5 releases; waiting 224 ms; commit 0 ms)
2026-11-08T13:46:27Z [load_day 2025-09-08] 2025-09-08 hour 23: 9979 events in 0 files, snapshot none (task 1210 ms: download 765 ms overlapping gunzip 79 ms, parse 269 ms, sort 0 ms, write 0 ms, index 127 ms: 1 candidates, 6543 repo-hours, 57 releases; waiting 517 ms; commit 0 ms)
2026-11-08T13:46:34Z [load_day 2025-09-08] 2025-09-08: repo_hour merged from 24 files to 1 (1323764 rows, 6817 ms)
2026-11-08T13:46:37Z [load_day 2025-09-08] 2025-09-08: index committed in 10239 ms (19 + 1 + 23 files)
2026-11-08T13:46:37Z [load_day 2025-09-08] 2025-09-08: 2634316 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:46:37Z [load_day 2025-09-08] attempt 1 succeeded