orcaLog in

Runs · run 4375

load_day 2025-09-10, attempt 1 succeeded

Host
73ccef5e07c2:376807
Started
2026-11-08T13:46:38Z
Ended
2026-11-08T13:48:34Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
809 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
169.1 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4375/load_day/2025-09-10/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:46:38Z [load_day 2025-09-10] attempt 1 started
2026-11-08T13:46:39Z [load_day 2025-09-10] 2025-09-10: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:46:47Z [load_day 2025-09-10] 2025-09-10 hour 0: 150367 events in 0 files, snapshot none (task 7289 ms: download 4428 ms overlapping gunzip 1219 ms, parse 4572 ms, sort 0 ms, write 0 ms, index 605 ms: 5 candidates, 78970 repo-hours, 1051 releases; waiting 498 ms; commit 0 ms)
2026-11-08T13:46:47Z [load_day 2025-09-10] 2025-09-10 hour 1: 161557 events in 0 files, snapshot none (task 7441 ms: download 4813 ms overlapping gunzip 1205 ms, parse 5025 ms, sort 0 ms, write 0 ms, index 674 ms: 9 candidates, 96368 repo-hours, 797 releases; waiting 238 ms; commit 0 ms)
2026-11-08T13:46:53Z [load_day 2025-09-10] 2025-09-10 hour 2: 149616 events in 0 files, snapshot none (task 5824 ms: download 3542 ms overlapping gunzip 839 ms, parse 3354 ms, sort 0 ms, write 0 ms, index 567 ms: 7 candidates, 76027 repo-hours, 779 releases; waiting 783 ms; commit 0 ms)
2026-11-08T13:46:53Z [load_day 2025-09-10] 2025-09-10 hour 3: 154750 events in 0 files, snapshot none (task 5516 ms: download 3310 ms overlapping gunzip 846 ms, parse 3217 ms, sort 0 ms, write 0 ms, index 539 ms: 10 candidates, 73287 repo-hours, 1784 releases; waiting 541 ms; commit 0 ms)
2026-11-08T13:46:59Z [load_day 2025-09-10] 2025-09-10 hour 4: 149310 events in 0 files, snapshot none (task 5062 ms: download 2926 ms overlapping gunzip 726 ms, parse 2848 ms, sort 0 ms, write 0 ms, index 577 ms: 4 candidates, 66084 repo-hours, 605 releases; waiting 535 ms; commit 0 ms)
2026-11-08T13:46:59Z [load_day 2025-09-10] 2025-09-10 hour 5: 154779 events in 0 files, snapshot none (task 5195 ms: download 3122 ms overlapping gunzip 798 ms, parse 3004 ms, sort 0 ms, write 0 ms, index 573 ms: 9 candidates, 69360 repo-hours, 658 releases; waiting 520 ms; commit 0 ms)
2026-11-08T13:47:06Z [load_day 2025-09-10] 2025-09-10 hour 6: 156802 events in 0 files, snapshot none (task 6331 ms: download 3242 ms overlapping gunzip 888 ms, parse 3530 ms, sort 0 ms, write 0 ms, index 1029 ms: 8 candidates, 80900 repo-hours, 751 releases; waiting 625 ms; commit 0 ms)
2026-11-08T13:47:07Z [load_day 2025-09-10] 2025-09-10 hour 7: 159313 events in 0 files, snapshot none (task 6940 ms: download 3623 ms overlapping gunzip 1081 ms, parse 4163 ms, sort 0 ms, write 0 ms, index 810 ms: 7 candidates, 77429 repo-hours, 694 releases; waiting 576 ms; commit 0 ms)
2026-11-08T13:47:15Z [load_day 2025-09-10] 2025-09-10 hour 8: 164001 events in 0 files, snapshot none (task 8142 ms: download 4426 ms overlapping gunzip 1287 ms, parse 4834 ms, sort 0 ms, write 0 ms, index 1363 ms: 9 candidates, 80807 repo-hours, 813 releases; waiting 359 ms; commit 0 ms)
2026-11-08T13:47:15Z [load_day 2025-09-10] 2025-09-10 hour 9: 162362 events in 0 files, snapshot none (task 8305 ms: download 4557 ms overlapping gunzip 1315 ms, parse 5227 ms, sort 0 ms, write 0 ms, index 942 ms: 9 candidates, 81829 repo-hours, 998 releases; waiting 521 ms; commit 0 ms)
2026-11-08T13:47:23Z [load_day 2025-09-10] 2025-09-10 hour 10: 161627 events in 0 files, snapshot none (task 7486 ms: download 4323 ms overlapping gunzip 1241 ms, parse 4888 ms, sort 0 ms, write 0 ms, index 946 ms: 9 candidates, 79559 repo-hours, 898 releases; waiting 185 ms; commit 0 ms)
2026-11-08T13:47:24Z [load_day 2025-09-10] 2025-09-10 hour 11: 161699 events in 0 files, snapshot none (task 8016 ms: download 4312 ms overlapping gunzip 1313 ms, parse 5137 ms, sort 0 ms, write 0 ms, index 732 ms: 4 candidates, 77430 repo-hours, 705 releases; waiting 512 ms; commit 0 ms)
2026-11-08T13:47:32Z [load_day 2025-09-10] 2025-09-10 hour 12: 168994 events in 0 files, snapshot none (task 8691 ms: download 5930 ms overlapping gunzip 1279 ms, parse 5372 ms, sort 0 ms, write 0 ms, index 986 ms: 4 candidates, 99549 repo-hours, 771 releases; waiting 522 ms; commit 0 ms)
2026-11-08T13:47:33Z [load_day 2025-09-10] 2025-09-10 hour 13: 169588 events in 0 files, snapshot none (task 8164 ms: download 5158 ms overlapping gunzip 1274 ms, parse 5047 ms, sort 0 ms, write 0 ms, index 840 ms: 18 candidates, 93963 repo-hours, 744 releases; waiting 671 ms; commit 0 ms)
2026-11-08T13:47:42Z [load_day 2025-09-10] 2025-09-10 hour 14: 168867 events in 0 files, snapshot none (task 8995 ms: download 5774 ms overlapping gunzip 1387 ms, parse 5542 ms, sort 0 ms, write 0 ms, index 739 ms: 8 candidates, 87193 repo-hours, 888 releases; waiting 847 ms; commit 0 ms)
2026-11-08T13:47:42Z [load_day 2025-09-10] 2025-09-10 hour 15: 166286 events in 0 files, snapshot none (task 8547 ms: download 5460 ms overlapping gunzip 1367 ms, parse 5644 ms, sort 0 ms, write 0 ms, index 648 ms: 6 candidates, 85336 repo-hours, 1003 releases; waiting 555 ms; commit 0 ms)
2026-11-08T13:47:51Z [load_day 2025-09-10] 2025-09-10 hour 16: 165018 events in 0 files, snapshot none (task 8514 ms: download 5587 ms overlapping gunzip 1220 ms, parse 4958 ms, sort 0 ms, write 0 ms, index 717 ms: 10 candidates, 84720 repo-hours, 988 releases; waiting 1246 ms; commit 0 ms)
2026-11-08T13:47:51Z [load_day 2025-09-10] 2025-09-10 hour 17: 162815 events in 0 files, snapshot none (task 8528 ms: download 6059 ms overlapping gunzip 1504 ms, parse 5504 ms, sort 0 ms, write 0 ms, index 666 ms: 11 candidates, 87816 repo-hours, 718 releases; waiting 546 ms; commit 0 ms)
2026-11-08T13:48:01Z [load_day 2025-09-10] 2025-09-10 hour 18: 166212 events in 0 files, snapshot none (task 10045 ms: download 7572 ms overlapping gunzip 1880 ms, parse 6531 ms, sort 0 ms, write 0 ms, index 713 ms: 7 candidates, 100783 repo-hours, 756 releases; waiting 619 ms; commit 0 ms)
2026-11-08T13:48:01Z [load_day 2025-09-10] 2025-09-10 hour 19: 161656 events in 0 files, snapshot none (task 9306 ms: download 6892 ms overlapping gunzip 1732 ms, parse 6003 ms, sort 0 ms, write 0 ms, index 715 ms: 5 candidates, 85346 repo-hours, 724 releases; waiting 522 ms; commit 0 ms)
2026-11-08T13:48:11Z [load_day 2025-09-10] 2025-09-10 hour 20: 161449 events in 0 files, snapshot none (task 9463 ms: download 7034 ms overlapping gunzip 1711 ms, parse 6214 ms, sort 0 ms, write 0 ms, index 645 ms: 11 candidates, 81765 repo-hours, 763 releases; waiting 520 ms; commit 0 ms)
2026-11-08T13:48:11Z [load_day 2025-09-10] 2025-09-10 hour 21: 157097 events in 0 files, snapshot none (task 8661 ms: download 6143 ms overlapping gunzip 1590 ms, parse 5416 ms, sort 0 ms, write 0 ms, index 662 ms: 4 candidates, 75350 repo-hours, 811 releases; waiting 586 ms; commit 0 ms)
2026-11-08T13:48:20Z [load_day 2025-09-10] 2025-09-10 hour 22: 149618 events in 0 files, snapshot none (task 8238 ms: download 5875 ms overlapping gunzip 1380 ms, parse 5594 ms, sort 0 ms, write 0 ms, index 463 ms: 6 candidates, 64403 repo-hours, 860 releases; waiting 491 ms; commit 0 ms)
2026-11-08T13:48:20Z [load_day 2025-09-10] 2025-09-10 hour 23: 144085 events in 0 files, snapshot none (task 7569 ms: download 4797 ms overlapping gunzip 1325 ms, parse 5221 ms, sort 0 ms, write 0 ms, index 519 ms: 4 candidates, 60637 repo-hours, 740 releases; waiting 253 ms; commit 0 ms)
2026-11-08T13:48:29Z [load_day 2025-09-10] 2025-09-10: repo_hour merged from 24 files to 1 (1944911 rows, 9225 ms)
2026-11-08T13:48:34Z [load_day 2025-09-10] 2025-09-10: index committed in 13702 ms (24 + 1 + 24 files)
2026-11-08T13:48:34Z [load_day 2025-09-10] 2025-09-10: 3827868 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:48:34Z [load_day 2025-09-10] attempt 1 succeeded