orcaLog in

Runs · run 4294

load_day 2025-08-20, attempt 1 succeeded

Host
73ccef5e07c2:364339
Started
2026-11-08T13:28:16Z
Ended
2026-11-08T13:30:04Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
702 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
154.0 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4294/load_day/2025-08-20/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:28:16Z [load_day 2025-08-20] attempt 1 started
2026-11-08T13:28:17Z [load_day 2025-08-20] 2025-08-20: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:28:25Z [load_day 2025-08-20] 2025-08-20 hour 0: 149706 events in 0 files, snapshot none (task 6976 ms: download 3792 ms overlapping gunzip 1119 ms, parse 4537 ms, sort 0 ms, write 0 ms, index 731 ms: 8 candidates, 76023 repo-hours, 1140 releases; waiting 251 ms; commit 0 ms)
2026-11-08T13:28:25Z [load_day 2025-08-20] 2025-08-20 hour 1: 158039 events in 0 files, snapshot none (task 6668 ms: download 3520 ms overlapping gunzip 1024 ms, parse 4189 ms, sort 0 ms, write 0 ms, index 667 ms: 3 candidates, 92328 repo-hours, 810 releases; waiting 546 ms; commit 0 ms)
2026-11-08T13:28:33Z [load_day 2025-08-20] 2025-08-20 hour 2: 146477 events in 0 files, snapshot none (task 7146 ms: download 4160 ms overlapping gunzip 1104 ms, parse 4535 ms, sort 0 ms, write 0 ms, index 573 ms: 7 candidates, 71184 repo-hours, 785 releases; waiting 584 ms; commit 0 ms)
2026-11-08T13:28:33Z [load_day 2025-08-20] 2025-08-20 hour 3: 148964 events in 0 files, snapshot none (task 6715 ms: download 3896 ms overlapping gunzip 1032 ms, parse 4017 ms, sort 0 ms, write 0 ms, index 662 ms: 4 candidates, 68765 repo-hours, 1999 releases; waiting 533 ms; commit 0 ms)
2026-11-08T13:28:38Z [load_day 2025-08-20] 2025-08-20 hour 4: 152326 events in 0 files, snapshot none (task 4851 ms: download 2809 ms overlapping gunzip 705 ms, parse 2843 ms, sort 0 ms, write 0 ms, index 454 ms: 7 candidates, 64849 repo-hours, 626 releases; waiting 519 ms; commit 0 ms)
2026-11-08T13:28:40Z [load_day 2025-08-20] 2025-08-20 hour 5: 154057 events in 0 files, snapshot none (task 7015 ms: download 4671 ms overlapping gunzip 785 ms, parse 3219 ms, sort 0 ms, write 0 ms, index 506 ms: 3 candidates, 63298 repo-hours, 623 releases; waiting 2183 ms; commit 0 ms)
2026-11-08T13:28:44Z [load_day 2025-08-20] 2025-08-20 hour 6: 158055 events in 0 files, snapshot none (task 5807 ms: download 3966 ms overlapping gunzip 791 ms, parse 3047 ms, sort 0 ms, write 0 ms, index 645 ms: 7 candidates, 76513 repo-hours, 784 releases; waiting 1034 ms; commit 0 ms)
2026-11-08T13:28:46Z [load_day 2025-08-20] 2025-08-20 hour 7: 159792 events in 0 files, snapshot none (task 5745 ms: download 3568 ms overlapping gunzip 900 ms, parse 3468 ms, sort 0 ms, write 0 ms, index 577 ms: 6 candidates, 72560 repo-hours, 768 releases; waiting 553 ms; commit 0 ms)
2026-11-08T13:28:52Z [load_day 2025-08-20] 2025-08-20 hour 8: 163403 events in 0 files, snapshot none (task 7436 ms: download 4230 ms overlapping gunzip 1165 ms, parse 4634 ms, sort 0 ms, write 0 ms, index 783 ms: 6 candidates, 80879 repo-hours, 874 releases; waiting 582 ms; commit 0 ms)
2026-11-08T13:28:54Z [load_day 2025-08-20] 2025-08-20 hour 9: 163653 events in 0 files, snapshot none (task 7091 ms: download 4590 ms overlapping gunzip 1080 ms, parse 4470 ms, sort 0 ms, write 0 ms, index 603 ms: 3 candidates, 79889 repo-hours, 945 releases; waiting 599 ms; commit 0 ms)
2026-11-08T13:29:01Z [load_day 2025-08-20] 2025-08-20 hour 10: 163743 events in 0 files, snapshot none (task 8221 ms: download 4480 ms overlapping gunzip 1299 ms, parse 5149 ms, sort 0 ms, write 0 ms, index 883 ms: 1 candidates, 78510 repo-hours, 854 releases; waiting 627 ms; commit 0 ms)
2026-11-08T13:29:02Z [load_day 2025-08-20] 2025-08-20 hour 11: 160629 events in 0 files, snapshot none (task 7110 ms: download 4338 ms overlapping gunzip 1180 ms, parse 4900 ms, sort 0 ms, write 0 ms, index 618 ms: 2 candidates, 75610 repo-hours, 753 releases; waiting 225 ms; commit 0 ms)
2026-11-08T13:29:09Z [load_day 2025-08-20] 2025-08-20 hour 12: 167035 events in 0 files, snapshot none (task 7314 ms: download 3814 ms overlapping gunzip 1099 ms, parse 4811 ms, sort 0 ms, write 0 ms, index 760 ms: 8 candidates, 96547 repo-hours, 843 releases; waiting 308 ms; commit 0 ms)
2026-11-08T13:29:11Z [load_day 2025-08-20] 2025-08-20 hour 13: 162379 events in 0 files, snapshot none (task 8704 ms: download 6066 ms overlapping gunzip 1277 ms, parse 5305 ms, sort 0 ms, write 0 ms, index 635 ms: 6 candidates, 89475 repo-hours, 839 releases; waiting 1247 ms; commit 0 ms)
2026-11-08T13:29:18Z [load_day 2025-08-20] 2025-08-20 hour 14: 165884 events in 0 files, snapshot none (task 8826 ms: download 5959 ms overlapping gunzip 1486 ms, parse 5664 ms, sort 0 ms, write 0 ms, index 703 ms: 9 candidates, 85794 repo-hours, 829 releases; waiting 673 ms; commit 0 ms)
2026-11-08T13:29:19Z [load_day 2025-08-20] 2025-08-20 hour 15: 168872 events in 0 files, snapshot none (task 8011 ms: download 5441 ms overlapping gunzip 1308 ms, parse 5227 ms, sort 0 ms, write 0 ms, index 642 ms: 10 candidates, 84063 repo-hours, 876 releases; waiting 483 ms; commit 0 ms)
2026-11-08T13:29:27Z [load_day 2025-08-20] 2025-08-20 hour 16: 159223 events in 0 files, snapshot none (task 7809 ms: download 4848 ms overlapping gunzip 1269 ms, parse 4969 ms, sort 0 ms, write 0 ms, index 705 ms: 8 candidates, 78026 repo-hours, 762 releases; waiting 554 ms; commit 0 ms)
2026-11-08T13:29:28Z [load_day 2025-08-20] 2025-08-20 hour 17: 164001 events in 0 files, snapshot none (task 7660 ms: download 4910 ms overlapping gunzip 1326 ms, parse 5173 ms, sort 0 ms, write 0 ms, index 604 ms: 6 candidates, 77251 repo-hours, 885 releases; waiting 249 ms; commit 0 ms)
2026-11-08T13:29:35Z [load_day 2025-08-20] 2025-08-20 hour 18: 162303 events in 0 files, snapshot none (task 8065 ms: download 5200 ms overlapping gunzip 1323 ms, parse 5187 ms, sort 0 ms, write 0 ms, index 695 ms: 7 candidates, 81839 repo-hours, 861 releases; waiting 536 ms; commit 0 ms)
2026-11-08T13:29:35Z [load_day 2025-08-20] 2025-08-20 hour 19: 156630 events in 0 files, snapshot none (task 7320 ms: download 4940 ms overlapping gunzip 1294 ms, parse 5015 ms, sort 0 ms, write 0 ms, index 582 ms: 4 candidates, 69866 repo-hours, 808 releases; waiting 227 ms; commit 0 ms)
2026-11-08T13:29:43Z [load_day 2025-08-20] 2025-08-20 hour 20: 156958 events in 0 files, snapshot none (task 7736 ms: download 5290 ms overlapping gunzip 1273 ms, parse 5039 ms, sort 0 ms, write 0 ms, index 541 ms: 4 candidates, 69356 repo-hours, 848 releases; waiting 569 ms; commit 0 ms)
2026-11-08T13:29:43Z [load_day 2025-08-20] 2025-08-20 hour 21: 152187 events in 0 files, snapshot none (task 7240 ms: download 4817 ms overlapping gunzip 1156 ms, parse 4744 ms, sort 0 ms, write 0 ms, index 587 ms: 7 candidates, 65525 repo-hours, 898 releases; waiting 514 ms; commit 0 ms)
2026-11-08T13:29:51Z [load_day 2025-08-20] 2025-08-20 hour 22: 146186 events in 0 files, snapshot none (task 7153 ms: download 4441 ms overlapping gunzip 1114 ms, parse 4734 ms, sort 0 ms, write 0 ms, index 520 ms: 5 candidates, 61093 repo-hours, 835 releases; waiting 523 ms; commit 0 ms)
2026-11-08T13:29:51Z [load_day 2025-08-20] 2025-08-20 hour 23: 148497 events in 0 files, snapshot none (task 6974 ms: download 4059 ms overlapping gunzip 1129 ms, parse 4630 ms, sort 0 ms, write 0 ms, index 571 ms: 6 candidates, 60194 repo-hours, 881 releases; waiting 368 ms; commit 0 ms)
2026-11-08T13:30:00Z [load_day 2025-08-20] 2025-08-20: repo_hour merged from 24 files to 1 (1819437 rows, 9061 ms)
2026-11-08T13:30:04Z [load_day 2025-08-20] 2025-08-20: index committed in 13205 ms (24 + 1 + 24 files)
2026-11-08T13:30:04Z [load_day 2025-08-20] 2025-08-20: 3788999 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:30:04Z [load_day 2025-08-20] attempt 1 succeeded