orcaLog in

Runs · run 4237

load_day 2025-08-05, attempt 1 succeeded

Host
73ccef5e07c2:355771
Started
2026-11-08T13:14:26Z
Ended
2026-11-08T13:16:31Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
714 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
159.7 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4237/load_day/2025-08-05/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:14:26Z [load_day 2025-08-05] attempt 1 started
2026-11-08T13:14:27Z [load_day 2025-08-05] 2025-08-05: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:14:35Z [load_day 2025-08-05] 2025-08-05 hour 0: 144534 events in 0 files, snapshot none (task 7021 ms: download 4524 ms overlapping gunzip 1171 ms, parse 4402 ms, sort 0 ms, write 0 ms, index 588 ms: 7 candidates, 68446 repo-hours, 1014 releases; waiting 501 ms; commit 0 ms)
2026-11-08T13:14:35Z [load_day 2025-08-05] 2025-08-05 hour 1: 156091 events in 0 files, snapshot none (task 6842 ms: download 4070 ms overlapping gunzip 1078 ms, parse 4398 ms, sort 0 ms, write 0 ms, index 687 ms: 8 candidates, 88257 repo-hours, 819 releases; waiting 250 ms; commit 0 ms)
2026-11-08T13:14:44Z [load_day 2025-08-05] 2025-08-05 hour 2: 150139 events in 0 files, snapshot none (task 8461 ms: download 5782 ms overlapping gunzip 1176 ms, parse 4654 ms, sort 0 ms, write 0 ms, index 651 ms: 5 candidates, 76960 repo-hours, 663 releases; waiting 1564 ms; commit 0 ms)
2026-11-08T13:14:44Z [load_day 2025-08-05] 2025-08-05 hour 3: 145531 events in 0 files, snapshot none (task 7676 ms: download 4740 ms overlapping gunzip 1297 ms, parse 5012 ms, sort 0 ms, write 0 ms, index 486 ms: 3 candidates, 65019 repo-hours, 808 releases; waiting 544 ms; commit 0 ms)
2026-11-08T13:14:53Z [load_day 2025-08-05] 2025-08-05 hour 4: 147749 events in 0 files, snapshot none (task 8418 ms: download 5075 ms overlapping gunzip 1314 ms, parse 5537 ms, sort 0 ms, write 0 ms, index 726 ms: 5 candidates, 69468 repo-hours, 1759 releases; waiting 516 ms; commit 0 ms)
2026-11-08T13:14:53Z [load_day 2025-08-05] 2025-08-05 hour 5: 154007 events in 0 files, snapshot none (task 8962 ms: download 6299 ms overlapping gunzip 1559 ms, parse 6083 ms, sort 0 ms, write 0 ms, index 548 ms: 5 candidates, 69332 repo-hours, 646 releases; waiting 506 ms; commit 0 ms)
2026-11-08T13:15:02Z [load_day 2025-08-05] 2025-08-05 hour 6: 161022 events in 0 files, snapshot none (task 8343 ms: download 5152 ms overlapping gunzip 1426 ms, parse 5349 ms, sort 0 ms, write 0 ms, index 721 ms: 2 candidates, 80649 repo-hours, 851 releases; waiting 516 ms; commit 0 ms)
2026-11-08T13:15:02Z [load_day 2025-08-05] 2025-08-05 hour 7: 154907 events in 0 files, snapshot none (task 8419 ms: download 5729 ms overlapping gunzip 1358 ms, parse 5633 ms, sort 0 ms, write 0 ms, index 671 ms: 7 candidates, 75490 repo-hours, 722 releases; waiting 525 ms; commit 0 ms)
2026-11-08T13:15:12Z [load_day 2025-08-05] 2025-08-05 hour 8: 161813 events in 0 files, snapshot none (task 9277 ms: download 6699 ms overlapping gunzip 1300 ms, parse 5128 ms, sort 0 ms, write 0 ms, index 631 ms: 8 candidates, 80600 repo-hours, 867 releases; waiting 1887 ms; commit 0 ms)
2026-11-08T13:15:12Z [load_day 2025-08-05] 2025-08-05 hour 9: 161296 events in 0 files, snapshot none (task 7746 ms: download 4596 ms overlapping gunzip 1186 ms, parse 4968 ms, sort 0 ms, write 0 ms, index 787 ms: 5 candidates, 80330 repo-hours, 961 releases; waiting 513 ms; commit 0 ms)
2026-11-08T13:15:21Z [load_day 2025-08-05] 2025-08-05 hour 10: 159314 events in 0 files, snapshot none (task 8488 ms: download 5337 ms overlapping gunzip 1431 ms, parse 5630 ms, sort 0 ms, write 0 ms, index 732 ms: 4 candidates, 78302 repo-hours, 810 releases; waiting 384 ms; commit 0 ms)
2026-11-08T13:15:21Z [load_day 2025-08-05] 2025-08-05 hour 11: 162181 events in 0 files, snapshot none (task 8710 ms: download 5755 ms overlapping gunzip 1475 ms, parse 5702 ms, sort 0 ms, write 0 ms, index 703 ms: 8 candidates, 77129 repo-hours, 804 releases; waiting 486 ms; commit 0 ms)
2026-11-08T13:15:30Z [load_day 2025-08-05] 2025-08-05 hour 12: 168639 events in 0 files, snapshot none (task 8862 ms: download 6035 ms overlapping gunzip 1465 ms, parse 5819 ms, sort 0 ms, write 0 ms, index 820 ms: 7 candidates, 97157 repo-hours, 936 releases; waiting 498 ms; commit 0 ms)
2026-11-08T13:15:30Z [load_day 2025-08-05] 2025-08-05 hour 13: 165385 events in 0 files, snapshot none (task 8605 ms: download 5801 ms overlapping gunzip 1413 ms, parse 5478 ms, sort 0 ms, write 0 ms, index 770 ms: 6 candidates, 93257 repo-hours, 913 releases; waiting 576 ms; commit 0 ms)
2026-11-08T13:15:37Z [load_day 2025-08-05] 2025-08-05 hour 14: 165156 events in 0 files, snapshot none (task 6831 ms: download 4034 ms overlapping gunzip 1075 ms, parse 4135 ms, sort 0 ms, write 0 ms, index 842 ms: 4 candidates, 85429 repo-hours, 934 releases; waiting 510 ms; commit 0 ms)
2026-11-08T13:15:46Z [load_day 2025-08-05] 2025-08-05 hour 15: 161543 events in 0 files, snapshot none (task 15848 ms: download 14706 ms overlapping gunzip 996 ms, parse 4000 ms, sort 0 ms, write 0 ms, index 785 ms: 7 candidates, 83048 repo-hours, 888 releases; waiting 9726 ms; commit 0 ms)
2026-11-08T13:15:46Z [load_day 2025-08-05] 2025-08-05 hour 16: 161323 events in 0 files, snapshot none (task 5977 ms: download 3574 ms overlapping gunzip 912 ms, parse 3662 ms, sort 0 ms, write 0 ms, index 612 ms: 9 candidates, 81762 repo-hours, 770 releases; waiting 502 ms; commit 0 ms)
2026-11-08T13:15:56Z [load_day 2025-08-05] 2025-08-05 hour 17: 165110 events in 0 files, snapshot none (task 8714 ms: download 4850 ms overlapping gunzip 1400 ms, parse 5502 ms, sort 0 ms, write 0 ms, index 1111 ms: 6 candidates, 79737 repo-hours, 852 releases; waiting 365 ms; commit 0 ms)
2026-11-08T13:15:56Z [load_day 2025-08-05] 2025-08-05 hour 18: 158599 events in 0 files, snapshot none (task 8241 ms: download 4417 ms overlapping gunzip 1359 ms, parse 5221 ms, sort 0 ms, write 0 ms, index 812 ms: 4 candidates, 81410 repo-hours, 934 releases; waiting 504 ms; commit 0 ms)
2026-11-08T13:16:06Z [load_day 2025-08-05] 2025-08-05 hour 19: 155651 events in 0 files, snapshot none (task 9653 ms: download 7174 ms overlapping gunzip 1068 ms, parse 4496 ms, sort 0 ms, write 0 ms, index 641 ms: 8 candidates, 71717 repo-hours, 857 releases; waiting 3104 ms; commit 0 ms)
2026-11-08T13:16:06Z [load_day 2025-08-05] 2025-08-05 hour 20: 155485 events in 0 files, snapshot none (task 7485 ms: download 4201 ms overlapping gunzip 1165 ms, parse 4584 ms, sort 0 ms, write 0 ms, index 763 ms: 8 candidates, 71072 repo-hours, 865 releases; waiting 661 ms; commit 0 ms)
2026-11-08T13:16:14Z [load_day 2025-08-05] 2025-08-05 hour 21: 150932 events in 0 files, snapshot none (task 7373 ms: download 4896 ms overlapping gunzip 1196 ms, parse 4737 ms, sort 0 ms, write 0 ms, index 532 ms: 5 candidates, 66557 repo-hours, 960 releases; waiting 508 ms; commit 0 ms)
2026-11-08T13:16:14Z [load_day 2025-08-05] 2025-08-05 hour 22: 143974 events in 0 files, snapshot none (task 6758 ms: download 4241 ms overlapping gunzip 1105 ms, parse 4306 ms, sort 0 ms, write 0 ms, index 491 ms: 6 candidates, 60479 repo-hours, 904 releases; waiting 536 ms; commit 0 ms)
2026-11-08T13:16:20Z [load_day 2025-08-05] 2025-08-05 hour 23: 143195 events in 0 files, snapshot none (task 5540 ms: download 3292 ms overlapping gunzip 839 ms, parse 3411 ms, sort 0 ms, write 0 ms, index 411 ms: 5 candidates, 57728 repo-hours, 812 releases; waiting 550 ms; commit 0 ms)
2026-11-08T13:16:28Z [load_day 2025-08-05] 2025-08-05: repo_hour merged from 24 files to 1 (1839335 rows, 8428 ms)
2026-11-08T13:16:31Z [load_day 2025-08-05] 2025-08-05: index committed in 11223 ms (24 + 1 + 24 files)
2026-11-08T13:16:31Z [load_day 2025-08-05] 2025-08-05: 3753576 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:16:31Z [load_day 2025-08-05] attempt 1 succeeded