orcaLog in

Runs · run 4289

load_day 2025-08-18, attempt 1 succeeded

Host
73ccef5e07c2:363290
Started
2026-11-08T13:26:17Z
Ended
2026-11-08T13:28:16Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
696 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
175.7 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4289/load_day/2025-08-18/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:26:17Z [load_day 2025-08-18] attempt 1 started
2026-11-08T13:26:18Z [load_day 2025-08-18] 2025-08-18: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:26:25Z [load_day 2025-08-18] 2025-08-18 hour 0: 142738 events in 0 files, snapshot none (task 5935 ms: download 3821 ms overlapping gunzip 859 ms, parse 3409 ms, sort 0 ms, write 0 ms, index 736 ms: 8 candidates, 64000 repo-hours, 1111 releases; waiting 448 ms; commit 0 ms)
2026-11-08T13:26:28Z [load_day 2025-08-18] 2025-08-18 hour 1: 158279 events in 0 files, snapshot none (task 9353 ms: download 6173 ms overlapping gunzip 1063 ms, parse 4105 ms, sort 0 ms, write 0 ms, index 823 ms: 7 candidates, 88125 repo-hours, 746 releases; waiting 3011 ms; commit 0 ms)
2026-11-08T13:26:32Z [load_day 2025-08-18] 2025-08-18 hour 2: 151214 events in 0 files, snapshot none (task 6953 ms: download 4014 ms overlapping gunzip 1116 ms, parse 4362 ms, sort 0 ms, write 0 ms, index 692 ms: 5 candidates, 77416 repo-hours, 829 releases; waiting 494 ms; commit 0 ms)
2026-11-08T13:26:36Z [load_day 2025-08-18] 2025-08-18 hour 3: 147262 events in 0 files, snapshot none (task 6894 ms: download 3813 ms overlapping gunzip 1094 ms, parse 4031 ms, sort 0 ms, write 0 ms, index 904 ms: 6 candidates, 65204 repo-hours, 854 releases; waiting 517 ms; commit 0 ms)
2026-11-08T13:26:39Z [load_day 2025-08-18] 2025-08-18 hour 4: 149442 events in 0 files, snapshot none (task 6697 ms: download 3845 ms overlapping gunzip 1064 ms, parse 4049 ms, sort 0 ms, write 0 ms, index 746 ms: 8 candidates, 67397 repo-hours, 1893 releases; waiting 519 ms; commit 0 ms)
2026-11-08T13:26:42Z [load_day 2025-08-18] 2025-08-18 hour 5: 151750 events in 0 files, snapshot none (task 5987 ms: download 3839 ms overlapping gunzip 1088 ms, parse 3690 ms, sort 0 ms, write 0 ms, index 535 ms: 5 candidates, 65543 repo-hours, 585 releases; waiting 419 ms; commit 0 ms)
2026-11-08T13:26:49Z [load_day 2025-08-18] 2025-08-18 hour 6: 160130 events in 0 files, snapshot none (task 8831 ms: download 6420 ms overlapping gunzip 1353 ms, parse 4775 ms, sort 0 ms, write 0 ms, index 613 ms: 13 candidates, 78213 repo-hours, 677 releases; waiting 1674 ms; commit 0 ms)
2026-11-08T13:26:50Z [load_day 2025-08-18] 2025-08-18 hour 7: 160365 events in 0 files, snapshot none (task 7170 ms: download 4841 ms overlapping gunzip 1228 ms, parse 4378 ms, sort 0 ms, write 0 ms, index 605 ms: 13 candidates, 74691 repo-hours, 677 releases; waiting 565 ms; commit 0 ms)
2026-11-08T13:26:56Z [load_day 2025-08-18] 2025-08-18 hour 8: 159885 events in 0 files, snapshot none (task 6802 ms: download 4510 ms overlapping gunzip 1170 ms, parse 4243 ms, sort 0 ms, write 0 ms, index 577 ms: 3 candidates, 78495 repo-hours, 702 releases; waiting 571 ms; commit 0 ms)
2026-11-08T13:26:57Z [load_day 2025-08-18] 2025-08-18 hour 9: 160998 events in 0 files, snapshot none (task 6895 ms: download 4488 ms overlapping gunzip 1167 ms, parse 4165 ms, sort 0 ms, write 0 ms, index 623 ms: 10 candidates, 77574 repo-hours, 777 releases; waiting 524 ms; commit 0 ms)
2026-11-08T13:27:02Z [load_day 2025-08-18] 2025-08-18 hour 10: 159400 events in 0 files, snapshot none (task 6280 ms: download 3842 ms overlapping gunzip 1045 ms, parse 3812 ms, sort 0 ms, write 0 ms, index 604 ms: 5 candidates, 76183 repo-hours, 777 releases; waiting 523 ms; commit 0 ms)
2026-11-08T13:27:04Z [load_day 2025-08-18] 2025-08-18 hour 11: 162358 events in 0 files, snapshot none (task 6232 ms: download 3840 ms overlapping gunzip 963 ms, parse 3679 ms, sort 0 ms, write 0 ms, index 659 ms: 11 candidates, 76105 repo-hours, 834 releases; waiting 566 ms; commit 0 ms)
2026-11-08T13:27:12Z [load_day 2025-08-18] 2025-08-18 hour 12: 166850 events in 0 files, snapshot none (task 9668 ms: download 6866 ms overlapping gunzip 1053 ms, parse 4113 ms, sort 0 ms, write 0 ms, index 799 ms: 12 candidates, 96505 repo-hours, 772 releases; waiting 3361 ms; commit 0 ms)
2026-11-08T13:27:13Z [load_day 2025-08-18] 2025-08-18 hour 13: 168199 events in 0 files, snapshot none (task 8738 ms: download 5873 ms overlapping gunzip 1196 ms, parse 4938 ms, sort 0 ms, write 0 ms, index 662 ms: 4 candidates, 92604 repo-hours, 763 releases; waiting 1657 ms; commit 0 ms)
2026-11-08T13:27:21Z [load_day 2025-08-18] 2025-08-18 hour 14: 165873 events in 0 files, snapshot none (task 8169 ms: download 4288 ms overlapping gunzip 1360 ms, parse 5017 ms, sort 0 ms, write 0 ms, index 920 ms: 7 candidates, 83840 repo-hours, 777 releases; waiting 614 ms; commit 0 ms)
2026-11-08T13:27:22Z [load_day 2025-08-18] 2025-08-18 hour 15: 167244 events in 0 files, snapshot none (task 7988 ms: download 5072 ms overlapping gunzip 1352 ms, parse 5200 ms, sort 0 ms, write 0 ms, index 678 ms: 9 candidates, 84663 repo-hours, 928 releases; waiting 493 ms; commit 0 ms)
2026-11-08T13:27:30Z [load_day 2025-08-18] 2025-08-18 hour 16: 165748 events in 0 files, snapshot none (task 8182 ms: download 5178 ms overlapping gunzip 1271 ms, parse 5398 ms, sort 0 ms, write 0 ms, index 737 ms: 15 candidates, 81969 repo-hours, 809 releases; waiting 548 ms; commit 0 ms)
2026-11-08T13:27:30Z [load_day 2025-08-18] 2025-08-18 hour 17: 159539 events in 0 files, snapshot none (task 7884 ms: download 4725 ms overlapping gunzip 1350 ms, parse 5050 ms, sort 0 ms, write 0 ms, index 715 ms: 7 candidates, 77184 repo-hours, 712 releases; waiting 504 ms; commit 0 ms)
2026-11-08T13:27:39Z [load_day 2025-08-18] 2025-08-18 hour 18: 162765 events in 0 files, snapshot none (task 8571 ms: download 5907 ms overlapping gunzip 1530 ms, parse 5742 ms, sort 0 ms, write 0 ms, index 667 ms: 10 candidates, 83153 repo-hours, 859 releases; waiting 361 ms; commit 0 ms)
2026-11-08T13:27:39Z [load_day 2025-08-18] 2025-08-18 hour 19: 157378 events in 0 files, snapshot none (task 8001 ms: download 4900 ms overlapping gunzip 1417 ms, parse 5121 ms, sort 0 ms, write 0 ms, index 938 ms: 9 candidates, 72826 repo-hours, 784 releases; waiting 234 ms; commit 0 ms)
2026-11-08T13:27:48Z [load_day 2025-08-18] 2025-08-18 hour 20: 154141 events in 0 files, snapshot none (task 8207 ms: download 5506 ms overlapping gunzip 1336 ms, parse 5350 ms, sort 0 ms, write 0 ms, index 561 ms: 5 candidates, 69986 repo-hours, 758 releases; waiting 721 ms; commit 0 ms)
2026-11-08T13:27:48Z [load_day 2025-08-18] 2025-08-18 hour 21: 155213 events in 0 files, snapshot none (task 8296 ms: download 5866 ms overlapping gunzip 1409 ms, parse 5360 ms, sort 0 ms, write 0 ms, index 616 ms: 5 candidates, 66667 repo-hours, 876 releases; waiting 616 ms; commit 0 ms)
2026-11-08T13:27:56Z [load_day 2025-08-18] 2025-08-18 hour 22: 148259 events in 0 files, snapshot none (task 7630 ms: download 5265 ms overlapping gunzip 1400 ms, parse 4900 ms, sort 0 ms, write 0 ms, index 455 ms: 7 candidates, 62713 repo-hours, 878 releases; waiting 590 ms; commit 0 ms)
2026-11-08T13:27:56Z [load_day 2025-08-18] 2025-08-18 hour 23: 144800 events in 0 files, snapshot none (task 6956 ms: download 4720 ms overlapping gunzip 1243 ms, parse 4415 ms, sort 0 ms, write 0 ms, index 702 ms: 11 candidates, 60353 repo-hours, 731 releases; waiting 385 ms; commit 0 ms)
2026-11-08T13:28:05Z [load_day 2025-08-18] 2025-08-18: repo_hour merged from 24 files to 1 (1821409 rows, 8628 ms)
2026-11-08T13:28:16Z [load_day 2025-08-18] 2025-08-18: index committed in 19685 ms (24 + 1 + 24 files)
2026-11-08T13:28:16Z [load_day 2025-08-18] 2025-08-18: 3779830 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:28:16Z [load_day 2025-08-18] attempt 1 succeeded