orcaLog in

Runs · run 3700

load_day 2025-03-22, attempt 1 succeeded

Host
73ccef5e07c2:274824
Started
2026-11-08T10:58:44Z
Ended
2026-11-08T11:00:25Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
706 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
139.6 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3700/load_day/2025-03-22/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:58:44Z [load_day 2025-03-22] attempt 1 started
2026-11-08T10:58:45Z [load_day 2025-03-22] 2025-03-22: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:58:52Z [load_day 2025-03-22] 2025-03-22 hour 0: 191774 events in 0 files, snapshot none (task 6655 ms: download 3684 ms overlapping gunzip 951 ms, parse 4179 ms, sort 0 ms, write 0 ms, index 925 ms: 3 candidates, 88236 repo-hours, 1356 releases; waiting 330 ms; commit 0 ms)
2026-11-08T10:58:52Z [load_day 2025-03-22] 2025-03-22 hour 1: 200223 events in 0 files, snapshot none (task 6555 ms: download 3573 ms overlapping gunzip 912 ms, parse 4035 ms, sort 0 ms, write 0 ms, index 910 ms: 6 candidates, 106454 repo-hours, 828 releases; waiting 480 ms; commit 0 ms)
2026-11-08T10:58:59Z [load_day 2025-03-22] 2025-03-22 hour 2: 172039 events in 0 files, snapshot none (task 6002 ms: download 3319 ms overlapping gunzip 874 ms, parse 3647 ms, sort 0 ms, write 0 ms, index 636 ms: 5 candidates, 72097 repo-hours, 844 releases; waiting 474 ms; commit 0 ms)
2026-11-08T10:58:59Z [load_day 2025-03-22] 2025-03-22 hour 3: 191345 events in 0 files, snapshot none (task 6469 ms: download 3439 ms overlapping gunzip 939 ms, parse 4167 ms, sort 0 ms, write 0 ms, index 527 ms: 4 candidates, 74115 repo-hours, 3353 releases; waiting 374 ms; commit 0 ms)
2026-11-08T10:59:05Z [load_day 2025-03-22] 2025-03-22 hour 4: 168961 events in 0 files, snapshot none (task 5762 ms: download 2937 ms overlapping gunzip 791 ms, parse 3458 ms, sort 0 ms, write 0 ms, index 728 ms: 8 candidates, 61908 repo-hours, 688 releases; waiting 527 ms; commit 0 ms)
2026-11-08T10:59:05Z [load_day 2025-03-22] 2025-03-22 hour 5: 172980 events in 0 files, snapshot none (task 5855 ms: download 2848 ms overlapping gunzip 858 ms, parse 3580 ms, sort 0 ms, write 0 ms, index 620 ms: 6 candidates, 63152 repo-hours, 883 releases; waiting 563 ms; commit 0 ms)
2026-11-08T10:59:12Z [load_day 2025-03-22] 2025-03-22 hour 6: 199114 events in 0 files, snapshot none (task 6010 ms: download 3052 ms overlapping gunzip 827 ms, parse 3601 ms, sort 0 ms, write 0 ms, index 676 ms: 2 candidates, 82523 repo-hours, 1190 releases; waiting 530 ms; commit 0 ms)
2026-11-08T10:59:12Z [load_day 2025-03-22] 2025-03-22 hour 7: 184937 events in 0 files, snapshot none (task 5850 ms: download 3016 ms overlapping gunzip 871 ms, parse 3763 ms, sort 0 ms, write 0 ms, index 650 ms: 4 candidates, 67431 repo-hours, 953 releases; waiting 259 ms; commit 0 ms)
2026-11-08T10:59:20Z [load_day 2025-03-22] 2025-03-22 hour 8: 190630 events in 0 files, snapshot none (task 7824 ms: download 4026 ms overlapping gunzip 1204 ms, parse 5053 ms, sort 0 ms, write 0 ms, index 723 ms: 2 candidates, 73823 repo-hours, 972 releases; waiting 526 ms; commit 0 ms)
2026-11-08T10:59:21Z [load_day 2025-03-22] 2025-03-22 hour 9: 199876 events in 0 files, snapshot none (task 8513 ms: download 4965 ms overlapping gunzip 1326 ms, parse 5489 ms, sort 0 ms, write 0 ms, index 873 ms: 4 candidates, 79858 repo-hours, 1261 releases; waiting 499 ms; commit 0 ms)
2026-11-08T10:59:29Z [load_day 2025-03-22] 2025-03-22 hour 10: 199990 events in 0 files, snapshot none (task 8477 ms: download 4575 ms overlapping gunzip 1120 ms, parse 5229 ms, sort 0 ms, write 0 ms, index 1139 ms: 3 candidates, 76725 repo-hours, 977 releases; waiting 658 ms; commit 0 ms)
2026-11-08T10:59:29Z [load_day 2025-03-22] 2025-03-22 hour 11: 201645 events in 0 files, snapshot none (task 7412 ms: download 3907 ms overlapping gunzip 1200 ms, parse 4708 ms, sort 0 ms, write 0 ms, index 1017 ms: 2 candidates, 73404 repo-hours, 906 releases; waiting 202 ms; commit 0 ms)
2026-11-08T10:59:37Z [load_day 2025-03-22] 2025-03-22 hour 12: 262936 events in 0 files, snapshot none (task 7787 ms: download 4023 ms overlapping gunzip 1036 ms, parse 4698 ms, sort 0 ms, write 0 ms, index 1217 ms: 8 candidates, 124264 repo-hours, 1074 releases; waiting 480 ms; commit 0 ms)
2026-11-08T10:59:37Z [load_day 2025-03-22] 2025-03-22 hour 13: 231316 events in 0 files, snapshot none (task 7533 ms: download 4182 ms overlapping gunzip 989 ms, parse 4664 ms, sort 0 ms, write 0 ms, index 1073 ms: 7 candidates, 102179 repo-hours, 934 releases; waiting 452 ms; commit 0 ms)
2026-11-08T10:59:46Z [load_day 2025-03-22] 2025-03-22 hour 14: 222117 events in 0 files, snapshot none (task 8081 ms: download 5071 ms overlapping gunzip 1129 ms, parse 5371 ms, sort 0 ms, write 0 ms, index 794 ms: 4 candidates, 86421 repo-hours, 1030 releases; waiting 536 ms; commit 0 ms)
2026-11-08T10:59:46Z [load_day 2025-03-22] 2025-03-22 hour 15: 233398 events in 0 files, snapshot none (task 7654 ms: download 4526 ms overlapping gunzip 1143 ms, parse 5152 ms, sort 0 ms, write 0 ms, index 739 ms: 6 candidates, 94872 repo-hours, 1124 releases; waiting 413 ms; commit 0 ms)
2026-11-08T10:59:54Z [load_day 2025-03-22] 2025-03-22 hour 16: 216913 events in 0 files, snapshot none (task 7219 ms: download 4071 ms overlapping gunzip 1039 ms, parse 4487 ms, sort 0 ms, write 0 ms, index 920 ms: 12 candidates, 86608 repo-hours, 1181 releases; waiting 503 ms; commit 0 ms)
2026-11-08T10:59:54Z [load_day 2025-03-22] 2025-03-22 hour 17: 213123 events in 0 files, snapshot none (task 7675 ms: download 4645 ms overlapping gunzip 1190 ms, parse 5142 ms, sort 0 ms, write 0 ms, index 629 ms: 8 candidates, 80742 repo-hours, 974 releases; waiting 497 ms; commit 0 ms)
2026-11-08T11:00:00Z [load_day 2025-03-22] 2025-03-22 hour 18: 221484 events in 0 files, snapshot none (task 6010 ms: download 3017 ms overlapping gunzip 854 ms, parse 3593 ms, sort 0 ms, write 0 ms, index 1051 ms: 8 candidates, 94512 repo-hours, 1164 releases; waiting 255 ms; commit 0 ms)
2026-11-08T11:00:00Z [load_day 2025-03-22] 2025-03-22 hour 19: 196232 events in 0 files, snapshot none (task 5671 ms: download 3082 ms overlapping gunzip 731 ms, parse 3275 ms, sort 0 ms, write 0 ms, index 759 ms: 4 candidates, 71694 repo-hours, 1053 releases; waiting 550 ms; commit 0 ms)
2026-11-08T11:00:09Z [load_day 2025-03-22] 2025-03-22 hour 20: 193443 events in 0 files, snapshot none (task 8268 ms: download 5623 ms overlapping gunzip 771 ms, parse 3441 ms, sort 0 ms, write 0 ms, index 678 ms: 6 candidates, 72803 repo-hours, 1004 releases; waiting 3051 ms; commit 0 ms)
2026-11-08T11:00:09Z [load_day 2025-03-22] 2025-03-22 hour 21: 196020 events in 0 files, snapshot none (task 5575 ms: download 2910 ms overlapping gunzip 738 ms, parse 3348 ms, sort 0 ms, write 0 ms, index 691 ms: 5 candidates, 72462 repo-hours, 1061 releases; waiting 490 ms; commit 0 ms)
2026-11-08T11:00:15Z [load_day 2025-03-22] 2025-03-22 hour 22: 177845 events in 0 files, snapshot none (task 5206 ms: download 2847 ms overlapping gunzip 746 ms, parse 3230 ms, sort 0 ms, write 0 ms, index 437 ms: 14 candidates, 63495 repo-hours, 1024 releases; waiting 511 ms; commit 0 ms)
2026-11-08T11:00:15Z [load_day 2025-03-22] 2025-03-22 hour 23: 167972 events in 0 files, snapshot none (task 5059 ms: download 2951 ms overlapping gunzip 749 ms, parse 3108 ms, sort 0 ms, write 0 ms, index 411 ms: 3 candidates, 59758 repo-hours, 972 releases; waiting 501 ms; commit 0 ms)
2026-11-08T11:00:23Z [load_day 2025-03-22] 2025-03-22: repo_hour merged from 24 files to 1 (1929536 rows, 7787 ms)
2026-11-08T11:00:25Z [load_day 2025-03-22] 2025-03-22: index committed in 10225 ms (24 + 1 + 24 files)
2026-11-08T11:00:25Z [load_day 2025-03-22] 2025-03-22: 4806313 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:00:25Z [load_day 2025-03-22] attempt 1 succeeded