orcaLog in

Runs · run 4185

load_day 2025-07-24, attempt 1 succeeded

Host
73ccef5e07c2:348219
Started
2026-11-08T13:04:20Z
Ended
2026-11-08T13:06:00Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
691 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
151.4 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4185/load_day/2025-07-24/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:04:20Z [load_day 2025-07-24] attempt 1 started
2026-11-08T13:04:21Z [load_day 2025-07-24] 2025-07-24: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:04:29Z [load_day 2025-07-24] 2025-07-24 hour 0: 144189 events in 0 files, snapshot none (task 8102 ms: download 4387 ms overlapping gunzip 1317 ms, parse 5043 ms, sort 0 ms, write 0 ms, index 804 ms: 4 candidates, 67879 repo-hours, 1025 releases; waiting 628 ms; commit 0 ms)
2026-11-08T13:04:29Z [load_day 2025-07-24] 2025-07-24 hour 1: 155615 events in 0 files, snapshot none (task 7704 ms: download 3672 ms overlapping gunzip 1216 ms, parse 4859 ms, sort 0 ms, write 0 ms, index 841 ms: 7 candidates, 88343 repo-hours, 819 releases; waiting 505 ms; commit 0 ms)
2026-11-08T13:04:37Z [load_day 2025-07-24] 2025-07-24 hour 2: 149490 events in 0 files, snapshot none (task 7193 ms: download 3362 ms overlapping gunzip 1083 ms, parse 4553 ms, sort 0 ms, write 0 ms, index 758 ms: 3 candidates, 74952 repo-hours, 890 releases; waiting 471 ms; commit 0 ms)
2026-11-08T13:04:37Z [load_day 2025-07-24] 2025-07-24 hour 3: 145955 events in 0 files, snapshot none (task 6700 ms: download 3405 ms overlapping gunzip 1023 ms, parse 4126 ms, sort 0 ms, write 0 ms, index 744 ms: 0 candidates, 65381 repo-hours, 932 releases; waiting 483 ms; commit 0 ms)
2026-11-08T13:04:44Z [load_day 2025-07-24] 2025-07-24 hour 4: 146968 events in 0 files, snapshot none (task 6577 ms: download 3763 ms overlapping gunzip 837 ms, parse 3509 ms, sort 0 ms, write 0 ms, index 936 ms: 6 candidates, 66185 repo-hours, 1858 releases; waiting 1062 ms; commit 0 ms)
2026-11-08T13:04:44Z [load_day 2025-07-24] 2025-07-24 hour 5: 150786 events in 0 files, snapshot none (task 6895 ms: download 3433 ms overlapping gunzip 1024 ms, parse 4265 ms, sort 0 ms, write 0 ms, index 896 ms: 6 candidates, 66750 repo-hours, 609 releases; waiting 464 ms; commit 0 ms)
2026-11-08T13:04:51Z [load_day 2025-07-24] 2025-07-24 hour 6: 158212 events in 0 files, snapshot none (task 6208 ms: download 3649 ms overlapping gunzip 963 ms, parse 3762 ms, sort 0 ms, write 0 ms, index 629 ms: 2 candidates, 78807 repo-hours, 760 releases; waiting 460 ms; commit 0 ms)
2026-11-08T13:04:52Z [load_day 2025-07-24] 2025-07-24 hour 7: 155257 events in 0 files, snapshot none (task 6682 ms: download 4371 ms overlapping gunzip 1056 ms, parse 4327 ms, sort 0 ms, write 0 ms, index 569 ms: 5 candidates, 75120 repo-hours, 771 releases; waiting 492 ms; commit 0 ms)
2026-11-08T13:04:57Z [load_day 2025-07-24] 2025-07-24 hour 8: 159785 events in 0 files, snapshot none (task 5921 ms: download 3360 ms overlapping gunzip 943 ms, parse 3782 ms, sort 0 ms, write 0 ms, index 626 ms: 7 candidates, 78956 repo-hours, 924 releases; waiting 245 ms; commit 0 ms)
2026-11-08T13:04:58Z [load_day 2025-07-24] 2025-07-24 hour 9: 161618 events in 0 files, snapshot none (task 5860 ms: download 3504 ms overlapping gunzip 912 ms, parse 3744 ms, sort 0 ms, write 0 ms, index 588 ms: 4 candidates, 80657 repo-hours, 1119 releases; waiting 281 ms; commit 0 ms)
2026-11-08T13:05:05Z [load_day 2025-07-24] 2025-07-24 hour 10: 159966 events in 0 files, snapshot none (task 7218 ms: download 5520 ms overlapping gunzip 923 ms, parse 3644 ms, sort 0 ms, write 0 ms, index 724 ms: 6 candidates, 78130 repo-hours, 892 releases; waiting 1439 ms; commit 0 ms)
2026-11-08T13:05:05Z [load_day 2025-07-24] 2025-07-24 hour 11: 157734 events in 0 files, snapshot none (task 6667 ms: download 3873 ms overlapping gunzip 869 ms, parse 3608 ms, sort 0 ms, write 0 ms, index 769 ms: 6 candidates, 76331 repo-hours, 930 releases; waiting 1097 ms; commit 0 ms)
2026-11-08T13:05:14Z [load_day 2025-07-24] 2025-07-24 hour 12: 171849 events in 0 files, snapshot none (task 8259 ms: download 4747 ms overlapping gunzip 1192 ms, parse 4861 ms, sort 0 ms, write 0 ms, index 1243 ms: 8 candidates, 99948 repo-hours, 937 releases; waiting 629 ms; commit 0 ms)
2026-11-08T13:05:14Z [load_day 2025-07-24] 2025-07-24 hour 13: 166642 events in 0 files, snapshot none (task 8058 ms: download 4808 ms overlapping gunzip 1220 ms, parse 5024 ms, sort 0 ms, write 0 ms, index 1010 ms: 7 candidates, 92743 repo-hours, 897 releases; waiting 471 ms; commit 0 ms)
2026-11-08T13:05:22Z [load_day 2025-07-24] 2025-07-24 hour 14: 163875 events in 0 files, snapshot none (task 7867 ms: download 5346 ms overlapping gunzip 1110 ms, parse 4419 ms, sort 0 ms, write 0 ms, index 605 ms: 10 candidates, 83352 repo-hours, 912 releases; waiting 1379 ms; commit 0 ms)
2026-11-08T13:05:22Z [load_day 2025-07-24] 2025-07-24 hour 15: 164986 events in 0 files, snapshot none (task 7118 ms: download 4068 ms overlapping gunzip 1064 ms, parse 4123 ms, sort 0 ms, write 0 ms, index 1228 ms: 1 candidates, 83435 repo-hours, 1044 releases; waiting 446 ms; commit 0 ms)
2026-11-08T13:05:31Z [load_day 2025-07-24] 2025-07-24 hour 16: 160288 events in 0 files, snapshot none (task 5768 ms: download 3521 ms overlapping gunzip 811 ms, parse 3329 ms, sort 0 ms, write 0 ms, index 607 ms: 17 candidates, 80136 repo-hours, 1042 releases; waiting 660 ms; commit 0 ms)
2026-11-08T13:05:31Z [load_day 2025-07-24] 2025-07-24 hour 17: 164335 events in 0 files, snapshot none (task 6011 ms: download 3985 ms overlapping gunzip 878 ms, parse 3531 ms, sort 0 ms, write 0 ms, index 583 ms: 14 candidates, 78090 repo-hours, 891 releases; waiting 786 ms; commit 0 ms)
2026-11-08T13:05:37Z [load_day 2025-07-24] 2025-07-24 hour 18: 160540 events in 0 files, snapshot none (task 6026 ms: download 3608 ms overlapping gunzip 858 ms, parse 3484 ms, sort 0 ms, write 0 ms, index 588 ms: 10 candidates, 80524 repo-hours, 907 releases; waiting 782 ms; commit 0 ms)
2026-11-08T13:05:37Z [load_day 2025-07-24] 2025-07-24 hour 19: 155810 events in 0 files, snapshot none (task 5463 ms: download 3317 ms overlapping gunzip 796 ms, parse 3342 ms, sort 0 ms, write 0 ms, index 545 ms: 11 candidates, 69636 repo-hours, 915 releases; waiting 551 ms; commit 0 ms)
2026-11-08T13:05:43Z [load_day 2025-07-24] 2025-07-24 hour 20: 153686 events in 0 files, snapshot none (task 5278 ms: download 3907 ms overlapping gunzip 810 ms, parse 3189 ms, sort 0 ms, write 0 ms, index 515 ms: 15 candidates, 69897 repo-hours, 888 releases; waiting 471 ms; commit 0 ms)
2026-11-08T13:05:44Z [load_day 2025-07-24] 2025-07-24 hour 21: 149614 events in 0 files, snapshot none (task 5646 ms: download 3593 ms overlapping gunzip 822 ms, parse 3534 ms, sort 0 ms, write 0 ms, index 475 ms: 8 candidates, 64309 repo-hours, 1113 releases; waiting 517 ms; commit 0 ms)
2026-11-08T13:05:49Z [load_day 2025-07-24] 2025-07-24 hour 22: 142566 events in 0 files, snapshot none (task 5397 ms: download 3390 ms overlapping gunzip 816 ms, parse 3175 ms, sort 0 ms, write 0 ms, index 423 ms: 5 candidates, 58630 repo-hours, 968 releases; waiting 646 ms; commit 0 ms)
2026-11-08T13:05:49Z [load_day 2025-07-24] 2025-07-24 hour 23: 142648 events in 0 files, snapshot none (task 5146 ms: download 2831 ms overlapping gunzip 789 ms, parse 3069 ms, sort 0 ms, write 0 ms, index 404 ms: 8 candidates, 56242 repo-hours, 1089 releases; waiting 418 ms; commit 0 ms)
2026-11-08T13:05:57Z [load_day 2025-07-24] 2025-07-24: repo_hour merged from 24 files to 1 (1814433 rows, 8001 ms)
2026-11-08T13:06:00Z [load_day 2025-07-24] 2025-07-24: index committed in 10865 ms (23 + 1 + 24 files)
2026-11-08T13:06:00Z [load_day 2025-07-24] 2025-07-24: 3742414 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:06:00Z [load_day 2025-07-24] attempt 1 succeeded