orcaLog in

Runs · run 4206

load_day 2025-07-29, attempt 1 succeeded

Host
73ccef5e07c2:351327
Started
2026-11-08T13:08:41Z
Ended
2026-11-08T13:10:29Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
672 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
156.1 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4206/load_day/2025-07-29/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:08:41Z [load_day 2025-07-29] attempt 1 started
2026-11-08T13:08:42Z [load_day 2025-07-29] 2025-07-29: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:08:49Z [load_day 2025-07-29] 2025-07-29 hour 0: 130726 events in 0 files, snapshot none (task 6101 ms: download 3676 ms overlapping gunzip 957 ms, parse 3884 ms, sort 0 ms, write 0 ms, index 512 ms: 12 candidates, 60020 repo-hours, 904 releases; waiting 488 ms; commit 0 ms)
2026-11-08T13:08:49Z [load_day 2025-07-29] 2025-07-29 hour 1: 146446 events in 0 files, snapshot none (task 6236 ms: download 3601 ms overlapping gunzip 944 ms, parse 3870 ms, sort 0 ms, write 0 ms, index 631 ms: 9 candidates, 82693 repo-hours, 678 releases; waiting 538 ms; commit 0 ms)
2026-11-08T13:08:56Z [load_day 2025-07-29] 2025-07-29 hour 2: 150634 events in 0 files, snapshot none (task 7064 ms: download 3929 ms overlapping gunzip 1134 ms, parse 4333 ms, sort 0 ms, write 0 ms, index 760 ms: 7 candidates, 77437 repo-hours, 750 releases; waiting 480 ms; commit 0 ms)
2026-11-08T13:08:56Z [load_day 2025-07-29] 2025-07-29 hour 3: 144640 events in 0 files, snapshot none (task 6911 ms: download 3908 ms overlapping gunzip 1154 ms, parse 4279 ms, sort 0 ms, write 0 ms, index 697 ms: 10 candidates, 66516 repo-hours, 943 releases; waiting 535 ms; commit 0 ms)
2026-11-08T13:09:04Z [load_day 2025-07-29] 2025-07-29 hour 4: 144997 events in 0 files, snapshot none (task 6817 ms: download 3769 ms overlapping gunzip 997 ms, parse 4128 ms, sort 0 ms, write 0 ms, index 660 ms: 6 candidates, 67091 repo-hours, 2080 releases; waiting 620 ms; commit 0 ms)
2026-11-08T13:09:04Z [load_day 2025-07-29] 2025-07-29 hour 5: 150821 events in 0 files, snapshot none (task 7148 ms: download 4424 ms overlapping gunzip 1144 ms, parse 4505 ms, sort 0 ms, write 0 ms, index 549 ms: 9 candidates, 68122 repo-hours, 792 releases; waiting 683 ms; commit 0 ms)
2026-11-08T13:09:10Z [load_day 2025-07-29] 2025-07-29 hour 6: 156216 events in 0 files, snapshot none (task 5983 ms: download 3164 ms overlapping gunzip 950 ms, parse 3775 ms, sort 0 ms, write 0 ms, index 693 ms: 19 candidates, 80520 repo-hours, 860 releases; waiting 341 ms; commit 0 ms)
2026-11-08T13:09:11Z [load_day 2025-07-29] 2025-07-29 hour 7: 160863 events in 0 files, snapshot none (task 6418 ms: download 3728 ms overlapping gunzip 965 ms, parse 3920 ms, sort 0 ms, write 0 ms, index 688 ms: 12 candidates, 77352 repo-hours, 836 releases; waiting 614 ms; commit 0 ms)
2026-11-08T13:09:18Z [load_day 2025-07-29] 2025-07-29 hour 8: 160057 events in 0 files, snapshot none (task 6901 ms: download 4326 ms overlapping gunzip 1102 ms, parse 4463 ms, sort 0 ms, write 0 ms, index 597 ms: 7 candidates, 80804 repo-hours, 889 releases; waiting 439 ms; commit 0 ms)
2026-11-08T13:09:18Z [load_day 2025-07-29] 2025-07-29 hour 9: 165714 events in 0 files, snapshot none (task 7097 ms: download 4548 ms overlapping gunzip 1136 ms, parse 4515 ms, sort 0 ms, write 0 ms, index 651 ms: 12 candidates, 83142 repo-hours, 1085 releases; waiting 511 ms; commit 0 ms)
2026-11-08T13:09:25Z [load_day 2025-07-29] 2025-07-29 hour 10: 160513 events in 0 files, snapshot none (task 6715 ms: download 3193 ms overlapping gunzip 1047 ms, parse 4256 ms, sort 0 ms, write 0 ms, index 815 ms: 6 candidates, 78873 repo-hours, 822 releases; waiting 278 ms; commit 0 ms)
2026-11-08T13:09:26Z [load_day 2025-07-29] 2025-07-29 hour 11: 161026 events in 0 files, snapshot none (task 7070 ms: download 4167 ms overlapping gunzip 1140 ms, parse 4478 ms, sort 0 ms, write 0 ms, index 605 ms: 11 candidates, 76485 repo-hours, 927 releases; waiting 517 ms; commit 0 ms)
2026-11-08T13:09:33Z [load_day 2025-07-29] 2025-07-29 hour 12: 169819 events in 0 files, snapshot none (task 7618 ms: download 3847 ms overlapping gunzip 1185 ms, parse 4799 ms, sort 0 ms, write 0 ms, index 999 ms: 21 candidates, 98737 repo-hours, 1026 releases; waiting 384 ms; commit 0 ms)
2026-11-08T13:09:35Z [load_day 2025-07-29] 2025-07-29 hour 13: 171321 events in 0 files, snapshot none (task 8522 ms: download 6670 ms overlapping gunzip 1214 ms, parse 5095 ms, sort 0 ms, write 0 ms, index 769 ms: 11 candidates, 95285 repo-hours, 876 releases; waiting 1103 ms; commit 0 ms)
2026-11-08T13:09:42Z [load_day 2025-07-29] 2025-07-29 hour 14: 163889 events in 0 files, snapshot none (task 8218 ms: download 5141 ms overlapping gunzip 1249 ms, parse 5086 ms, sort 0 ms, write 0 ms, index 646 ms: 10 candidates, 84060 repo-hours, 943 releases; waiting 942 ms; commit 0 ms)
2026-11-08T13:09:43Z [load_day 2025-07-29] 2025-07-29 hour 15: 163100 events in 0 files, snapshot none (task 7689 ms: download 5096 ms overlapping gunzip 1245 ms, parse 4999 ms, sort 0 ms, write 0 ms, index 641 ms: 12 candidates, 84541 repo-hours, 1055 releases; waiting 524 ms; commit 0 ms)
2026-11-08T13:09:50Z [load_day 2025-07-29] 2025-07-29 hour 16: 161510 events in 0 files, snapshot none (task 7681 ms: download 4489 ms overlapping gunzip 1146 ms, parse 5010 ms, sort 0 ms, write 0 ms, index 789 ms: 12 candidates, 83041 repo-hours, 900 releases; waiting 382 ms; commit 0 ms)
2026-11-08T13:09:51Z [load_day 2025-07-29] 2025-07-29 hour 17: 161244 events in 0 files, snapshot none (task 7092 ms: download 4521 ms overlapping gunzip 1080 ms, parse 4499 ms, sort 0 ms, write 0 ms, index 646 ms: 9 candidates, 77818 repo-hours, 729 releases; waiting 522 ms; commit 0 ms)
2026-11-08T13:09:58Z [load_day 2025-07-29] 2025-07-29 hour 18: 159545 events in 0 files, snapshot none (task 7265 ms: download 4240 ms overlapping gunzip 1130 ms, parse 4566 ms, sort 0 ms, write 0 ms, index 750 ms: 11 candidates, 82330 repo-hours, 905 releases; waiting 585 ms; commit 0 ms)
2026-11-08T13:09:58Z [load_day 2025-07-29] 2025-07-29 hour 19: 158824 events in 0 files, snapshot none (task 6960 ms: download 4244 ms overlapping gunzip 1100 ms, parse 4361 ms, sort 0 ms, write 0 ms, index 611 ms: 9 candidates, 71957 repo-hours, 730 releases; waiting 552 ms; commit 0 ms)
2026-11-08T13:10:07Z [load_day 2025-07-29] 2025-07-29 hour 20: 155296 events in 0 files, snapshot none (task 8584 ms: download 6046 ms overlapping gunzip 1300 ms, parse 5026 ms, sort 0 ms, write 0 ms, index 562 ms: 4 candidates, 71407 repo-hours, 900 releases; waiting 1334 ms; commit 0 ms)
2026-11-08T13:10:07Z [load_day 2025-07-29] 2025-07-29 hour 21: 150068 events in 0 files, snapshot none (task 7478 ms: download 5439 ms overlapping gunzip 1252 ms, parse 4779 ms, sort 0 ms, write 0 ms, index 535 ms: 8 candidates, 65505 repo-hours, 870 releases; waiting 609 ms; commit 0 ms)
2026-11-08T13:10:16Z [load_day 2025-07-29] 2025-07-29 hour 22: 145822 events in 0 files, snapshot none (task 7731 ms: download 5508 ms overlapping gunzip 1393 ms, parse 5064 ms, sort 0 ms, write 0 ms, index 453 ms: 12 candidates, 60346 repo-hours, 897 releases; waiting 526 ms; commit 0 ms)
2026-11-08T13:10:16Z [load_day 2025-07-29] 2025-07-29 hour 23: 145305 events in 0 files, snapshot none (task 7395 ms: download 4757 ms overlapping gunzip 1206 ms, parse 4768 ms, sort 0 ms, write 0 ms, index 509 ms: 5 candidates, 59576 repo-hours, 735 releases; waiting 500 ms; commit 0 ms)
2026-11-08T13:10:26Z [load_day 2025-07-29] 2025-07-29: repo_hour merged from 24 files to 1 (1833658 rows, 10086 ms)
2026-11-08T13:10:29Z [load_day 2025-07-29] 2025-07-29: index committed in 13196 ms (24 + 1 + 24 files)
2026-11-08T13:10:29Z [load_day 2025-07-29] 2025-07-29: 3738396 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:10:29Z [load_day 2025-07-29] attempt 1 succeeded