orcaLog in

Runs · run 3805

load_day 2025-04-19, attempt 1 succeeded

Host
73ccef5e07c2:290512
Started
2026-11-08T11:29:55Z
Ended
2026-11-08T11:31:30Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
726 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
134.7 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3805/load_day/2025-04-19/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:29:55Z [load_day 2025-04-19] attempt 1 started
2026-11-08T11:29:56Z [load_day 2025-04-19] 2025-04-19: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:30:05Z [load_day 2025-04-19] 2025-04-19 hour 0: 181806 events in 0 files, snapshot none (task 7926 ms: download 4736 ms overlapping gunzip 1210 ms, parse 5329 ms, sort 0 ms, write 0 ms, index 608 ms: 11 candidates, 85531 repo-hours, 1324 releases; waiting 446 ms; commit 0 ms)
2026-11-08T11:30:05Z [load_day 2025-04-19] 2025-04-19 hour 1: 197286 events in 0 files, snapshot none (task 7490 ms: download 3869 ms overlapping gunzip 1002 ms, parse 4565 ms, sort 0 ms, write 0 ms, index 1037 ms: 5 candidates, 109560 repo-hours, 1017 releases; waiting 534 ms; commit 0 ms)
2026-11-08T11:30:12Z [load_day 2025-04-19] 2025-04-19 hour 2: 164643 events in 0 files, snapshot none (task 6966 ms: download 3506 ms overlapping gunzip 1032 ms, parse 4477 ms, sort 0 ms, write 0 ms, index 567 ms: 6 candidates, 71641 repo-hours, 1025 releases; waiting 561 ms; commit 0 ms)
2026-11-08T11:30:12Z [load_day 2025-04-19] 2025-04-19 hour 3: 178659 events in 0 files, snapshot none (task 7307 ms: download 3758 ms overlapping gunzip 1086 ms, parse 4731 ms, sort 0 ms, write 0 ms, index 569 ms: 4 candidates, 71323 repo-hours, 3131 releases; waiting 590 ms; commit 0 ms)
2026-11-08T11:30:18Z [load_day 2025-04-19] 2025-04-19 hour 4: 167574 events in 0 files, snapshot none (task 4998 ms: download 3004 ms overlapping gunzip 650 ms, parse 2966 ms, sort 0 ms, write 0 ms, index 524 ms: 7 candidates, 62303 repo-hours, 978 releases; waiting 517 ms; commit 0 ms)
2026-11-08T11:30:19Z [load_day 2025-04-19] 2025-04-19 hour 5: 176000 events in 0 files, snapshot none (task 5610 ms: download 2564 ms overlapping gunzip 835 ms, parse 3593 ms, sort 0 ms, write 0 ms, index 521 ms: 5 candidates, 65649 repo-hours, 1004 releases; waiting 457 ms; commit 0 ms)
2026-11-08T11:30:24Z [load_day 2025-04-19] 2025-04-19 hour 6: 194889 events in 0 files, snapshot none (task 5600 ms: download 2730 ms overlapping gunzip 804 ms, parse 3588 ms, sort 0 ms, write 0 ms, index 660 ms: 2 candidates, 83381 repo-hours, 1307 releases; waiting 229 ms; commit 0 ms)
2026-11-08T11:30:25Z [load_day 2025-04-19] 2025-04-19 hour 7: 190257 events in 0 files, snapshot none (task 5590 ms: download 3093 ms overlapping gunzip 783 ms, parse 3483 ms, sort 0 ms, write 0 ms, index 554 ms: 3 candidates, 69903 repo-hours, 1188 releases; waiting 493 ms; commit 0 ms)
2026-11-08T11:30:32Z [load_day 2025-04-19] 2025-04-19 hour 8: 194353 events in 0 files, snapshot none (task 7309 ms: download 4341 ms overlapping gunzip 1094 ms, parse 4715 ms, sort 0 ms, write 0 ms, index 646 ms: 5 candidates, 74665 repo-hours, 1184 releases; waiting 564 ms; commit 0 ms)
2026-11-08T11:30:32Z [load_day 2025-04-19] 2025-04-19 hour 9: 201977 events in 0 files, snapshot none (task 6683 ms: download 3771 ms overlapping gunzip 987 ms, parse 4544 ms, sort 0 ms, write 0 ms, index 583 ms: 3 candidates, 79452 repo-hours, 1313 releases; waiting 277 ms; commit 0 ms)
2026-11-08T11:30:37Z [load_day 2025-04-19] 2025-04-19 hour 10: 198672 events in 0 files, snapshot none (task 5076 ms: download 2605 ms overlapping gunzip 682 ms, parse 3020 ms, sort 0 ms, write 0 ms, index 597 ms: 6 candidates, 76017 repo-hours, 1080 releases; waiting 515 ms; commit 0 ms)
2026-11-08T11:30:37Z [load_day 2025-04-19] 2025-04-19 hour 11: 191520 events in 0 files, snapshot none (task 4681 ms: download 2220 ms overlapping gunzip 652 ms, parse 2941 ms, sort 0 ms, write 0 ms, index 541 ms: 9 candidates, 72369 repo-hours, 969 releases; waiting 278 ms; commit 0 ms)
2026-11-08T11:30:43Z [load_day 2025-04-19] 2025-04-19 hour 12: 247439 events in 0 files, snapshot none (task 5788 ms: download 3143 ms overlapping gunzip 726 ms, parse 3423 ms, sort 0 ms, write 0 ms, index 848 ms: 8 candidates, 121776 repo-hours, 1195 releases; waiting 499 ms; commit 0 ms)
2026-11-08T11:30:43Z [load_day 2025-04-19] 2025-04-19 hour 13: 221354 events in 0 files, snapshot none (task 5602 ms: download 3221 ms overlapping gunzip 715 ms, parse 3217 ms, sort 0 ms, write 0 ms, index 676 ms: 4 candidates, 101809 repo-hours, 1087 releases; waiting 533 ms; commit 0 ms)
2026-11-08T11:30:51Z [load_day 2025-04-19] 2025-04-19 hour 14: 212397 events in 0 files, snapshot none (task 6943 ms: download 3290 ms overlapping gunzip 1013 ms, parse 4312 ms, sort 0 ms, write 0 ms, index 780 ms: 7 candidates, 85676 repo-hours, 1249 releases; waiting 537 ms; commit 0 ms)
2026-11-08T11:30:51Z [load_day 2025-04-19] 2025-04-19 hour 15: 219499 events in 0 files, snapshot none (task 7000 ms: download 3706 ms overlapping gunzip 957 ms, parse 4243 ms, sort 0 ms, write 0 ms, index 755 ms: 5 candidates, 92470 repo-hours, 1282 releases; waiting 730 ms; commit 0 ms)
2026-11-08T11:30:59Z [load_day 2025-04-19] 2025-04-19 hour 16: 208472 events in 0 files, snapshot none (task 7106 ms: download 3761 ms overlapping gunzip 1003 ms, parse 4418 ms, sort 0 ms, write 0 ms, index 580 ms: 3 candidates, 83585 repo-hours, 1127 releases; waiting 580 ms; commit 0 ms)
2026-11-08T11:30:59Z [load_day 2025-04-19] 2025-04-19 hour 17: 210149 events in 0 files, snapshot none (task 6809 ms: download 3313 ms overlapping gunzip 927 ms, parse 4313 ms, sort 0 ms, write 0 ms, index 767 ms: 10 candidates, 78235 repo-hours, 1101 releases; waiting 515 ms; commit 0 ms)
2026-11-08T11:31:06Z [load_day 2025-04-19] 2025-04-19 hour 18: 215632 events in 0 files, snapshot none (task 6759 ms: download 4050 ms overlapping gunzip 996 ms, parse 4318 ms, sort 0 ms, write 0 ms, index 659 ms: 6 candidates, 92290 repo-hours, 1180 releases; waiting 534 ms; commit 0 ms)
2026-11-08T11:31:06Z [load_day 2025-04-19] 2025-04-19 hour 19: 198206 events in 0 files, snapshot none (task 6819 ms: download 4039 ms overlapping gunzip 1014 ms, parse 4368 ms, sort 0 ms, write 0 ms, index 615 ms: 7 candidates, 72038 repo-hours, 1074 releases; waiting 535 ms; commit 0 ms)
2026-11-08T11:31:13Z [load_day 2025-04-19] 2025-04-19 hour 20: 191105 events in 0 files, snapshot none (task 6517 ms: download 3771 ms overlapping gunzip 953 ms, parse 4173 ms, sort 0 ms, write 0 ms, index 602 ms: 12 candidates, 71276 repo-hours, 982 releases; waiting 472 ms; commit 0 ms)
2026-11-08T11:31:13Z [load_day 2025-04-19] 2025-04-19 hour 21: 179040 events in 0 files, snapshot none (task 6341 ms: download 3662 ms overlapping gunzip 872 ms, parse 4093 ms, sort 0 ms, write 0 ms, index 556 ms: 5 candidates, 69359 repo-hours, 1042 releases; waiting 528 ms; commit 0 ms)
2026-11-08T11:31:19Z [load_day 2025-04-19] 2025-04-19 hour 22: 163758 events in 0 files, snapshot none (task 5977 ms: download 3392 ms overlapping gunzip 811 ms, parse 3544 ms, sort 0 ms, write 0 ms, index 410 ms: 7 candidates, 57738 repo-hours, 1137 releases; waiting 919 ms; commit 0 ms)
2026-11-08T11:31:19Z [load_day 2025-04-19] 2025-04-19 hour 23: 151782 events in 0 files, snapshot none (task 5550 ms: download 2692 ms overlapping gunzip 775 ms, parse 3558 ms, sort 0 ms, write 0 ms, index 481 ms: 13 candidates, 55540 repo-hours, 1117 releases; waiting 512 ms; commit 0 ms)
2026-11-08T11:31:27Z [load_day 2025-04-19] 2025-04-19: repo_hour merged from 24 files to 1 (1903586 rows, 8014 ms)
2026-11-08T11:31:30Z [load_day 2025-04-19] 2025-04-19: index committed in 10707 ms (24 + 1 + 24 files)
2026-11-08T11:31:30Z [load_day 2025-04-19] 2025-04-19: 4656469 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:31:30Z [load_day 2025-04-19] attempt 1 succeeded