orcaLog in

Runs · run 5031

load_day 2026-03-13, attempt 1 succeeded

Host
73ccef5e07c2:454872
Started
2026-11-08T15:34:06Z
Ended
2026-11-08T15:35:06Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
723 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
68.3 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/5031/load_day/2026-03-13/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:34:06Z [load_day 2026-03-13] attempt 1 started
2026-11-08T15:34:07Z [load_day 2026-03-13] 2026-03-13: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:34:11Z [load_day 2026-03-13] 2026-03-13 hour 0: 147949 events in 0 files, snapshot none (task 3689 ms: download 2220 ms overlapping gunzip 427 ms, parse 1291 ms, sort 0 ms, write 0 ms, index 574 ms: 7 candidates, 74901 repo-hours, 872 releases; waiting 1014 ms; commit 0 ms)
2026-11-08T15:34:11Z [load_day 2026-03-13] 2026-03-13 hour 1: 154703 events in 0 files, snapshot none (task 3506 ms: download 2360 ms overlapping gunzip 360 ms, parse 1187 ms, sort 0 ms, write 0 ms, index 714 ms: 9 candidates, 90495 repo-hours, 467 releases; waiting 930 ms; commit 0 ms)
2026-11-08T15:34:15Z [load_day 2026-03-13] 2026-03-13 hour 2: 155050 events in 0 files, snapshot none (task 3287 ms: download 2200 ms overlapping gunzip 337 ms, parse 1065 ms, sort 0 ms, write 0 ms, index 622 ms: 7 candidates, 89565 repo-hours, 509 releases; waiting 972 ms; commit 0 ms)
2026-11-08T15:34:15Z [load_day 2026-03-13] 2026-03-13 hour 3: 144009 events in 0 files, snapshot none (task 2810 ms: download 1580 ms overlapping gunzip 374 ms, parse 1141 ms, sort 0 ms, write 0 ms, index 553 ms: 8 candidates, 70361 repo-hours, 921 releases; waiting 276 ms; commit 0 ms)
2026-11-08T15:34:18Z [load_day 2026-03-13] 2026-03-13 hour 4: 141955 events in 0 files, snapshot none (task 3052 ms: download 1692 ms overlapping gunzip 427 ms, parse 1342 ms, sort 0 ms, write 0 ms, index 732 ms: 9 candidates, 71102 repo-hours, 922 releases; waiting 242 ms; commit 0 ms)
2026-11-08T15:34:19Z [load_day 2026-03-13] 2026-03-13 hour 5: 147692 events in 0 files, snapshot none (task 3774 ms: download 2331 ms overlapping gunzip 518 ms, parse 1590 ms, sort 0 ms, write 0 ms, index 635 ms: 7 candidates, 77680 repo-hours, 711 releases; waiting 729 ms; commit 0 ms)
2026-11-08T15:34:22Z [load_day 2026-03-13] 2026-03-13 hour 6: 149555 events in 0 files, snapshot none (task 3470 ms: download 1832 ms overlapping gunzip 334 ms, parse 1024 ms, sort 0 ms, write 0 ms, index 822 ms: 7 candidates, 80955 repo-hours, 653 releases; waiting 654 ms; commit 0 ms)
2026-11-08T15:34:23Z [load_day 2026-03-13] 2026-03-13 hour 7: 151736 events in 0 files, snapshot none (task 3425 ms: download 2308 ms overlapping gunzip 384 ms, parse 1118 ms, sort 0 ms, write 0 ms, index 610 ms: 3 candidates, 82629 repo-hours, 521 releases; waiting 1023 ms; commit 0 ms)
2026-11-08T15:34:26Z [load_day 2026-03-13] 2026-03-13 hour 8: 148580 events in 0 files, snapshot none (task 3093 ms: download 1889 ms overlapping gunzip 343 ms, parse 1025 ms, sort 0 ms, write 0 ms, index 638 ms: 8 candidates, 80953 repo-hours, 501 releases; waiting 654 ms; commit 0 ms)
2026-11-08T15:34:26Z [load_day 2026-03-13] 2026-03-13 hour 9: 154794 events in 0 files, snapshot none (task 2904 ms: download 1871 ms overlapping gunzip 327 ms, parse 1014 ms, sort 0 ms, write 0 ms, index 623 ms: 6 candidates, 85791 repo-hours, 438 releases; waiting 658 ms; commit 0 ms)
2026-11-08T15:34:30Z [load_day 2026-03-13] 2026-03-13 hour 10: 156647 events in 0 files, snapshot none (task 3735 ms: download 2422 ms overlapping gunzip 519 ms, parse 1630 ms, sort 0 ms, write 0 ms, index 750 ms: 9 candidates, 88398 repo-hours, 298 releases; waiting 580 ms; commit 0 ms)
2026-11-08T15:34:30Z [load_day 2026-03-13] 2026-03-13 hour 11: 151142 events in 0 files, snapshot none (task 3558 ms: download 2067 ms overlapping gunzip 486 ms, parse 1506 ms, sort 0 ms, write 0 ms, index 796 ms: 5 candidates, 82349 repo-hours, 305 releases; waiting 412 ms; commit 0 ms)
2026-11-08T15:34:35Z [load_day 2026-03-13] 2026-03-13 hour 12: 158763 events in 0 files, snapshot none (task 3744 ms: download 2002 ms overlapping gunzip 356 ms, parse 1166 ms, sort 0 ms, write 0 ms, index 994 ms: 9 candidates, 94832 repo-hours, 196 releases; waiting 880 ms; commit 0 ms)
2026-11-08T15:34:35Z [load_day 2026-03-13] 2026-03-13 hour 13: 158938 events in 0 files, snapshot none (task 3846 ms: download 2278 ms overlapping gunzip 314 ms, parse 1081 ms, sort 0 ms, write 0 ms, index 848 ms: 8 candidates, 94040 repo-hours, 100 releases; waiting 1293 ms; commit 0 ms)
2026-11-08T15:34:38Z [load_day 2026-03-13] 2026-03-13 hour 14: 155089 events in 0 files, snapshot none (task 2984 ms: download 1324 ms overlapping gunzip 284 ms, parse 920 ms, sort 0 ms, write 0 ms, index 1112 ms: 3 candidates, 88332 repo-hours, 162 releases; waiting 381 ms; commit 0 ms)
2026-11-08T15:34:39Z [load_day 2026-03-13] 2026-03-13 hour 15: 159452 events in 0 files, snapshot none (task 3452 ms: download 2029 ms overlapping gunzip 388 ms, parse 1108 ms, sort 0 ms, write 0 ms, index 791 ms: 10 candidates, 91164 repo-hours, 162 releases; waiting 762 ms; commit 0 ms)
2026-11-08T15:34:41Z [load_day 2026-03-13] 2026-03-13 hour 16: 161362 events in 0 files, snapshot none (task 2969 ms: download 1746 ms overlapping gunzip 263 ms, parse 873 ms, sort 0 ms, write 0 ms, index 742 ms: 13 candidates, 89590 repo-hours, 151 releases; waiting 765 ms; commit 0 ms)
2026-11-08T15:34:43Z [load_day 2026-03-13] 2026-03-13 hour 17: 157046 events in 0 files, snapshot none (task 3527 ms: download 2141 ms overlapping gunzip 287 ms, parse 911 ms, sort 0 ms, write 0 ms, index 853 ms: 7 candidates, 87235 repo-hours, 208 releases; waiting 1110 ms; commit 0 ms)
2026-11-08T15:34:44Z [load_day 2026-03-13] 2026-03-13 hour 18: 154979 events in 0 files, snapshot none (task 2580 ms: download 1429 ms overlapping gunzip 274 ms, parse 857 ms, sort 0 ms, write 0 ms, index 601 ms: 13 candidates, 86130 repo-hours, 301 releases; waiting 510 ms; commit 0 ms)
2026-11-08T15:34:46Z [load_day 2026-03-13] 2026-03-13 hour 19: 148953 events in 0 files, snapshot none (task 2820 ms: download 1521 ms overlapping gunzip 295 ms, parse 911 ms, sort 0 ms, write 0 ms, index 824 ms: 11 candidates, 79546 repo-hours, 523 releases; waiting 411 ms; commit 0 ms)
2026-11-08T15:34:48Z [load_day 2026-03-13] 2026-03-13 hour 20: 151631 events in 0 files, snapshot none (task 2821 ms: download 1512 ms overlapping gunzip 389 ms, parse 1183 ms, sort 0 ms, write 0 ms, index 597 ms: 7 candidates, 79914 repo-hours, 507 releases; waiting 217 ms; commit 0 ms)
2026-11-08T15:34:49Z [load_day 2026-03-13] 2026-03-13 hour 21: 150543 events in 0 files, snapshot none (task 2450 ms: download 1240 ms overlapping gunzip 340 ms, parse 1048 ms, sort 0 ms, write 0 ms, index 582 ms: 8 candidates, 75416 repo-hours, 700 releases; waiting 221 ms; commit 0 ms)
2026-11-08T15:34:53Z [load_day 2026-03-13] 2026-03-13 hour 22: 149805 events in 0 files, snapshot none (task 4395 ms: download 2999 ms overlapping gunzip 442 ms, parse 1402 ms, sort 0 ms, write 0 ms, index 647 ms: 5 candidates, 75476 repo-hours, 808 releases; waiting 1623 ms; commit 0 ms)
2026-11-08T15:34:53Z [load_day 2026-03-13] 2026-03-13 hour 23: 146035 events in 0 files, snapshot none (task 3477 ms: download 2420 ms overlapping gunzip 423 ms, parse 1357 ms, sort 0 ms, write 0 ms, index 551 ms: 3 candidates, 68752 repo-hours, 993 releases; waiting 866 ms; commit 0 ms)
2026-11-08T15:35:02Z [load_day 2026-03-13] 2026-03-13: repo_hour merged from 24 files to 1 (1985606 rows, 8674 ms)
2026-11-08T15:35:06Z [load_day 2026-03-13] 2026-03-13: index committed in 12919 ms (24 + 1 + 24 files)
2026-11-08T15:35:06Z [load_day 2026-03-13] 2026-03-13: 3656408 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:35:06Z [load_day 2026-03-13] attempt 1 succeeded