orcaLog in

Runs · run 4329

load_day 2025-08-29, attempt 1 succeeded

Host
73ccef5e07c2:369572
Started
2026-11-08T13:35:54Z
Ended
2026-11-08T13:37:38Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
678 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
145.4 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4329/load_day/2025-08-29/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:35:54Z [load_day 2025-08-29] attempt 1 started
2026-11-08T13:35:55Z [load_day 2025-08-29] 2025-08-29: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:36:02Z [load_day 2025-08-29] 2025-08-29 hour 0: 145980 events in 0 files, snapshot none (task 5726 ms: download 3097 ms overlapping gunzip 914 ms, parse 3496 ms, sort 0 ms, write 0 ms, index 557 ms: 9 candidates, 73380 repo-hours, 1105 releases; waiting 472 ms; commit 0 ms)
2026-11-08T13:36:02Z [load_day 2025-08-29] 2025-08-29 hour 1: 155431 events in 0 files, snapshot none (task 5514 ms: download 3023 ms overlapping gunzip 740 ms, parse 3355 ms, sort 0 ms, write 0 ms, index 731 ms: 5 candidates, 91869 repo-hours, 760 releases; waiting 447 ms; commit 0 ms)
2026-11-08T13:36:09Z [load_day 2025-08-29] 2025-08-29 hour 2: 149078 events in 0 files, snapshot none (task 7380 ms: download 4494 ms overlapping gunzip 1160 ms, parse 4666 ms, sort 0 ms, write 0 ms, index 712 ms: 15 candidates, 71405 repo-hours, 884 releases; waiting 504 ms; commit 0 ms)
2026-11-08T13:36:10Z [load_day 2025-08-29] 2025-08-29 hour 3: 149533 events in 0 files, snapshot none (task 7429 ms: download 4950 ms overlapping gunzip 1204 ms, parse 4948 ms, sort 0 ms, write 0 ms, index 568 ms: 4 candidates, 65459 repo-hours, 2127 releases; waiting 484 ms; commit 0 ms)
2026-11-08T13:36:16Z [load_day 2025-08-29] 2025-08-29 hour 4: 147317 events in 0 files, snapshot none (task 6133 ms: download 3480 ms overlapping gunzip 1007 ms, parse 4019 ms, sort 0 ms, write 0 ms, index 460 ms: 9 candidates, 61081 repo-hours, 798 releases; waiting 379 ms; commit 0 ms)
2026-11-08T13:36:17Z [load_day 2025-08-29] 2025-08-29 hour 5: 152667 events in 0 files, snapshot none (task 6852 ms: download 4327 ms overlapping gunzip 1058 ms, parse 4374 ms, sort 0 ms, write 0 ms, index 537 ms: 7 candidates, 62815 repo-hours, 762 releases; waiting 598 ms; commit 0 ms)
2026-11-08T13:36:23Z [load_day 2025-08-29] 2025-08-29 hour 6: 156588 events in 0 files, snapshot none (task 6186 ms: download 3366 ms overlapping gunzip 936 ms, parse 3843 ms, sort 0 ms, write 0 ms, index 600 ms: 2 candidates, 77606 repo-hours, 895 releases; waiting 523 ms; commit 0 ms)
2026-11-08T13:36:24Z [load_day 2025-08-29] 2025-08-29 hour 7: 156883 events in 0 files, snapshot none (task 7013 ms: download 4044 ms overlapping gunzip 1014 ms, parse 4115 ms, sort 0 ms, write 0 ms, index 796 ms: 5 candidates, 71802 repo-hours, 723 releases; waiting 697 ms; commit 0 ms)
2026-11-08T13:36:30Z [load_day 2025-08-29] 2025-08-29 hour 8: 162443 events in 0 files, snapshot none (task 6931 ms: download 3901 ms overlapping gunzip 1033 ms, parse 3939 ms, sort 0 ms, write 0 ms, index 808 ms: 9 candidates, 76976 repo-hours, 952 releases; waiting 785 ms; commit 0 ms)
2026-11-08T13:36:33Z [load_day 2025-08-29] 2025-08-29 hour 9: 161584 events in 0 files, snapshot none (task 8049 ms: download 4200 ms overlapping gunzip 1047 ms, parse 4313 ms, sort 0 ms, write 0 ms, index 1274 ms: 7 candidates, 77215 repo-hours, 993 releases; waiting 979 ms; commit 0 ms)
2026-11-08T13:36:36Z [load_day 2025-08-29] 2025-08-29 hour 10: 158296 events in 0 files, snapshot none (task 5897 ms: download 3415 ms overlapping gunzip 879 ms, parse 3630 ms, sort 0 ms, write 0 ms, index 603 ms: 5 candidates, 73999 repo-hours, 856 releases; waiting 488 ms; commit 0 ms)
2026-11-08T13:36:43Z [load_day 2025-08-29] 2025-08-29 hour 11: 161564 events in 0 files, snapshot none (task 9473 ms: download 6574 ms overlapping gunzip 1216 ms, parse 4845 ms, sort 0 ms, write 0 ms, index 546 ms: 7 candidates, 71294 repo-hours, 831 releases; waiting 2587 ms; commit 0 ms)
2026-11-08T13:36:44Z [load_day 2025-08-29] 2025-08-29 hour 12: 167520 events in 0 files, snapshot none (task 6954 ms: download 4289 ms overlapping gunzip 1116 ms, parse 4598 ms, sort 0 ms, write 0 ms, index 644 ms: 4 candidates, 95361 repo-hours, 848 releases; waiting 323 ms; commit 0 ms)
2026-11-08T13:36:51Z [load_day 2025-08-29] 2025-08-29 hour 13: 167208 events in 0 files, snapshot none (task 7486 ms: download 4761 ms overlapping gunzip 1145 ms, parse 4835 ms, sort 0 ms, write 0 ms, index 641 ms: 10 candidates, 88083 repo-hours, 852 releases; waiting 555 ms; commit 0 ms)
2026-11-08T13:36:52Z [load_day 2025-08-29] 2025-08-29 hour 14: 164198 events in 0 files, snapshot none (task 7911 ms: download 5331 ms overlapping gunzip 1236 ms, parse 5152 ms, sort 0 ms, write 0 ms, index 649 ms: 10 candidates, 77986 repo-hours, 819 releases; waiting 527 ms; commit 0 ms)
2026-11-08T13:36:59Z [load_day 2025-08-29] 2025-08-29 hour 15: 162688 events in 0 files, snapshot none (task 7616 ms: download 5069 ms overlapping gunzip 1253 ms, parse 4893 ms, sort 0 ms, write 0 ms, index 630 ms: 12 candidates, 77747 repo-hours, 921 releases; waiting 535 ms; commit 0 ms)
2026-11-08T13:37:00Z [load_day 2025-08-29] 2025-08-29 hour 16: 159522 events in 0 files, snapshot none (task 7005 ms: download 4470 ms overlapping gunzip 1120 ms, parse 4434 ms, sort 0 ms, write 0 ms, index 602 ms: 10 candidates, 75519 repo-hours, 807 releases; waiting 509 ms; commit 0 ms)
2026-11-08T13:37:05Z [load_day 2025-08-29] 2025-08-29 hour 17: 162425 events in 0 files, snapshot none (task 5749 ms: download 3314 ms overlapping gunzip 851 ms, parse 3571 ms, sort 0 ms, write 0 ms, index 621 ms: 6 candidates, 73589 repo-hours, 770 releases; waiting 443 ms; commit 0 ms)
2026-11-08T13:37:06Z [load_day 2025-08-29] 2025-08-29 hour 18: 160671 events in 0 files, snapshot none (task 5814 ms: download 3201 ms overlapping gunzip 853 ms, parse 3324 ms, sort 0 ms, write 0 ms, index 805 ms: 10 candidates, 77657 repo-hours, 931 releases; waiting 606 ms; commit 0 ms)
2026-11-08T13:37:11Z [load_day 2025-08-29] 2025-08-29 hour 19: 153977 events in 0 files, snapshot none (task 5758 ms: download 3339 ms overlapping gunzip 911 ms, parse 3457 ms, sort 0 ms, write 0 ms, index 542 ms: 4 candidates, 65167 repo-hours, 731 releases; waiting 631 ms; commit 0 ms)
2026-11-08T13:37:12Z [load_day 2025-08-29] 2025-08-29 hour 20: 153417 events in 0 files, snapshot none (task 5798 ms: download 3509 ms overlapping gunzip 884 ms, parse 3527 ms, sort 0 ms, write 0 ms, index 532 ms: 7 candidates, 66239 repo-hours, 811 releases; waiting 517 ms; commit 0 ms)
2026-11-08T13:37:19Z [load_day 2025-08-29] 2025-08-29 hour 21: 153160 events in 0 files, snapshot none (task 7197 ms: download 4741 ms overlapping gunzip 1244 ms, parse 4927 ms, sort 0 ms, write 0 ms, index 446 ms: 9 candidates, 60413 repo-hours, 838 releases; waiting 365 ms; commit 0 ms)
2026-11-08T13:37:19Z [load_day 2025-08-29] 2025-08-29 hour 22: 145090 events in 0 files, snapshot none (task 6319 ms: download 3726 ms overlapping gunzip 996 ms, parse 4025 ms, sort 0 ms, write 0 ms, index 537 ms: 6 candidates, 55799 repo-hours, 869 releases; waiting 471 ms; commit 0 ms)
2026-11-08T13:37:25Z [load_day 2025-08-29] 2025-08-29 hour 23: 143050 events in 0 files, snapshot none (task 5541 ms: download 3247 ms overlapping gunzip 851 ms, parse 3427 ms, sort 0 ms, write 0 ms, index 392 ms: 8 candidates, 52575 repo-hours, 950 releases; waiting 615 ms; commit 0 ms)
2026-11-08T13:37:35Z [load_day 2025-08-29] 2025-08-29: repo_hour merged from 24 files to 1 (1741036 rows, 9789 ms)
2026-11-08T13:37:38Z [load_day 2025-08-29] 2025-08-29: index committed in 12589 ms (24 + 1 + 24 files)
2026-11-08T13:37:38Z [load_day 2025-08-29] 2025-08-29: 3750290 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:37:38Z [load_day 2025-08-29] attempt 1 succeeded