orcaLog in

Runs · run 3650

load_day 2025-03-09, attempt 1 succeeded

Host
73ccef5e07c2:267867
Started
2026-11-08T10:45:05Z
Ended
2026-11-08T10:46:49Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
732 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
141.2 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3650/load_day/2025-03-09/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:45:05Z [load_day 2025-03-09] attempt 1 started
2026-11-08T10:45:06Z [load_day 2025-03-09] 2025-03-09: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:45:12Z [load_day 2025-03-09] 2025-03-09 hour 0: 197134 events in 0 files, snapshot none (task 5745 ms: download 2914 ms overlapping gunzip 804 ms, parse 3506 ms, sort 0 ms, write 0 ms, index 635 ms: 10 candidates, 95230 repo-hours, 1339 releases; waiting 479 ms; commit 0 ms)
2026-11-08T10:45:13Z [load_day 2025-03-09] 2025-03-09 hour 1: 206173 events in 0 files, snapshot none (task 6407 ms: download 3704 ms overlapping gunzip 917 ms, parse 4056 ms, sort 0 ms, write 0 ms, index 734 ms: 6 candidates, 109994 repo-hours, 915 releases; waiting 491 ms; commit 0 ms)
2026-11-08T10:45:17Z [load_day 2025-03-09] 2025-03-09 hour 2: 176845 events in 0 files, snapshot none (task 4763 ms: download 2782 ms overlapping gunzip 657 ms, parse 2820 ms, sort 0 ms, write 0 ms, index 459 ms: 6 candidates, 63608 repo-hours, 757 releases; waiting 451 ms; commit 0 ms)
2026-11-08T10:45:19Z [load_day 2025-03-09] 2025-03-09 hour 3: 193853 events in 0 files, snapshot none (task 5390 ms: download 2646 ms overlapping gunzip 695 ms, parse 3120 ms, sort 0 ms, write 0 ms, index 720 ms: 4 candidates, 70412 repo-hours, 3846 releases; waiting 566 ms; commit 0 ms)
2026-11-08T10:45:22Z [load_day 2025-03-09] 2025-03-09 hour 4: 180705 events in 0 files, snapshot none (task 4390 ms: download 2120 ms overlapping gunzip 639 ms, parse 2563 ms, sort 0 ms, write 0 ms, index 439 ms: 6 candidates, 61811 repo-hours, 602 releases; waiting 382 ms; commit 0 ms)
2026-11-08T10:45:24Z [load_day 2025-03-09] 2025-03-09 hour 5: 185088 events in 0 files, snapshot none (task 4272 ms: download 2058 ms overlapping gunzip 600 ms, parse 2658 ms, sort 0 ms, write 0 ms, index 449 ms: 3 candidates, 64431 repo-hours, 741 releases; waiting 240 ms; commit 0 ms)
2026-11-08T10:45:28Z [load_day 2025-03-09] 2025-03-09 hour 6: 205400 events in 0 files, snapshot none (task 5231 ms: download 3098 ms overlapping gunzip 702 ms, parse 2964 ms, sort 0 ms, write 0 ms, index 717 ms: 6 candidates, 83532 repo-hours, 879 releases; waiting 595 ms; commit 0 ms)
2026-11-08T10:45:29Z [load_day 2025-03-09] 2025-03-09 hour 7: 193802 events in 0 files, snapshot none (task 4798 ms: download 2391 ms overlapping gunzip 707 ms, parse 2900 ms, sort 0 ms, write 0 ms, index 555 ms: 8 candidates, 68067 repo-hours, 715 releases; waiting 357 ms; commit 0 ms)
2026-11-08T10:45:35Z [load_day 2025-03-09] 2025-03-09 hour 8: 197567 events in 0 files, snapshot none (task 6848 ms: download 3745 ms overlapping gunzip 1059 ms, parse 4454 ms, sort 0 ms, write 0 ms, index 565 ms: 8 candidates, 73036 repo-hours, 842 releases; waiting 481 ms; commit 0 ms)
2026-11-08T10:45:36Z [load_day 2025-03-09] 2025-03-09 hour 9: 192280 events in 0 files, snapshot none (task 6454 ms: download 3972 ms overlapping gunzip 952 ms, parse 4218 ms, sort 0 ms, write 0 ms, index 574 ms: 3 candidates, 75150 repo-hours, 879 releases; waiting 471 ms; commit 0 ms)
2026-11-08T10:45:50Z [load_day 2025-03-09] 2025-03-09 hour 10: 204418 events in 0 files, snapshot none (task 7279 ms: download 3868 ms overlapping gunzip 1118 ms, parse 4782 ms, sort 0 ms, write 0 ms, index 690 ms: 5 candidates, 76608 repo-hours, 783 releases; waiting 482 ms; commit 0 ms)
2026-11-08T10:45:50Z [load_day 2025-03-09] 2025-03-09 hour 11: 207177 events in 0 files, snapshot none (task 7188 ms: download 3913 ms overlapping gunzip 1007 ms, parse 4657 ms, sort 0 ms, write 0 ms, index 749 ms: 9 candidates, 74428 repo-hours, 935 releases; waiting 500 ms; commit 0 ms)
2026-11-08T10:45:59Z [load_day 2025-03-09] 2025-03-09 hour 12: 286023 events in 0 files, snapshot none (task 8307 ms: download 4438 ms overlapping gunzip 1143 ms, parse 5248 ms, sort 0 ms, write 0 ms, index 1118 ms: 10 candidates, 124725 repo-hours, 1026 releases; waiting 526 ms; commit 0 ms)
2026-11-08T10:45:59Z [load_day 2025-03-09] 2025-03-09 hour 13: 233849 events in 0 files, snapshot none (task 7888 ms: download 4292 ms overlapping gunzip 1116 ms, parse 4890 ms, sort 0 ms, write 0 ms, index 1065 ms: 3 candidates, 100762 repo-hours, 936 releases; waiting 510 ms; commit 0 ms)
2026-11-08T10:46:07Z [load_day 2025-03-09] 2025-03-09 hour 14: 227658 events in 0 files, snapshot none (task 7513 ms: download 3936 ms overlapping gunzip 1114 ms, parse 4979 ms, sort 0 ms, write 0 ms, index 872 ms: 4 candidates, 87207 repo-hours, 1075 releases; waiting 287 ms; commit 0 ms)
2026-11-08T10:46:07Z [load_day 2025-03-09] 2025-03-09 hour 15: 232550 events in 0 files, snapshot none (task 7173 ms: download 3772 ms overlapping gunzip 1037 ms, parse 4526 ms, sort 0 ms, write 0 ms, index 781 ms: 7 candidates, 93294 repo-hours, 1224 releases; waiting 545 ms; commit 0 ms)
2026-11-08T10:46:14Z [load_day 2025-03-09] 2025-03-09 hour 16: 223560 events in 0 files, snapshot none (task 7011 ms: download 4016 ms overlapping gunzip 1027 ms, parse 4208 ms, sort 0 ms, write 0 ms, index 949 ms: 9 candidates, 84984 repo-hours, 1297 releases; waiting 504 ms; commit 0 ms)
2026-11-08T10:46:14Z [load_day 2025-03-09] 2025-03-09 hour 17: 219898 events in 0 files, snapshot none (task 6632 ms: download 3905 ms overlapping gunzip 902 ms, parse 4152 ms, sort 0 ms, write 0 ms, index 795 ms: 6 candidates, 80997 repo-hours, 1054 releases; waiting 496 ms; commit 0 ms)
2026-11-08T10:46:23Z [load_day 2025-03-09] 2025-03-09 hour 18: 231844 events in 0 files, snapshot none (task 8393 ms: download 5485 ms overlapping gunzip 1278 ms, parse 5573 ms, sort 0 ms, write 0 ms, index 764 ms: 4 candidates, 98110 repo-hours, 1056 releases; waiting 467 ms; commit 0 ms)
2026-11-08T10:46:23Z [load_day 2025-03-09] 2025-03-09 hour 19: 208663 events in 0 files, snapshot none (task 7724 ms: download 4380 ms overlapping gunzip 1149 ms, parse 5133 ms, sort 0 ms, write 0 ms, index 662 ms: 5 candidates, 73850 repo-hours, 1052 releases; waiting 509 ms; commit 0 ms)
2026-11-08T10:46:31Z [load_day 2025-03-09] 2025-03-09 hour 20: 206270 events in 0 files, snapshot none (task 7441 ms: download 4235 ms overlapping gunzip 1071 ms, parse 4754 ms, sort 0 ms, write 0 ms, index 815 ms: 10 candidates, 75412 repo-hours, 1001 releases; waiting 527 ms; commit 0 ms)
2026-11-08T10:46:31Z [load_day 2025-03-09] 2025-03-09 hour 21: 207510 events in 0 files, snapshot none (task 7485 ms: download 4453 ms overlapping gunzip 1126 ms, parse 4713 ms, sort 0 ms, write 0 ms, index 810 ms: 13 candidates, 77001 repo-hours, 1305 releases; waiting 562 ms; commit 0 ms)
2026-11-08T10:46:37Z [load_day 2025-03-09] 2025-03-09 hour 22: 189844 events in 0 files, snapshot none (task 5635 ms: download 2998 ms overlapping gunzip 799 ms, parse 3526 ms, sort 0 ms, write 0 ms, index 520 ms: 9 candidates, 66956 repo-hours, 998 releases; waiting 383 ms; commit 0 ms)
2026-11-08T10:46:37Z [load_day 2025-03-09] 2025-03-09 hour 23: 182471 events in 0 files, snapshot none (task 5806 ms: download 3083 ms overlapping gunzip 789 ms, parse 3571 ms, sort 0 ms, write 0 ms, index 466 ms: 10 candidates, 64143 repo-hours, 967 releases; waiting 480 ms; commit 0 ms)
2026-11-08T10:46:46Z [load_day 2025-03-09] 2025-03-09: repo_hour merged from 24 files to 1 (1943748 rows, 8640 ms)
2026-11-08T10:46:49Z [load_day 2025-03-09] 2025-03-09: index committed in 11205 ms (24 + 1 + 24 files)
2026-11-08T10:46:49Z [load_day 2025-03-09] 2025-03-09: 4990582 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:46:49Z [load_day 2025-03-09] attempt 1 succeeded