orcaLog in

Runs · run 4245

load_day 2025-08-07, attempt 1 succeeded

Host
73ccef5e07c2:357059
Started
2026-11-08T13:16:32Z
Ended
2026-11-08T13:18:16Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
674 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
156.4 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4245/load_day/2025-08-07/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:16:32Z [load_day 2025-08-07] attempt 1 started
2026-11-08T13:16:33Z [load_day 2025-08-07] 2025-08-07: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:16:41Z [load_day 2025-08-07] 2025-08-07 hour 0: 150164 events in 0 files, snapshot none (task 7385 ms: download 4483 ms overlapping gunzip 1237 ms, parse 4892 ms, sort 0 ms, write 0 ms, index 636 ms: 4 candidates, 69642 repo-hours, 975 releases; waiting 386 ms; commit 0 ms)
2026-11-08T13:16:41Z [load_day 2025-08-07] 2025-08-07 hour 1: 151126 events in 0 files, snapshot none (task 6566 ms: download 3439 ms overlapping gunzip 1026 ms, parse 3983 ms, sort 0 ms, write 0 ms, index 774 ms: 6 candidates, 85289 repo-hours, 746 releases; waiting 485 ms; commit 0 ms)
2026-11-08T13:16:48Z [load_day 2025-08-07] 2025-08-07 hour 2: 150862 events in 0 files, snapshot none (task 6644 ms: download 3990 ms overlapping gunzip 985 ms, parse 4072 ms, sort 0 ms, write 0 ms, index 755 ms: 8 candidates, 76785 repo-hours, 773 releases; waiting 506 ms; commit 0 ms)
2026-11-08T13:16:48Z [load_day 2025-08-07] 2025-08-07 hour 3: 145792 events in 0 files, snapshot none (task 7311 ms: download 4178 ms overlapping gunzip 1049 ms, parse 4267 ms, sort 0 ms, write 0 ms, index 570 ms: 3 candidates, 65278 repo-hours, 932 releases; waiting 1148 ms; commit 0 ms)
2026-11-08T13:16:55Z [load_day 2025-08-07] 2025-08-07 hour 4: 148771 events in 0 files, snapshot none (task 6778 ms: download 3140 ms overlapping gunzip 1000 ms, parse 4054 ms, sort 0 ms, write 0 ms, index 862 ms: 2 candidates, 67844 repo-hours, 1958 releases; waiting 553 ms; commit 0 ms)
2026-11-08T13:16:55Z [load_day 2025-08-07] 2025-08-07 hour 5: 148148 events in 0 files, snapshot none (task 6589 ms: download 3303 ms overlapping gunzip 1011 ms, parse 3989 ms, sort 0 ms, write 0 ms, index 930 ms: 2 candidates, 67462 repo-hours, 718 releases; waiting 335 ms; commit 0 ms)
2026-11-08T13:17:02Z [load_day 2025-08-07] 2025-08-07 hour 6: 152883 events in 0 files, snapshot none (task 6393 ms: download 3615 ms overlapping gunzip 964 ms, parse 3853 ms, sort 0 ms, write 0 ms, index 869 ms: 5 candidates, 77447 repo-hours, 875 releases; waiting 487 ms; commit 0 ms)
2026-11-08T13:17:03Z [load_day 2025-08-07] 2025-08-07 hour 7: 161653 events in 0 files, snapshot none (task 7205 ms: download 3907 ms overlapping gunzip 1125 ms, parse 4418 ms, sort 0 ms, write 0 ms, index 843 ms: 6 candidates, 75909 repo-hours, 797 releases; waiting 488 ms; commit 0 ms)
2026-11-08T13:17:10Z [load_day 2025-08-07] 2025-08-07 hour 8: 160361 events in 0 files, snapshot none (task 7232 ms: download 4410 ms overlapping gunzip 1106 ms, parse 4375 ms, sort 0 ms, write 0 ms, index 890 ms: 4 candidates, 79453 repo-hours, 926 releases; waiting 491 ms; commit 0 ms)
2026-11-08T13:17:11Z [load_day 2025-08-07] 2025-08-07 hour 9: 157779 events in 0 files, snapshot none (task 6751 ms: download 4089 ms overlapping gunzip 1051 ms, parse 4164 ms, sort 0 ms, write 0 ms, index 714 ms: 6 candidates, 79186 repo-hours, 992 releases; waiting 586 ms; commit 0 ms)
2026-11-08T13:17:17Z [load_day 2025-08-07] 2025-08-07 hour 10: 157050 events in 0 files, snapshot none (task 6038 ms: download 3753 ms overlapping gunzip 935 ms, parse 3662 ms, sort 0 ms, write 0 ms, index 623 ms: 4 candidates, 76619 repo-hours, 820 releases; waiting 544 ms; commit 0 ms)
2026-11-08T13:17:18Z [load_day 2025-08-07] 2025-08-07 hour 11: 160061 events in 0 files, snapshot none (task 6641 ms: download 4532 ms overlapping gunzip 1026 ms, parse 3991 ms, sort 0 ms, write 0 ms, index 638 ms: 9 candidates, 75613 repo-hours, 885 releases; waiting 736 ms; commit 0 ms)
2026-11-08T13:17:23Z [load_day 2025-08-07] 2025-08-07 hour 12: 165474 events in 0 files, snapshot none (task 6008 ms: download 3445 ms overlapping gunzip 886 ms, parse 3574 ms, sort 0 ms, write 0 ms, index 681 ms: 12 candidates, 95453 repo-hours, 931 releases; waiting 505 ms; commit 0 ms)
2026-11-08T13:17:25Z [load_day 2025-08-07] 2025-08-07 hour 13: 167512 events in 0 files, snapshot none (task 6447 ms: download 4051 ms overlapping gunzip 1008 ms, parse 3919 ms, sort 0 ms, write 0 ms, index 626 ms: 7 candidates, 92050 repo-hours, 834 releases; waiting 536 ms; commit 0 ms)
2026-11-08T13:17:30Z [load_day 2025-08-07] 2025-08-07 hour 14: 160359 events in 0 files, snapshot none (task 5953 ms: download 3736 ms overlapping gunzip 908 ms, parse 3416 ms, sort 0 ms, write 0 ms, index 656 ms: 7 candidates, 80567 repo-hours, 948 releases; waiting 721 ms; commit 0 ms)
2026-11-08T13:17:31Z [load_day 2025-08-07] 2025-08-07 hour 15: 162389 events in 0 files, snapshot none (task 5743 ms: download 3368 ms overlapping gunzip 966 ms, parse 3520 ms, sort 0 ms, write 0 ms, index 639 ms: 6 candidates, 80463 repo-hours, 974 releases; waiting 319 ms; commit 0 ms)
2026-11-08T13:17:39Z [load_day 2025-08-07] 2025-08-07 hour 16: 164816 events in 0 files, snapshot none (task 8447 ms: download 5866 ms overlapping gunzip 1437 ms, parse 5347 ms, sort 0 ms, write 0 ms, index 677 ms: 4 candidates, 79347 repo-hours, 906 releases; waiting 606 ms; commit 0 ms)
2026-11-08T13:17:39Z [load_day 2025-08-07] 2025-08-07 hour 17: 161339 events in 0 files, snapshot none (task 7646 ms: download 5104 ms overlapping gunzip 1281 ms, parse 4875 ms, sort 0 ms, write 0 ms, index 645 ms: 5 candidates, 75278 repo-hours, 865 releases; waiting 557 ms; commit 0 ms)
2026-11-08T13:17:47Z [load_day 2025-08-07] 2025-08-07 hour 18: 162326 events in 0 files, snapshot none (task 7449 ms: download 4857 ms overlapping gunzip 1250 ms, parse 5109 ms, sort 0 ms, write 0 ms, index 633 ms: 3 candidates, 80872 repo-hours, 887 releases; waiting 228 ms; commit 0 ms)
2026-11-08T13:17:47Z [load_day 2025-08-07] 2025-08-07 hour 19: 151909 events in 0 files, snapshot none (task 7600 ms: download 5018 ms overlapping gunzip 1241 ms, parse 4919 ms, sort 0 ms, write 0 ms, index 508 ms: 5 candidates, 67300 repo-hours, 750 releases; waiting 624 ms; commit 0 ms)
2026-11-08T13:17:56Z [load_day 2025-08-07] 2025-08-07 hour 20: 156378 events in 0 files, snapshot none (task 8289 ms: download 5928 ms overlapping gunzip 1444 ms, parse 5460 ms, sort 0 ms, write 0 ms, index 543 ms: 11 candidates, 68770 repo-hours, 853 releases; waiting 523 ms; commit 0 ms)
2026-11-08T13:17:56Z [load_day 2025-08-07] 2025-08-07 hour 21: 155170 events in 0 files, snapshot none (task 8454 ms: download 6128 ms overlapping gunzip 1476 ms, parse 5641 ms, sort 0 ms, write 0 ms, index 516 ms: 5 candidates, 66095 repo-hours, 1076 releases; waiting 518 ms; commit 0 ms)
2026-11-08T13:18:04Z [load_day 2025-08-07] 2025-08-07 hour 22: 145116 events in 0 files, snapshot none (task 7483 ms: download 5258 ms overlapping gunzip 1311 ms, parse 4851 ms, sort 0 ms, write 0 ms, index 477 ms: 3 candidates, 58304 repo-hours, 931 releases; waiting 497 ms; commit 0 ms)
2026-11-08T13:18:04Z [load_day 2025-08-07] 2025-08-07 hour 23: 143102 events in 0 files, snapshot none (task 6872 ms: download 4782 ms overlapping gunzip 1279 ms, parse 4378 ms, sort 0 ms, write 0 ms, index 405 ms: 2 candidates, 55673 repo-hours, 1038 releases; waiting 506 ms; commit 0 ms)
2026-11-08T13:18:13Z [load_day 2025-08-07] 2025-08-07: repo_hour merged from 24 files to 1 (1796699 rows, 8841 ms)
2026-11-08T13:18:16Z [load_day 2025-08-07] 2025-08-07: index committed in 12194 ms (24 + 1 + 24 files)
2026-11-08T13:18:16Z [load_day 2025-08-07] 2025-08-07: 3740540 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:18:16Z [load_day 2025-08-07] attempt 1 succeeded