orcaLog in

Runs · run 3961

load_day 2025-05-29, attempt 1 succeeded

Host
73ccef5e07c2:313923
Started
2026-11-08T12:11:40Z
Ended
2026-11-08T12:15:39Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
686 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
148.9 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3961/load_day/2025-05-29/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:11:40Z [load_day 2025-05-29] attempt 1 started
2026-11-08T12:11:41Z [load_day 2025-05-29] 2025-05-29: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:11:46Z [load_day 2025-05-29] 2025-05-29 hour 0: 141831 events in 0 files, snapshot none (task 4942 ms: download 2447 ms overlapping gunzip 682 ms, parse 2896 ms, sort 0 ms, write 0 ms, index 599 ms: 11 candidates, 71926 repo-hours, 1024 releases; waiting 481 ms; commit 0 ms)
2026-11-08T12:11:46Z [load_day 2025-05-29] 2025-05-29 hour 1: 150403 events in 0 files, snapshot none (task 5148 ms: download 2935 ms overlapping gunzip 685 ms, parse 2949 ms, sort 0 ms, write 0 ms, index 699 ms: 7 candidates, 89743 repo-hours, 755 releases; waiting 506 ms; commit 0 ms)
2026-11-08T12:11:51Z [load_day 2025-05-29] 2025-05-29 hour 2: 137110 events in 0 files, snapshot none (task 4952 ms: download 2553 ms overlapping gunzip 704 ms, parse 2814 ms, sort 0 ms, write 0 ms, index 611 ms: 12 candidates, 70259 repo-hours, 748 releases; waiting 518 ms; commit 0 ms)
2026-11-08T12:11:52Z [load_day 2025-05-29] 2025-05-29 hour 3: 139248 events in 0 files, snapshot none (task 5408 ms: download 3206 ms overlapping gunzip 716 ms, parse 2892 ms, sort 0 ms, write 0 ms, index 596 ms: 9 candidates, 67224 repo-hours, 1855 releases; waiting 874 ms; commit 0 ms)
2026-11-08T12:11:58Z [load_day 2025-05-29] 2025-05-29 hour 4: 136087 events in 0 files, snapshot none (task 5639 ms: download 3228 ms overlapping gunzip 821 ms, parse 3663 ms, sort 0 ms, write 0 ms, index 444 ms: 8 candidates, 62832 repo-hours, 823 releases; waiting 483 ms; commit 0 ms)
2026-11-08T12:11:58Z [load_day 2025-05-29] 2025-05-29 hour 5: 145485 events in 0 files, snapshot none (task 5781 ms: download 3295 ms overlapping gunzip 843 ms, parse 3638 ms, sort 0 ms, write 0 ms, index 490 ms: 8 candidates, 66387 repo-hours, 688 releases; waiting 492 ms; commit 0 ms)
2026-11-08T12:12:04Z [load_day 2025-05-29] 2025-05-29 hour 6: 154924 events in 0 files, snapshot none (task 5785 ms: download 3369 ms overlapping gunzip 872 ms, parse 3430 ms, sort 0 ms, write 0 ms, index 590 ms: 7 candidates, 79217 repo-hours, 743 releases; waiting 628 ms; commit 0 ms)
2026-11-08T12:14:32Z [load_day 2025-05-29] 2025-05-29 hour 7: 156406 events in 0 files, snapshot none (task 152940 ms: download 151820 ms overlapping gunzip 1191 ms, parse 5324 ms, sort 0 ms, write 0 ms, index 681 ms: 6 candidates, 73812 repo-hours, 851 releases; waiting 145339 ms; commit 0 ms)
2026-11-08T12:14:32Z [load_day 2025-05-29] 2025-05-29 hour 8: 155857 events in 0 files, snapshot none (task 5951 ms: download 3470 ms overlapping gunzip 883 ms, parse 3549 ms, sort 0 ms, write 0 ms, index 596 ms: 12 candidates, 77637 repo-hours, 846 releases; waiting 587 ms; commit 0 ms)
2026-11-08T12:14:39Z [load_day 2025-05-29] 2025-05-29 hour 9: 156110 events in 0 files, snapshot none (task 6882 ms: download 4153 ms overlapping gunzip 1050 ms, parse 4500 ms, sort 0 ms, write 0 ms, index 663 ms: 12 candidates, 78181 repo-hours, 864 releases; waiting 378 ms; commit 0 ms)
2026-11-08T12:14:39Z [load_day 2025-05-29] 2025-05-29 hour 10: 156078 events in 0 files, snapshot none (task 6765 ms: download 4107 ms overlapping gunzip 1022 ms, parse 4359 ms, sort 0 ms, write 0 ms, index 623 ms: 11 candidates, 77827 repo-hours, 828 releases; waiting 529 ms; commit 0 ms)
2026-11-08T12:14:47Z [load_day 2025-05-29] 2025-05-29 hour 11: 155604 events in 0 files, snapshot none (task 6852 ms: download 4287 ms overlapping gunzip 1054 ms, parse 4352 ms, sort 0 ms, write 0 ms, index 574 ms: 7 candidates, 73781 repo-hours, 730 releases; waiting 486 ms; commit 0 ms)
2026-11-08T12:14:47Z [load_day 2025-05-29] 2025-05-29 hour 12: 166442 events in 0 files, snapshot none (task 7220 ms: download 4660 ms overlapping gunzip 1082 ms, parse 4556 ms, sort 0 ms, write 0 ms, index 708 ms: 11 candidates, 97863 repo-hours, 748 releases; waiting 642 ms; commit 0 ms)
2026-11-08T12:14:54Z [load_day 2025-05-29] 2025-05-29 hour 13: 162868 events in 0 files, snapshot none (task 6575 ms: download 3674 ms overlapping gunzip 976 ms, parse 4101 ms, sort 0 ms, write 0 ms, index 695 ms: 13 candidates, 89751 repo-hours, 693 releases; waiting 457 ms; commit 0 ms)
2026-11-08T12:14:54Z [load_day 2025-05-29] 2025-05-29 hour 14: 162668 events in 0 files, snapshot none (task 6440 ms: download 3753 ms overlapping gunzip 988 ms, parse 3886 ms, sort 0 ms, write 0 ms, index 725 ms: 12 candidates, 82285 repo-hours, 828 releases; waiting 485 ms; commit 0 ms)
2026-11-08T12:15:00Z [load_day 2025-05-29] 2025-05-29 hour 15: 160333 events in 0 files, snapshot none (task 5641 ms: download 3070 ms overlapping gunzip 870 ms, parse 3475 ms, sort 0 ms, write 0 ms, index 713 ms: 10 candidates, 83240 repo-hours, 840 releases; waiting 262 ms; commit 0 ms)
2026-11-08T12:15:01Z [load_day 2025-05-29] 2025-05-29 hour 16: 161575 events in 0 files, snapshot none (task 6095 ms: download 3349 ms overlapping gunzip 984 ms, parse 3913 ms, sort 0 ms, write 0 ms, index 768 ms: 4 candidates, 80953 repo-hours, 880 releases; waiting 226 ms; commit 0 ms)
2026-11-08T12:15:07Z [load_day 2025-05-29] 2025-05-29 hour 17: 155262 events in 0 files, snapshot none (task 6500 ms: download 3343 ms overlapping gunzip 900 ms, parse 3670 ms, sort 0 ms, write 0 ms, index 714 ms: 15 candidates, 76311 repo-hours, 779 releases; waiting 815 ms; commit 0 ms)
2026-11-08T12:15:08Z [load_day 2025-05-29] 2025-05-29 hour 18: 160102 events in 0 files, snapshot none (task 6541 ms: download 3847 ms overlapping gunzip 997 ms, parse 4052 ms, sort 0 ms, write 0 ms, index 643 ms: 15 candidates, 81043 repo-hours, 762 releases; waiting 532 ms; commit 0 ms)
2026-11-08T12:15:15Z [load_day 2025-05-29] 2025-05-29 hour 19: 154874 events in 0 files, snapshot none (task 7768 ms: download 4968 ms overlapping gunzip 1036 ms, parse 4307 ms, sort 0 ms, write 0 ms, index 680 ms: 11 candidates, 72306 repo-hours, 818 releases; waiting 1362 ms; commit 0 ms)
2026-11-08T12:15:15Z [load_day 2025-05-29] 2025-05-29 hour 20: 155043 events in 0 files, snapshot none (task 7026 ms: download 4392 ms overlapping gunzip 1026 ms, parse 4414 ms, sort 0 ms, write 0 ms, index 611 ms: 11 candidates, 72596 repo-hours, 890 releases; waiting 592 ms; commit 0 ms)
2026-11-08T12:15:22Z [load_day 2025-05-29] 2025-05-29 hour 21: 148908 events in 0 files, snapshot none (task 6788 ms: download 3276 ms overlapping gunzip 990 ms, parse 4156 ms, sort 0 ms, write 0 ms, index 786 ms: 6 candidates, 69025 repo-hours, 869 releases; waiting 524 ms; commit 0 ms)
2026-11-08T12:15:23Z [load_day 2025-05-29] 2025-05-29 hour 22: 142762 events in 0 files, snapshot none (task 6207 ms: download 3690 ms overlapping gunzip 927 ms, parse 3941 ms, sort 0 ms, write 0 ms, index 483 ms: 12 candidates, 62485 repo-hours, 849 releases; waiting 521 ms; commit 0 ms)
2026-11-08T12:15:27Z [load_day 2025-05-29] 2025-05-29 hour 23: 140930 events in 0 files, snapshot none (task 4716 ms: download 2890 ms overlapping gunzip 719 ms, parse 2841 ms, sort 0 ms, write 0 ms, index 471 ms: 7 candidates, 60316 repo-hours, 937 releases; waiting 403 ms; commit 0 ms)
2026-11-08T12:15:36Z [load_day 2025-05-29] 2025-05-29: repo_hour merged from 24 files to 1 (1817000 rows, 8488 ms)
2026-11-08T12:15:39Z [load_day 2025-05-29] 2025-05-29: index committed in 11270 ms (24 + 1 + 24 files)
2026-11-08T12:15:39Z [load_day 2025-05-29] 2025-05-29: 3656910 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:15:39Z [load_day 2025-05-29] attempt 1 succeeded