orcaLog in

Runs · run 3887

load_day 2025-05-11, attempt 1 succeeded

Host
73ccef5e07c2:302759
Started
2026-11-08T11:53:23Z
Ended
2026-11-08T11:55:01Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
773 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
139.9 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3887/load_day/2025-05-11/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:53:23Z [load_day 2025-05-11] attempt 1 started
2026-11-08T11:53:24Z [load_day 2025-05-11] 2025-05-11: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:53:29Z [load_day 2025-05-11] 2025-05-11 hour 0: 160884 events in 0 files, snapshot none (task 4601 ms: download 2657 ms overlapping gunzip 601 ms, parse 2620 ms, sort 0 ms, write 0 ms, index 519 ms: 7 candidates, 71550 repo-hours, 1153 releases; waiting 566 ms; commit 0 ms)
2026-11-08T11:53:30Z [load_day 2025-05-11] 2025-05-11 hour 1: 192697 events in 0 files, snapshot none (task 5155 ms: download 2990 ms overlapping gunzip 673 ms, parse 2965 ms, sort 0 ms, write 0 ms, index 721 ms: 11 candidates, 106596 repo-hours, 927 releases; waiting 475 ms; commit 0 ms)
2026-11-08T11:53:35Z [load_day 2025-05-11] 2025-05-11 hour 2: 163667 events in 0 files, snapshot none (task 4594 ms: download 2862 ms overlapping gunzip 631 ms, parse 2670 ms, sort 0 ms, write 0 ms, index 547 ms: 13 candidates, 74095 repo-hours, 876 releases; waiting 530 ms; commit 0 ms)
2026-11-08T11:53:37Z [load_day 2025-05-11] 2025-05-11 hour 3: 170016 events in 0 files, snapshot none (task 6122 ms: download 3643 ms overlapping gunzip 648 ms, parse 2814 ms, sort 0 ms, write 0 ms, index 610 ms: 19 candidates, 66699 repo-hours, 2894 releases; waiting 1761 ms; commit 0 ms)
2026-11-08T11:53:41Z [load_day 2025-05-11] 2025-05-11 hour 4: 163633 events in 0 files, snapshot none (task 6151 ms: download 3084 ms overlapping gunzip 879 ms, parse 3784 ms, sort 0 ms, write 0 ms, index 674 ms: 11 candidates, 61247 repo-hours, 751 releases; waiting 410 ms; commit 0 ms)
2026-11-08T11:53:43Z [load_day 2025-05-11] 2025-05-11 hour 5: 172556 events in 0 files, snapshot none (task 5464 ms: download 2873 ms overlapping gunzip 768 ms, parse 3324 ms, sort 0 ms, write 0 ms, index 473 ms: 1 candidates, 62029 repo-hours, 814 releases; waiting 477 ms; commit 0 ms)
2026-11-08T11:53:47Z [load_day 2025-05-11] 2025-05-11 hour 6: 188697 events in 0 files, snapshot none (task 5763 ms: download 3139 ms overlapping gunzip 823 ms, parse 3546 ms, sort 0 ms, write 0 ms, index 653 ms: 6 candidates, 76802 repo-hours, 887 releases; waiting 474 ms; commit 0 ms)
2026-11-08T11:53:50Z [load_day 2025-05-11] 2025-05-11 hour 7: 181560 events in 0 files, snapshot none (task 6879 ms: download 3628 ms overlapping gunzip 919 ms, parse 4007 ms, sort 0 ms, write 0 ms, index 1085 ms: 5 candidates, 68215 repo-hours, 687 releases; waiting 519 ms; commit 0 ms)
2026-11-08T11:53:54Z [load_day 2025-05-11] 2025-05-11 hour 8: 187627 events in 0 files, snapshot none (task 6080 ms: download 3182 ms overlapping gunzip 828 ms, parse 3731 ms, sort 0 ms, write 0 ms, index 732 ms: 5 candidates, 74727 repo-hours, 882 releases; waiting 465 ms; commit 0 ms)
2026-11-08T11:53:58Z [load_day 2025-05-11] 2025-05-11 hour 9: 198204 events in 0 files, snapshot none (task 7163 ms: download 3473 ms overlapping gunzip 989 ms, parse 4106 ms, sort 0 ms, write 0 ms, index 1205 ms: 8 candidates, 77124 repo-hours, 875 releases; waiting 543 ms; commit 0 ms)
2026-11-08T11:54:02Z [load_day 2025-05-11] 2025-05-11 hour 10: 199024 events in 0 files, snapshot none (task 6845 ms: download 3743 ms overlapping gunzip 916 ms, parse 4053 ms, sort 0 ms, write 0 ms, index 907 ms: 6 candidates, 78666 repo-hours, 859 releases; waiting 569 ms; commit 0 ms)
2026-11-08T11:54:06Z [load_day 2025-05-11] 2025-05-11 hour 11: 197787 events in 0 files, snapshot none (task 7013 ms: download 2954 ms overlapping gunzip 1014 ms, parse 4199 ms, sort 0 ms, write 0 ms, index 1190 ms: 4 candidates, 75349 repo-hours, 804 releases; waiting 293 ms; commit 0 ms)
2026-11-08T11:54:10Z [load_day 2025-05-11] 2025-05-11 hour 12: 246141 events in 0 files, snapshot none (task 7784 ms: download 4480 ms overlapping gunzip 1044 ms, parse 4915 ms, sort 0 ms, write 0 ms, index 1071 ms: 5 candidates, 121486 repo-hours, 1012 releases; waiting 539 ms; commit 0 ms)
2026-11-08T11:54:13Z [load_day 2025-05-11] 2025-05-11 hour 13: 231189 events in 0 files, snapshot none (task 6837 ms: download 3935 ms overlapping gunzip 893 ms, parse 4077 ms, sort 0 ms, write 0 ms, index 1007 ms: 8 candidates, 106801 repo-hours, 918 releases; waiting 500 ms; commit 0 ms)
2026-11-08T11:54:18Z [load_day 2025-05-11] 2025-05-11 hour 14: 214347 events in 0 files, snapshot none (task 7258 ms: download 3447 ms overlapping gunzip 1028 ms, parse 4447 ms, sort 0 ms, write 0 ms, index 976 ms: 3 candidates, 85343 repo-hours, 1024 releases; waiting 534 ms; commit 0 ms)
2026-11-08T11:54:20Z [load_day 2025-05-11] 2025-05-11 hour 15: 220415 events in 0 files, snapshot none (task 5739 ms: download 2962 ms overlapping gunzip 883 ms, parse 3639 ms, sort 0 ms, write 0 ms, index 745 ms: 11 candidates, 90870 repo-hours, 1150 releases; waiting 230 ms; commit 0 ms)
2026-11-08T11:54:27Z [load_day 2025-05-11] 2025-05-11 hour 16: 215671 events in 0 files, snapshot none (task 8054 ms: download 5238 ms overlapping gunzip 852 ms, parse 3966 ms, sort 0 ms, write 0 ms, index 861 ms: 3 candidates, 87286 repo-hours, 1051 releases; waiting 2042 ms; commit 0 ms)
2026-11-08T11:54:27Z [load_day 2025-05-11] 2025-05-11 hour 17: 214261 events in 0 files, snapshot none (task 6893 ms: download 3982 ms overlapping gunzip 959 ms, parse 4276 ms, sort 0 ms, write 0 ms, index 808 ms: 4 candidates, 81089 repo-hours, 941 releases; waiting 541 ms; commit 0 ms)
2026-11-08T11:54:35Z [load_day 2025-05-11] 2025-05-11 hour 18: 218265 events in 0 files, snapshot none (task 7546 ms: download 4492 ms overlapping gunzip 1103 ms, parse 5006 ms, sort 0 ms, write 0 ms, index 709 ms: 6 candidates, 94929 repo-hours, 1073 releases; waiting 351 ms; commit 0 ms)
2026-11-08T11:54:35Z [load_day 2025-05-11] 2025-05-11 hour 19: 200921 events in 0 files, snapshot none (task 6578 ms: download 4001 ms overlapping gunzip 947 ms, parse 4269 ms, sort 0 ms, write 0 ms, index 547 ms: 4 candidates, 73386 repo-hours, 895 releases; waiting 525 ms; commit 0 ms)
2026-11-08T11:54:43Z [load_day 2025-05-11] 2025-05-11 hour 20: 198350 events in 0 files, snapshot none (task 7504 ms: download 3064 ms overlapping gunzip 1148 ms, parse 4855 ms, sort 0 ms, write 0 ms, index 1044 ms: 5 candidates, 76795 repo-hours, 1023 releases; waiting 166 ms; commit 0 ms)
2026-11-08T11:54:43Z [load_day 2025-05-11] 2025-05-11 hour 21: 187553 events in 0 files, snapshot none (task 6846 ms: download 3142 ms overlapping gunzip 868 ms, parse 4345 ms, sort 0 ms, write 0 ms, index 863 ms: 3 candidates, 69521 repo-hours, 951 releases; waiting 485 ms; commit 0 ms)
2026-11-08T11:54:50Z [load_day 2025-05-11] 2025-05-11 hour 22: 171225 events in 0 files, snapshot none (task 6558 ms: download 3702 ms overlapping gunzip 995 ms, parse 4275 ms, sort 0 ms, write 0 ms, index 497 ms: 13 candidates, 62353 repo-hours, 935 releases; waiting 480 ms; commit 0 ms)
2026-11-08T11:54:50Z [load_day 2025-05-11] 2025-05-11 hour 23: 167430 events in 0 files, snapshot none (task 6499 ms: download 3674 ms overlapping gunzip 944 ms, parse 4172 ms, sort 0 ms, write 0 ms, index 557 ms: 9 candidates, 60113 repo-hours, 883 releases; waiting 484 ms; commit 0 ms)
2026-11-08T11:54:59Z [load_day 2025-05-11] 2025-05-11: repo_hour merged from 24 files to 1 (1903071 rows, 8832 ms)
2026-11-08T11:55:01Z [load_day 2025-05-11] 2025-05-11: index committed in 11505 ms (24 + 1 + 24 files)
2026-11-08T11:55:01Z [load_day 2025-05-11] 2025-05-11: 4662120 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:55:01Z [load_day 2025-05-11] attempt 1 succeeded