orcaLog in

Runs · run 3670

load_day 2025-03-15, attempt 1 succeeded

Host
73ccef5e07c2:270701
Started
2026-11-08T10:51:28Z
Ended
2026-11-08T10:53:01Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
738 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
143.5 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3670/load_day/2025-03-15/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:51:28Z [load_day 2025-03-15] attempt 1 started
2026-11-08T10:51:28Z [load_day 2025-03-15] 2025-03-15: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:51:37Z [load_day 2025-03-15] 2025-03-15 hour 0: 212028 events in 0 files, snapshot none (task 7261 ms: download 4276 ms overlapping gunzip 1128 ms, parse 4736 ms, sort 0 ms, write 0 ms, index 655 ms: 13 candidates, 92394 repo-hours, 1186 releases; waiting 477 ms; commit 0 ms)
2026-11-08T10:51:37Z [load_day 2025-03-15] 2025-03-15 hour 1: 228873 events in 0 files, snapshot none (task 7704 ms: download 5000 ms overlapping gunzip 1084 ms, parse 5088 ms, sort 0 ms, write 0 ms, index 803 ms: 8 candidates, 113431 repo-hours, 888 releases; waiting 467 ms; commit 0 ms)
2026-11-08T10:51:45Z [load_day 2025-03-15] 2025-03-15 hour 2: 190206 events in 0 files, snapshot none (task 7578 ms: download 4813 ms overlapping gunzip 1222 ms, parse 4867 ms, sort 0 ms, write 0 ms, index 632 ms: 3 candidates, 73726 repo-hours, 792 releases; waiting 534 ms; commit 0 ms)
2026-11-08T10:51:45Z [load_day 2025-03-15] 2025-03-15 hour 3: 198028 events in 0 files, snapshot none (task 7204 ms: download 4050 ms overlapping gunzip 1043 ms, parse 4507 ms, sort 0 ms, write 0 ms, index 813 ms: 4 candidates, 71778 repo-hours, 3853 releases; waiting 528 ms; commit 0 ms)
2026-11-08T10:51:50Z [load_day 2025-03-15] 2025-03-15 hour 4: 178942 events in 0 files, snapshot none (task 4877 ms: download 2531 ms overlapping gunzip 645 ms, parse 2830 ms, sort 0 ms, write 0 ms, index 755 ms: 4 candidates, 59970 repo-hours, 716 releases; waiting 336 ms; commit 0 ms)
2026-11-08T10:51:50Z [load_day 2025-03-15] 2025-03-15 hour 5: 185068 events in 0 files, snapshot none (task 4890 ms: download 2636 ms overlapping gunzip 708 ms, parse 2931 ms, sort 0 ms, write 0 ms, index 501 ms: 7 candidates, 61798 repo-hours, 766 releases; waiting 490 ms; commit 0 ms)
2026-11-08T10:51:58Z [load_day 2025-03-15] 2025-03-15 hour 6: 207789 events in 0 files, snapshot none (task 7260 ms: download 4536 ms overlapping gunzip 1097 ms, parse 4775 ms, sort 0 ms, write 0 ms, index 652 ms: 11 candidates, 81215 repo-hours, 1044 releases; waiting 468 ms; commit 0 ms)
2026-11-08T10:51:58Z [load_day 2025-03-15] 2025-03-15 hour 7: 190895 events in 0 files, snapshot none (task 6389 ms: download 3314 ms overlapping gunzip 882 ms, parse 4095 ms, sort 0 ms, write 0 ms, index 557 ms: 7 candidates, 65629 repo-hours, 1004 releases; waiting 511 ms; commit 0 ms)
2026-11-08T10:52:06Z [load_day 2025-03-15] 2025-03-15 hour 8: 196089 events in 0 files, snapshot none (task 7217 ms: download 4208 ms overlapping gunzip 1080 ms, parse 4691 ms, sort 0 ms, write 0 ms, index 697 ms: 3 candidates, 71000 repo-hours, 904 releases; waiting 473 ms; commit 0 ms)
2026-11-08T10:52:06Z [load_day 2025-03-15] 2025-03-15 hour 9: 209458 events in 0 files, snapshot none (task 7099 ms: download 4206 ms overlapping gunzip 1026 ms, parse 4605 ms, sort 0 ms, write 0 ms, index 636 ms: 6 candidates, 80048 repo-hours, 1093 releases; waiting 500 ms; commit 0 ms)
2026-11-08T10:52:12Z [load_day 2025-03-15] 2025-03-15 hour 10: 210152 events in 0 files, snapshot none (task 5337 ms: download 2617 ms overlapping gunzip 853 ms, parse 3712 ms, sort 0 ms, write 0 ms, index 555 ms: 5 candidates, 76832 repo-hours, 959 releases; waiting 18 ms; commit 0 ms)
2026-11-08T10:52:12Z [load_day 2025-03-15] 2025-03-15 hour 11: 205603 events in 0 files, snapshot none (task 4910 ms: download 2278 ms overlapping gunzip 750 ms, parse 3229 ms, sort 0 ms, write 0 ms, index 683 ms: 12 candidates, 72022 repo-hours, 759 releases; waiting 18 ms; commit 0 ms)
2026-11-08T10:52:18Z [load_day 2025-03-15] 2025-03-15 hour 12: 265409 events in 0 files, snapshot none (task 6016 ms: download 3208 ms overlapping gunzip 891 ms, parse 4035 ms, sort 0 ms, write 0 ms, index 858 ms: 13 candidates, 124116 repo-hours, 1028 releases; waiting 9 ms; commit 0 ms)
2026-11-08T10:52:18Z [load_day 2025-03-15] 2025-03-15 hour 13: 233401 events in 0 files, snapshot none (task 5884 ms: download 3365 ms overlapping gunzip 901 ms, parse 4002 ms, sort 0 ms, write 0 ms, index 751 ms: 8 candidates, 102783 repo-hours, 873 releases; waiting 19 ms; commit 0 ms)
2026-11-08T10:52:24Z [load_day 2025-03-15] 2025-03-15 hour 14: 227376 events in 0 files, snapshot none (task 5468 ms: download 2946 ms overlapping gunzip 866 ms, parse 3738 ms, sort 0 ms, write 0 ms, index 647 ms: 4 candidates, 87212 repo-hours, 992 releases; waiting 23 ms; commit 0 ms)
2026-11-08T10:52:24Z [load_day 2025-03-15] 2025-03-15 hour 15: 234437 events in 0 files, snapshot none (task 5754 ms: download 3237 ms overlapping gunzip 878 ms, parse 3980 ms, sort 0 ms, write 0 ms, index 680 ms: 2 candidates, 95567 repo-hours, 1269 releases; waiting 19 ms; commit 0 ms)
2026-11-08T10:52:30Z [load_day 2025-03-15] 2025-03-15 hour 16: 227934 events in 0 files, snapshot none (task 5198 ms: download 2701 ms overlapping gunzip 800 ms, parse 3498 ms, sort 0 ms, write 0 ms, index 656 ms: 4 candidates, 86748 repo-hours, 1036 releases; waiting 22 ms; commit 0 ms)
2026-11-08T10:52:31Z [load_day 2025-03-15] 2025-03-15 hour 17: 227393 events in 0 files, snapshot none (task 5669 ms: download 3204 ms overlapping gunzip 805 ms, parse 3415 ms, sort 0 ms, write 0 ms, index 615 ms: 5 candidates, 83436 repo-hours, 846 releases; waiting 528 ms; commit 0 ms)
2026-11-08T10:52:37Z [load_day 2025-03-15] 2025-03-15 hour 18: 234073 events in 0 files, snapshot none (task 6554 ms: download 3010 ms overlapping gunzip 1030 ms, parse 4508 ms, sort 0 ms, write 0 ms, index 795 ms: 8 candidates, 96508 repo-hours, 1108 releases; waiting 22 ms; commit 0 ms)
2026-11-08T10:52:37Z [load_day 2025-03-15] 2025-03-15 hour 19: 208813 events in 0 files, snapshot none (task 6439 ms: download 2864 ms overlapping gunzip 1015 ms, parse 4623 ms, sort 0 ms, write 0 ms, index 590 ms: 11 candidates, 71021 repo-hours, 908 releases; waiting 14 ms; commit 0 ms)
2026-11-08T10:52:43Z [load_day 2025-03-15] 2025-03-15 hour 20: 204444 events in 0 files, snapshot none (task 5941 ms: download 2131 ms overlapping gunzip 857 ms, parse 4126 ms, sort 0 ms, write 0 ms, index 748 ms: 6 candidates, 71016 repo-hours, 788 releases; waiting 17 ms; commit 0 ms)
2026-11-08T10:52:44Z [load_day 2025-03-15] 2025-03-15 hour 21: 200750 events in 0 files, snapshot none (task 5801 ms: download 2863 ms overlapping gunzip 914 ms, parse 4141 ms, sort 0 ms, write 0 ms, index 539 ms: 10 candidates, 71866 repo-hours, 986 releases; waiting 11 ms; commit 0 ms)
2026-11-08T10:52:50Z [load_day 2025-03-15] 2025-03-15 hour 22: 181029 events in 0 files, snapshot none (task 5835 ms: download 2783 ms overlapping gunzip 876 ms, parse 4047 ms, sort 0 ms, write 0 ms, index 441 ms: 3 candidates, 62346 repo-hours, 1069 releases; waiting 193 ms; commit 0 ms)
2026-11-08T10:52:50Z [load_day 2025-03-15] 2025-03-15 hour 23: 171456 events in 0 files, snapshot none (task 5089 ms: download 1650 ms overlapping gunzip 788 ms, parse 3572 ms, sort 0 ms, write 0 ms, index 544 ms: 6 candidates, 57134 repo-hours, 1093 releases; waiting 16 ms; commit 0 ms)
2026-11-08T10:52:58Z [load_day 2025-03-15] 2025-03-15: repo_hour merged from 24 files to 1 (1929596 rows, 8333 ms)
2026-11-08T10:53:01Z [load_day 2025-03-15] 2025-03-15: index committed in 11198 ms (24 + 1 + 24 files)
2026-11-08T10:53:01Z [load_day 2025-03-15] 2025-03-15: 5029646 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:53:01Z [load_day 2025-03-15] attempt 1 succeeded