orcaLog in

Runs · run 3418

load_day 2025-01-10, attempt 1 succeeded

Host
73ccef5e07c2:235510
Started
2026-11-08T09:45:09Z
Ended
2026-11-08T09:47:09Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
730 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
192.4 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3418/load_day/2025-01-10/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:45:09Z [load_day 2025-01-10] attempt 1 started
2026-11-08T09:45:10Z [load_day 2025-01-10] 2025-01-10: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:45:18Z [load_day 2025-01-10] 2025-01-10 hour 0: 178906 events in 0 files, snapshot none (task 6756 ms: download 4204 ms overlapping gunzip 976 ms, parse 4169 ms, sort 0 ms, write 0 ms, index 611 ms: 7 candidates, 86435 repo-hours, 1215 releases; waiting 661 ms; commit 0 ms)
2026-11-08T09:45:18Z [load_day 2025-01-10] 2025-01-10 hour 1: 198477 events in 0 files, snapshot none (task 6979 ms: download 4196 ms overlapping gunzip 1034 ms, parse 4277 ms, sort 0 ms, write 0 ms, index 794 ms: 5 candidates, 109272 repo-hours, 928 releases; waiting 482 ms; commit 0 ms)
2026-11-08T09:45:26Z [load_day 2025-01-10] 2025-01-10 hour 2: 176674 events in 0 files, snapshot none (task 7679 ms: download 4969 ms overlapping gunzip 1200 ms, parse 5183 ms, sort 0 ms, write 0 ms, index 575 ms: 7 candidates, 79958 repo-hours, 993 releases; waiting 409 ms; commit 0 ms)
2026-11-08T09:45:26Z [load_day 2025-01-10] 2025-01-10 hour 3: 189609 events in 0 files, snapshot none (task 7682 ms: download 4722 ms overlapping gunzip 1254 ms, parse 5013 ms, sort 0 ms, write 0 ms, index 653 ms: 4 candidates, 76475 repo-hours, 3981 releases; waiting 491 ms; commit 0 ms)
2026-11-08T09:45:32Z [load_day 2025-01-10] 2025-01-10 hour 4: 178342 events in 0 files, snapshot none (task 5650 ms: download 2906 ms overlapping gunzip 928 ms, parse 3633 ms, sort 0 ms, write 0 ms, index 574 ms: 2 candidates, 63129 repo-hours, 752 releases; waiting 200 ms; commit 0 ms)
2026-11-08T09:45:33Z [load_day 2025-01-10] 2025-01-10 hour 5: 212454 events in 0 files, snapshot none (task 6754 ms: download 3688 ms overlapping gunzip 963 ms, parse 4426 ms, sort 0 ms, write 0 ms, index 743 ms: 6 candidates, 67030 repo-hours, 751 releases; waiting 340 ms; commit 0 ms)
2026-11-08T09:45:41Z [load_day 2025-01-10] 2025-01-10 hour 6: 251247 events in 0 files, snapshot none (task 8323 ms: download 4731 ms overlapping gunzip 1133 ms, parse 5192 ms, sort 0 ms, write 0 ms, index 1313 ms: 5 candidates, 88112 repo-hours, 967 releases; waiting 464 ms; commit 0 ms)
2026-11-08T09:45:41Z [load_day 2025-01-10] 2025-01-10 hour 7: 247378 events in 0 files, snapshot none (task 7792 ms: download 4507 ms overlapping gunzip 1210 ms, parse 4997 ms, sort 0 ms, write 0 ms, index 798 ms: 1 candidates, 77177 repo-hours, 1021 releases; waiting 465 ms; commit 0 ms)
2026-11-08T09:45:49Z [load_day 2025-01-10] 2025-01-10 hour 8: 260931 events in 0 files, snapshot none (task 7954 ms: download 5390 ms overlapping gunzip 1306 ms, parse 5101 ms, sort 0 ms, write 0 ms, index 608 ms: 6 candidates, 87533 repo-hours, 1087 releases; waiting 550 ms; commit 0 ms)
2026-11-08T09:45:50Z [load_day 2025-01-10] 2025-01-10 hour 9: 272175 events in 0 files, snapshot none (task 8210 ms: download 5723 ms overlapping gunzip 1282 ms, parse 5459 ms, sort 0 ms, write 0 ms, index 694 ms: 3 candidates, 95989 repo-hours, 1316 releases; waiting 529 ms; commit 0 ms)
2026-11-08T09:45:57Z [load_day 2025-01-10] 2025-01-10 hour 10: 260634 events in 0 files, snapshot none (task 7308 ms: download 4874 ms overlapping gunzip 1156 ms, parse 4749 ms, sort 0 ms, write 0 ms, index 625 ms: 3 candidates, 89956 repo-hours, 1303 releases; waiting 497 ms; commit 0 ms)
2026-11-08T09:45:58Z [load_day 2025-01-10] 2025-01-10 hour 11: 258284 events in 0 files, snapshot none (task 7450 ms: download 4904 ms overlapping gunzip 1170 ms, parse 4902 ms, sort 0 ms, write 0 ms, index 630 ms: 0 candidates, 83248 repo-hours, 1051 releases; waiting 471 ms; commit 0 ms)
2026-11-08T09:46:07Z [load_day 2025-01-10] 2025-01-10 hour 12: 289311 events in 0 files, snapshot none (task 9886 ms: download 7160 ms overlapping gunzip 1384 ms, parse 6694 ms, sort 0 ms, write 0 ms, index 820 ms: 8 candidates, 125141 repo-hours, 1146 releases; waiting 778 ms; commit 0 ms)
2026-11-08T09:46:08Z [load_day 2025-01-10] 2025-01-10 hour 13: 277821 events in 0 files, snapshot none (task 9354 ms: download 6829 ms overlapping gunzip 1499 ms, parse 6579 ms, sort 0 ms, write 0 ms, index 725 ms: 6 candidates, 107062 repo-hours, 1222 releases; waiting 296 ms; commit 0 ms)
2026-11-08T09:46:19Z [load_day 2025-01-10] 2025-01-10 hour 14: 275189 events in 0 files, snapshot none (task 11880 ms: download 7989 ms overlapping gunzip 1936 ms, parse 8255 ms, sort 0 ms, write 0 ms, index 968 ms: 1 candidates, 96591 repo-hours, 1326 releases; waiting 486 ms; commit 0 ms)
2026-11-08T09:46:21Z [load_day 2025-01-10] 2025-01-10 hour 15: 283402 events in 0 files, snapshot none (task 12498 ms: download 9193 ms overlapping gunzip 2067 ms, parse 8864 ms, sort 0 ms, write 0 ms, index 814 ms: 4 candidates, 103825 repo-hours, 1320 releases; waiting 483 ms; commit 0 ms)
2026-11-08T09:46:31Z [load_day 2025-01-10] 2025-01-10 hour 16: 267060 events in 0 files, snapshot none (task 10868 ms: download 7964 ms overlapping gunzip 1778 ms, parse 7167 ms, sort 0 ms, write 0 ms, index 1041 ms: 3 candidates, 95837 repo-hours, 1257 releases; waiting 567 ms; commit 0 ms)
2026-11-08T09:46:31Z [load_day 2025-01-10] 2025-01-10 hour 17: 246335 events in 0 files, snapshot none (task 9288 ms: download 6639 ms overlapping gunzip 1454 ms, parse 6314 ms, sort 0 ms, write 0 ms, index 737 ms: 3 candidates, 89397 repo-hours, 1218 releases; waiting 520 ms; commit 0 ms)
2026-11-08T09:46:41Z [load_day 2025-01-10] 2025-01-10 hour 18: 271230 events in 0 files, snapshot none (task 9196 ms: download 5926 ms overlapping gunzip 1430 ms, parse 6219 ms, sort 0 ms, write 0 ms, index 936 ms: 4 candidates, 98574 repo-hours, 1218 releases; waiting 333 ms; commit 0 ms)
2026-11-08T09:46:41Z [load_day 2025-01-10] 2025-01-10 hour 19: 244734 events in 0 files, snapshot none (task 8495 ms: download 5165 ms overlapping gunzip 1258 ms, parse 5471 ms, sort 0 ms, write 0 ms, index 1021 ms: 4 candidates, 75236 repo-hours, 977 releases; waiting 485 ms; commit 0 ms)
2026-11-08T09:46:49Z [load_day 2025-01-10] 2025-01-10 hour 20: 237911 events in 0 files, snapshot none (task 8056 ms: download 5017 ms overlapping gunzip 1306 ms, parse 5306 ms, sort 0 ms, write 0 ms, index 638 ms: 7 candidates, 74225 repo-hours, 1039 releases; waiting 521 ms; commit 0 ms)
2026-11-08T09:46:50Z [load_day 2025-01-10] 2025-01-10 hour 21: 240810 events in 0 files, snapshot none (task 8534 ms: download 5929 ms overlapping gunzip 1404 ms, parse 5787 ms, sort 0 ms, write 0 ms, index 607 ms: 7 candidates, 75814 repo-hours, 1167 releases; waiting 499 ms; commit 0 ms)
2026-11-08T09:46:58Z [load_day 2025-01-10] 2025-01-10 hour 22: 225855 events in 0 files, snapshot none (task 8403 ms: download 6019 ms overlapping gunzip 1182 ms, parse 5046 ms, sort 0 ms, write 0 ms, index 504 ms: 4 candidates, 66318 repo-hours, 1078 releases; waiting 1371 ms; commit 0 ms)
2026-11-08T09:46:58Z [load_day 2025-01-10] 2025-01-10 hour 23: 210933 events in 0 files, snapshot none (task 6944 ms: download 4264 ms overlapping gunzip 1046 ms, parse 4580 ms, sort 0 ms, write 0 ms, index 461 ms: 8 candidates, 58472 repo-hours, 946 releases; waiting 535 ms; commit 0 ms)
2026-11-08T09:47:06Z [load_day 2025-01-10] 2025-01-10: repo_hour merged from 24 files to 1 (2070806 rows, 8577 ms)
2026-11-08T09:47:09Z [load_day 2025-01-10] 2025-01-10: index committed in 11486 ms (23 + 1 + 24 files)
2026-11-08T09:47:09Z [load_day 2025-01-10] 2025-01-10: 5755702 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:47:09Z [load_day 2025-01-10] attempt 1 succeeded