orcaLog in

Runs · run 3466

load_day 2025-01-22, attempt 1 succeeded

Host
73ccef5e07c2:241987
Started
2026-11-08T09:56:44Z
Ended
2026-11-08T09:58:53Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
806 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
200.7 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3466/load_day/2025-01-22/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:56:44Z [load_day 2025-01-22] attempt 1 started
2026-11-08T09:56:45Z [load_day 2025-01-22] 2025-01-22: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:56:57Z [load_day 2025-01-22] 2025-01-22 hour 0: 206868 events in 0 files, snapshot none (task 11493 ms: download 8611 ms overlapping gunzip 1305 ms, parse 5484 ms, sort 0 ms, write 0 ms, index 813 ms: 5 candidates, 96243 repo-hours, 1312 releases; waiting 3629 ms; commit 0 ms)
2026-11-08T09:56:57Z [load_day 2025-01-22] 2025-01-22 hour 1: 217908 events in 0 files, snapshot none (task 8005 ms: download 3953 ms overlapping gunzip 1123 ms, parse 4736 ms, sort 0 ms, write 0 ms, index 1300 ms: 7 candidates, 112869 repo-hours, 958 releases; waiting 503 ms; commit 0 ms)
2026-11-08T09:57:05Z [load_day 2025-01-22] 2025-01-22 hour 2: 197433 events in 0 files, snapshot none (task 7312 ms: download 4211 ms overlapping gunzip 1222 ms, parse 4754 ms, sort 0 ms, write 0 ms, index 684 ms: 8 candidates, 82242 repo-hours, 1054 releases; waiting 377 ms; commit 0 ms)
2026-11-08T09:57:06Z [load_day 2025-01-22] 2025-01-22 hour 3: 204755 events in 0 files, snapshot none (task 7830 ms: download 4687 ms overlapping gunzip 1229 ms, parse 5031 ms, sort 0 ms, write 0 ms, index 770 ms: 5 candidates, 79804 repo-hours, 4021 releases; waiting 504 ms; commit 0 ms)
2026-11-08T09:57:13Z [load_day 2025-01-22] 2025-01-22 hour 4: 192460 events in 0 files, snapshot none (task 7574 ms: download 4306 ms overlapping gunzip 1156 ms, parse 4616 ms, sort 0 ms, write 0 ms, index 1068 ms: 3 candidates, 70878 repo-hours, 759 releases; waiting 512 ms; commit 0 ms)
2026-11-08T09:57:14Z [load_day 2025-01-22] 2025-01-22 hour 5: 203387 events in 0 files, snapshot none (task 7583 ms: download 4377 ms overlapping gunzip 1216 ms, parse 4791 ms, sort 0 ms, write 0 ms, index 772 ms: 8 candidates, 75388 repo-hours, 803 releases; waiting 510 ms; commit 0 ms)
2026-11-08T09:57:21Z [load_day 2025-01-22] 2025-01-22 hour 6: 224804 events in 0 files, snapshot none (task 7730 ms: download 5239 ms overlapping gunzip 1244 ms, parse 4967 ms, sort 0 ms, write 0 ms, index 766 ms: 6 candidates, 98869 repo-hours, 854 releases; waiting 506 ms; commit 0 ms)
2026-11-08T09:57:22Z [load_day 2025-01-22] 2025-01-22 hour 7: 218692 events in 0 files, snapshot none (task 7637 ms: download 5139 ms overlapping gunzip 1163 ms, parse 5013 ms, sort 0 ms, write 0 ms, index 629 ms: 4 candidates, 84841 repo-hours, 945 releases; waiting 483 ms; commit 0 ms)
2026-11-08T09:57:29Z [load_day 2025-01-22] 2025-01-22 hour 8: 231065 events in 0 files, snapshot none (task 7642 ms: download 4922 ms overlapping gunzip 1160 ms, parse 4841 ms, sort 0 ms, write 0 ms, index 696 ms: 8 candidates, 93161 repo-hours, 1036 releases; waiting 667 ms; commit 0 ms)
2026-11-08T09:57:30Z [load_day 2025-01-22] 2025-01-22 hour 9: 249465 events in 0 files, snapshot none (task 7935 ms: download 5339 ms overlapping gunzip 1265 ms, parse 5166 ms, sort 0 ms, write 0 ms, index 746 ms: 9 candidates, 103037 repo-hours, 1333 releases; waiting 457 ms; commit 0 ms)
2026-11-08T09:57:39Z [load_day 2025-01-22] 2025-01-22 hour 10: 237346 events in 0 files, snapshot none (task 9456 ms: download 5990 ms overlapping gunzip 1451 ms, parse 6134 ms, sort 0 ms, write 0 ms, index 910 ms: 12 candidates, 97028 repo-hours, 1287 releases; waiting 526 ms; commit 0 ms)
2026-11-08T09:57:40Z [load_day 2025-01-22] 2025-01-22 hour 11: 233287 events in 0 files, snapshot none (task 9072 ms: download 5922 ms overlapping gunzip 1374 ms, parse 6290 ms, sort 0 ms, write 0 ms, index 816 ms: 4 candidates, 90727 repo-hours, 1226 releases; waiting 330 ms; commit 0 ms)
2026-11-08T09:57:49Z [load_day 2025-01-22] 2025-01-22 hour 12: 276591 events in 0 files, snapshot none (task 9882 ms: download 6291 ms overlapping gunzip 1483 ms, parse 6569 ms, sort 0 ms, write 0 ms, index 1102 ms: 4 candidates, 135800 repo-hours, 1238 releases; waiting 499 ms; commit 0 ms)
2026-11-08T09:57:50Z [load_day 2025-01-22] 2025-01-22 hour 13: 265870 events in 0 files, snapshot none (task 10295 ms: download 7533 ms overlapping gunzip 1579 ms, parse 6970 ms, sort 0 ms, write 0 ms, index 841 ms: 5 candidates, 118954 repo-hours, 1195 releases; waiting 619 ms; commit 0 ms)
2026-11-08T09:58:01Z [load_day 2025-01-22] 2025-01-22 hour 14: 254157 events in 0 files, snapshot none (task 11144 ms: download 7970 ms overlapping gunzip 1685 ms, parse 7511 ms, sort 0 ms, write 0 ms, index 1216 ms: 10 candidates, 106065 repo-hours, 1442 releases; waiting 477 ms; commit 0 ms)
2026-11-08T09:58:03Z [load_day 2025-01-22] 2025-01-22 hour 15: 261107 events in 0 files, snapshot none (task 11493 ms: download 8120 ms overlapping gunzip 1967 ms, parse 7865 ms, sort 0 ms, write 0 ms, index 907 ms: 5 candidates, 114682 repo-hours, 1505 releases; waiting 471 ms; commit 0 ms)
2026-11-08T09:58:12Z [load_day 2025-01-22] 2025-01-22 hour 16: 252780 events in 0 files, snapshot none (task 9997 ms: download 6831 ms overlapping gunzip 1586 ms, parse 6731 ms, sort 0 ms, write 0 ms, index 911 ms: 11 candidates, 106943 repo-hours, 1316 releases; waiting 528 ms; commit 0 ms)
2026-11-08T09:58:12Z [load_day 2025-01-22] 2025-01-22 hour 17: 250510 events in 0 files, snapshot none (task 9015 ms: download 5950 ms overlapping gunzip 1459 ms, parse 6129 ms, sort 0 ms, write 0 ms, index 770 ms: 8 candidates, 100589 repo-hours, 1275 releases; waiting 353 ms; commit 0 ms)
2026-11-08T09:58:22Z [load_day 2025-01-22] 2025-01-22 hour 18: 249010 events in 0 files, snapshot none (task 9484 ms: download 6312 ms overlapping gunzip 1516 ms, parse 6326 ms, sort 0 ms, write 0 ms, index 878 ms: 9 candidates, 111674 repo-hours, 1327 releases; waiting 492 ms; commit 0 ms)
2026-11-08T09:58:22Z [load_day 2025-01-22] 2025-01-22 hour 19: 226152 events in 0 files, snapshot none (task 7875 ms: download 4926 ms overlapping gunzip 1210 ms, parse 5222 ms, sort 0 ms, write 0 ms, index 954 ms: 10 candidates, 88239 repo-hours, 1135 releases; waiting 224 ms; commit 0 ms)
2026-11-08T09:58:32Z [load_day 2025-01-22] 2025-01-22 hour 20: 222612 events in 0 files, snapshot none (task 9275 ms: download 5946 ms overlapping gunzip 1529 ms, parse 6324 ms, sort 0 ms, write 0 ms, index 833 ms: 7 candidates, 87287 repo-hours, 1130 releases; waiting 278 ms; commit 0 ms)
2026-11-08T09:58:32Z [load_day 2025-01-22] 2025-01-22 hour 21: 224000 events in 0 files, snapshot none (task 9524 ms: download 5605 ms overlapping gunzip 1529 ms, parse 6394 ms, sort 0 ms, write 0 ms, index 816 ms: 18 candidates, 87653 repo-hours, 1173 releases; waiting 479 ms; commit 0 ms)
2026-11-08T09:58:40Z [load_day 2025-01-22] 2025-01-22 hour 22: 199946 events in 0 files, snapshot none (task 7794 ms: download 4907 ms overlapping gunzip 1192 ms, parse 5261 ms, sort 0 ms, write 0 ms, index 589 ms: 11 candidates, 74938 repo-hours, 1588 releases; waiting 501 ms; commit 0 ms)
2026-11-08T09:58:40Z [load_day 2025-01-22] 2025-01-22 hour 23: 184694 events in 0 files, snapshot none (task 8027 ms: download 5179 ms overlapping gunzip 1236 ms, parse 5308 ms, sort 0 ms, write 0 ms, index 647 ms: 14 candidates, 68040 repo-hours, 1070 releases; waiting 498 ms; commit 0 ms)
2026-11-08T09:58:51Z [load_day 2025-01-22] 2025-01-22: repo_hour merged from 24 files to 1 (2285951 rows, 10178 ms)
2026-11-08T09:58:53Z [load_day 2025-01-22] 2025-01-22: index committed in 12767 ms (24 + 1 + 24 files)
2026-11-08T09:58:53Z [load_day 2025-01-22] 2025-01-22: 5484899 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:58:53Z [load_day 2025-01-22] attempt 1 succeeded