orcaLog in

Runs · run 3278

load_day 2024-12-05, attempt 1 succeeded

Host
73ccef5e07c2:217107
Started
2026-11-08T09:13:06Z
Ended
2026-11-08T09:15:16Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
752 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
199.5 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3278/load_day/2024-12-05/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:13:06Z [load_day 2024-12-05] attempt 1 started
2026-11-08T09:13:07Z [load_day 2024-12-05] 2024-12-05: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:13:15Z [load_day 2024-12-05] 2024-12-05 hour 0: 196698 events in 0 files, snapshot none (task 7147 ms: download 4495 ms overlapping gunzip 1161 ms, parse 4699 ms, sort 0 ms, write 0 ms, index 651 ms: 7 candidates, 92417 repo-hours, 1161 releases; waiting 271 ms; commit 0 ms)
2026-11-08T09:13:15Z [load_day 2024-12-05] 2024-12-05 hour 1: 214991 events in 0 files, snapshot none (task 7386 ms: download 4572 ms overlapping gunzip 1041 ms, parse 4756 ms, sort 0 ms, write 0 ms, index 784 ms: 6 candidates, 117326 repo-hours, 823 releases; waiting 476 ms; commit 0 ms)
2026-11-08T09:13:24Z [load_day 2024-12-05] 2024-12-05 hour 2: 184476 events in 0 files, snapshot none (task 8479 ms: download 5434 ms overlapping gunzip 1291 ms, parse 5473 ms, sort 0 ms, write 0 ms, index 930 ms: 8 candidates, 80875 repo-hours, 827 releases; waiting 459 ms; commit 0 ms)
2026-11-08T09:13:25Z [load_day 2024-12-05] 2024-12-05 hour 3: 199528 events in 0 files, snapshot none (task 8533 ms: download 4637 ms overlapping gunzip 1268 ms, parse 5570 ms, sort 0 ms, write 0 ms, index 1018 ms: 4 candidates, 84220 repo-hours, 4111 releases; waiting 357 ms; commit 0 ms)
2026-11-08T09:13:33Z [load_day 2024-12-05] 2024-12-05 hour 4: 178575 events in 0 files, snapshot none (task 8572 ms: download 4316 ms overlapping gunzip 1317 ms, parse 5653 ms, sort 0 ms, write 0 ms, index 965 ms: 3 candidates, 69588 repo-hours, 753 releases; waiting 316 ms; commit 0 ms)
2026-11-08T09:13:34Z [load_day 2024-12-05] 2024-12-05 hour 5: 189955 events in 0 files, snapshot none (task 8799 ms: download 4656 ms overlapping gunzip 1367 ms, parse 5822 ms, sort 0 ms, write 0 ms, index 784 ms: 4 candidates, 75109 repo-hours, 754 releases; waiting 568 ms; commit 0 ms)
2026-11-08T09:13:42Z [load_day 2024-12-05] 2024-12-05 hour 6: 212461 events in 0 files, snapshot none (task 8029 ms: download 4997 ms overlapping gunzip 1182 ms, parse 4895 ms, sort 0 ms, write 0 ms, index 1057 ms: 4 candidates, 97530 repo-hours, 1039 releases; waiting 524 ms; commit 0 ms)
2026-11-08T09:13:42Z [load_day 2024-12-05] 2024-12-05 hour 7: 206981 events in 0 files, snapshot none (task 7786 ms: download 4869 ms overlapping gunzip 1160 ms, parse 4849 ms, sort 0 ms, write 0 ms, index 953 ms: 6 candidates, 84661 repo-hours, 968 releases; waiting 480 ms; commit 0 ms)
2026-11-08T09:13:52Z [load_day 2024-12-05] 2024-12-05 hour 8: 222573 events in 0 files, snapshot none (task 9737 ms: download 6791 ms overlapping gunzip 1455 ms, parse 6428 ms, sort 0 ms, write 0 ms, index 955 ms: 4 candidates, 95418 repo-hours, 1138 releases; waiting 532 ms; commit 0 ms)
2026-11-08T09:13:54Z [load_day 2024-12-05] 2024-12-05 hour 9: 238885 events in 0 files, snapshot none (task 10707 ms: download 7050 ms overlapping gunzip 1670 ms, parse 7146 ms, sort 0 ms, write 0 ms, index 1056 ms: 4 candidates, 104485 repo-hours, 1610 releases; waiting 522 ms; commit 0 ms)
2026-11-08T09:14:02Z [load_day 2024-12-05] 2024-12-05 hour 10: 233412 events in 0 files, snapshot none (task 8976 ms: download 5906 ms overlapping gunzip 1329 ms, parse 5947 ms, sort 0 ms, write 0 ms, index 1049 ms: 7 candidates, 98327 repo-hours, 1689 releases; waiting 353 ms; commit 0 ms)
2026-11-08T09:14:04Z [load_day 2024-12-05] 2024-12-05 hour 11: 228518 events in 0 files, snapshot none (task 9811 ms: download 6101 ms overlapping gunzip 1427 ms, parse 5888 ms, sort 0 ms, write 0 ms, index 1148 ms: 8 candidates, 93006 repo-hours, 1236 releases; waiting 1034 ms; commit 0 ms)
2026-11-08T09:14:11Z [load_day 2024-12-05] 2024-12-05 hour 12: 266085 events in 0 files, snapshot none (task 8294 ms: download 5245 ms overlapping gunzip 1209 ms, parse 5204 ms, sort 0 ms, write 0 ms, index 999 ms: 9 candidates, 136436 repo-hours, 1491 releases; waiting 504 ms; commit 0 ms)
2026-11-08T09:14:13Z [load_day 2024-12-05] 2024-12-05 hour 13: 255763 events in 0 files, snapshot none (task 8196 ms: download 5367 ms overlapping gunzip 1241 ms, parse 5257 ms, sort 0 ms, write 0 ms, index 918 ms: 5 candidates, 121162 repo-hours, 1301 releases; waiting 464 ms; commit 0 ms)
2026-11-08T09:14:19Z [load_day 2024-12-05] 2024-12-05 hour 14: 242969 events in 0 files, snapshot none (task 8385 ms: download 5746 ms overlapping gunzip 1345 ms, parse 5579 ms, sort 0 ms, write 0 ms, index 765 ms: 9 candidates, 104570 repo-hours, 1488 releases; waiting 391 ms; commit 0 ms)
2026-11-08T09:14:22Z [load_day 2024-12-05] 2024-12-05 hour 15: 257971 events in 0 files, snapshot none (task 8598 ms: download 5785 ms overlapping gunzip 1316 ms, parse 5587 ms, sort 0 ms, write 0 ms, index 901 ms: 3 candidates, 113970 repo-hours, 1672 releases; waiting 482 ms; commit 0 ms)
2026-11-08T09:14:32Z [load_day 2024-12-05] 2024-12-05 hour 16: 246317 events in 0 files, snapshot none (task 12436 ms: download 8521 ms overlapping gunzip 2025 ms, parse 8539 ms, sort 0 ms, write 0 ms, index 1159 ms: 9 candidates, 106167 repo-hours, 1334 releases; waiting 449 ms; commit 0 ms)
2026-11-08T09:14:35Z [load_day 2024-12-05] 2024-12-05 hour 17: 241309 events in 0 files, snapshot none (task 12338 ms: download 9195 ms overlapping gunzip 1913 ms, parse 8388 ms, sort 0 ms, write 0 ms, index 1192 ms: 5 candidates, 97384 repo-hours, 1088 releases; waiting 536 ms; commit 0 ms)
2026-11-08T09:14:43Z [load_day 2024-12-05] 2024-12-05 hour 18: 247844 events in 0 files, snapshot none (task 9972 ms: download 7093 ms overlapping gunzip 1568 ms, parse 6817 ms, sort 0 ms, write 0 ms, index 891 ms: 8 candidates, 106515 repo-hours, 1250 releases; waiting 473 ms; commit 0 ms)
2026-11-08T09:14:45Z [load_day 2024-12-05] 2024-12-05 hour 19: 223193 events in 0 files, snapshot none (task 9230 ms: download 6192 ms overlapping gunzip 1445 ms, parse 6086 ms, sort 0 ms, write 0 ms, index 831 ms: 9 candidates, 86328 repo-hours, 1090 releases; waiting 507 ms; commit 0 ms)
2026-11-08T09:14:52Z [load_day 2024-12-05] 2024-12-05 hour 20: 223343 events in 0 files, snapshot none (task 8880 ms: download 5675 ms overlapping gunzip 1385 ms, parse 5692 ms, sort 0 ms, write 0 ms, index 994 ms: 6 candidates, 86117 repo-hours, 1077 releases; waiting 537 ms; commit 0 ms)
2026-11-08T09:14:54Z [load_day 2024-12-05] 2024-12-05 hour 21: 215343 events in 0 files, snapshot none (task 9115 ms: download 5494 ms overlapping gunzip 1330 ms, parse 5827 ms, sort 0 ms, write 0 ms, index 1113 ms: 11 candidates, 85585 repo-hours, 1239 releases; waiting 489 ms; commit 0 ms)
2026-11-08T09:15:00Z [load_day 2024-12-05] 2024-12-05 hour 22: 200295 events in 0 files, snapshot none (task 7408 ms: download 4795 ms overlapping gunzip 1117 ms, parse 4843 ms, sort 0 ms, write 0 ms, index 682 ms: 4 candidates, 76688 repo-hours, 1160 releases; waiting 511 ms; commit 0 ms)
2026-11-08T09:15:02Z [load_day 2024-12-05] 2024-12-05 hour 23: 196283 events in 0 files, snapshot none (task 7621 ms: download 4819 ms overlapping gunzip 1173 ms, parse 4810 ms, sort 0 ms, write 0 ms, index 727 ms: 3 candidates, 77749 repo-hours, 878 releases; waiting 480 ms; commit 0 ms)
2026-11-08T09:15:13Z [load_day 2024-12-05] 2024-12-05: repo_hour merged from 24 files to 1 (2291633 rows, 10558 ms)
2026-11-08T09:15:15Z [load_day 2024-12-05] 2024-12-05: index committed in 13312 ms (24 + 1 + 24 files)
2026-11-08T09:15:15Z [load_day 2024-12-05] 2024-12-05: 5323768 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:15:15Z [load_day 2024-12-05] attempt 1 succeeded