orcaLog in

Runs · run 3681

load_day 2025-03-18, attempt 1 succeeded

Host
73ccef5e07c2:272246
Started
2026-11-08T10:54:08Z
Ended
2026-11-08T10:56:26Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
931 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
215.4 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3681/load_day/2025-03-18/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:54:08Z [load_day 2025-03-18] attempt 1 started
2026-11-08T10:54:08Z [load_day 2025-03-18] 2025-03-18: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:54:17Z [load_day 2025-03-18] 2025-03-18 hour 0: 213074 events in 0 files, snapshot none (task 7667 ms: download 5051 ms overlapping gunzip 1221 ms, parse 4997 ms, sort 0 ms, write 0 ms, index 708 ms: 8 candidates, 100002 repo-hours, 1412 releases; waiting 487 ms; commit 0 ms)
2026-11-08T10:54:17Z [load_day 2025-03-18] 2025-03-18 hour 1: 239696 events in 0 files, snapshot none (task 8266 ms: download 4504 ms overlapping gunzip 1141 ms, parse 4800 ms, sort 0 ms, write 0 ms, index 1894 ms: 6 candidates, 126803 repo-hours, 1096 releases; waiting 207 ms; commit 0 ms)
2026-11-08T10:54:26Z [load_day 2025-03-18] 2025-03-18 hour 2: 210421 events in 0 files, snapshot none (task 8416 ms: download 5341 ms overlapping gunzip 1284 ms, parse 5526 ms, sort 0 ms, write 0 ms, index 920 ms: 8 candidates, 91412 repo-hours, 1079 releases; waiting 345 ms; commit 0 ms)
2026-11-08T10:54:27Z [load_day 2025-03-18] 2025-03-18 hour 3: 221720 events in 0 files, snapshot none (task 9067 ms: download 5798 ms overlapping gunzip 1445 ms, parse 6164 ms, sort 0 ms, write 0 ms, index 690 ms: 2 candidates, 93224 repo-hours, 3928 releases; waiting 477 ms; commit 0 ms)
2026-11-08T10:54:36Z [load_day 2025-03-18] 2025-03-18 hour 4: 201813 events in 0 files, snapshot none (task 8906 ms: download 4424 ms overlapping gunzip 1354 ms, parse 5488 ms, sort 0 ms, write 0 ms, index 1315 ms: 4 candidates, 76645 repo-hours, 900 releases; waiting 476 ms; commit 0 ms)
2026-11-08T10:54:37Z [load_day 2025-03-18] 2025-03-18 hour 5: 211141 events in 0 files, snapshot none (task 9789 ms: download 5678 ms overlapping gunzip 1491 ms, parse 6584 ms, sort 0 ms, write 0 ms, index 913 ms: 6 candidates, 81803 repo-hours, 862 releases; waiting 497 ms; commit 0 ms)
2026-11-08T10:54:45Z [load_day 2025-03-18] 2025-03-18 hour 6: 238533 events in 0 files, snapshot none (task 8758 ms: download 5245 ms overlapping gunzip 1345 ms, parse 5641 ms, sort 0 ms, write 0 ms, index 1181 ms: 7 candidates, 104596 repo-hours, 1118 releases; waiting 233 ms; commit 0 ms)
2026-11-08T10:54:50Z [load_day 2025-03-18] 2025-03-18 hour 7: 239734 events in 0 files, snapshot none (task 12483 ms: download 9215 ms overlapping gunzip 1493 ms, parse 6515 ms, sort 0 ms, write 0 ms, index 868 ms: 2 candidates, 95349 repo-hours, 1017 releases; waiting 3276 ms; commit 0 ms)
2026-11-08T10:54:54Z [load_day 2025-03-18] 2025-03-18 hour 8: 254198 events in 0 files, snapshot none (task 8316 ms: download 5710 ms overlapping gunzip 1381 ms, parse 5657 ms, sort 0 ms, write 0 ms, index 807 ms: 6 candidates, 105274 repo-hours, 1218 releases; waiting 242 ms; commit 0 ms)
2026-11-08T10:55:04Z [load_day 2025-03-18] 2025-03-18 hour 9: 268353 events in 0 files, snapshot none (task 13225 ms: download 10622 ms overlapping gunzip 1555 ms, parse 6568 ms, sort 0 ms, write 0 ms, index 816 ms: 10 candidates, 115582 repo-hours, 1480 releases; waiting 4051 ms; commit 0 ms)
2026-11-08T10:55:04Z [load_day 2025-03-18] 2025-03-18 hour 10: 264349 events in 0 files, snapshot none (task 9499 ms: download 6951 ms overlapping gunzip 1500 ms, parse 6446 ms, sort 0 ms, write 0 ms, index 790 ms: 5 candidates, 110424 repo-hours, 1417 releases; waiting 536 ms; commit 0 ms)
2026-11-08T10:55:13Z [load_day 2025-03-18] 2025-03-18 hour 11: 262813 events in 0 files, snapshot none (task 7708 ms: download 5131 ms overlapping gunzip 1195 ms, parse 5045 ms, sort 0 ms, write 0 ms, index 737 ms: 10 candidates, 104464 repo-hours, 1202 releases; waiting 502 ms; commit 0 ms)
2026-11-08T10:55:14Z [load_day 2025-03-18] 2025-03-18 hour 12: 286591 events in 0 files, snapshot none (task 8733 ms: download 5850 ms overlapping gunzip 1265 ms, parse 5314 ms, sort 0 ms, write 0 ms, index 1029 ms: 6 candidates, 144376 repo-hours, 1548 releases; waiting 898 ms; commit 0 ms)
2026-11-08T10:55:22Z [load_day 2025-03-18] 2025-03-18 hour 13: 283709 events in 0 files, snapshot none (task 9161 ms: download 6115 ms overlapping gunzip 1407 ms, parse 5968 ms, sort 0 ms, write 0 ms, index 1039 ms: 6 candidates, 133576 repo-hours, 1569 releases; waiting 488 ms; commit 0 ms)
2026-11-08T10:55:24Z [load_day 2025-03-18] 2025-03-18 hour 14: 283459 events in 0 files, snapshot none (task 10079 ms: download 7109 ms overlapping gunzip 1560 ms, parse 6625 ms, sort 0 ms, write 0 ms, index 1191 ms: 10 candidates, 122034 repo-hours, 1576 releases; waiting 491 ms; commit 0 ms)
2026-11-08T10:55:36Z [load_day 2025-03-18] 2025-03-18 hour 15: 287173 events in 0 files, snapshot none (task 13403 ms: download 9629 ms overlapping gunzip 2288 ms, parse 9399 ms, sort 0 ms, write 0 ms, index 951 ms: 11 candidates, 127890 repo-hours, 1489 releases; waiting 459 ms; commit 0 ms)
2026-11-08T10:55:38Z [load_day 2025-03-18] 2025-03-18 hour 16: 267145 events in 0 files, snapshot none (task 13419 ms: download 10339 ms overlapping gunzip 2229 ms, parse 9096 ms, sort 0 ms, write 0 ms, index 1200 ms: 6 candidates, 114993 repo-hours, 1529 releases; waiting 558 ms; commit 0 ms)
2026-11-08T10:55:46Z [load_day 2025-03-18] 2025-03-18 hour 17: 273341 events in 0 files, snapshot none (task 9462 ms: download 6691 ms overlapping gunzip 1495 ms, parse 6573 ms, sort 0 ms, write 0 ms, index 765 ms: 11 candidates, 110519 repo-hours, 1267 releases; waiting 277 ms; commit 0 ms)
2026-11-08T10:55:47Z [load_day 2025-03-18] 2025-03-18 hour 18: 269954 events in 0 files, snapshot none (task 8584 ms: download 5731 ms overlapping gunzip 1368 ms, parse 5702 ms, sort 0 ms, write 0 ms, index 977 ms: 8 candidates, 119224 repo-hours, 1517 releases; waiting 208 ms; commit 0 ms)
2026-11-08T10:55:55Z [load_day 2025-03-18] 2025-03-18 hour 19: 253248 events in 0 files, snapshot none (task 8281 ms: download 5767 ms overlapping gunzip 1236 ms, parse 5392 ms, sort 0 ms, write 0 ms, index 752 ms: 9 candidates, 97740 repo-hours, 1215 releases; waiting 674 ms; commit 0 ms)
2026-11-08T10:55:56Z [load_day 2025-03-18] 2025-03-18 hour 20: 242584 events in 0 files, snapshot none (task 7780 ms: download 5265 ms overlapping gunzip 1224 ms, parse 5043 ms, sort 0 ms, write 0 ms, index 657 ms: 7 candidates, 97285 repo-hours, 1157 releases; waiting 511 ms; commit 0 ms)
2026-11-08T10:56:04Z [load_day 2025-03-18] 2025-03-18 hour 21: 231588 events in 0 files, snapshot none (task 8335 ms: download 5145 ms overlapping gunzip 1183 ms, parse 5049 ms, sort 0 ms, write 0 ms, index 1169 ms: 9 candidates, 91492 repo-hours, 1213 releases; waiting 703 ms; commit 0 ms)
2026-11-08T10:56:04Z [load_day 2025-03-18] 2025-03-18 hour 22: 217036 events in 0 files, snapshot none (task 7507 ms: download 4251 ms overlapping gunzip 1110 ms, parse 4733 ms, sort 0 ms, write 0 ms, index 941 ms: 9 candidates, 82800 repo-hours, 1247 releases; waiting 513 ms; commit 0 ms)
2026-11-08T10:56:11Z [load_day 2025-03-18] 2025-03-18 hour 23: 204063 events in 0 files, snapshot none (task 6479 ms: download 3844 ms overlapping gunzip 919 ms, parse 4152 ms, sort 0 ms, write 0 ms, index 676 ms: 8 candidates, 76701 repo-hours, 1312 releases; waiting 509 ms; commit 0 ms)
2026-11-08T10:56:23Z [load_day 2025-03-18] 2025-03-18: repo_hour merged from 24 files to 1 (2524208 rows, 11955 ms)
2026-11-08T10:56:26Z [load_day 2025-03-18] 2025-03-18: index committed in 15023 ms (24 + 1 + 24 files)
2026-11-08T10:56:26Z [load_day 2025-03-18] 2025-03-18: 5925736 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:56:26Z [load_day 2025-03-18] attempt 1 succeeded