orcaLog in

Runs · run 3442

load_day 2025-01-16, attempt 1 succeeded

Host
73ccef5e07c2:238727
Started
2026-11-08T09:50:50Z
Ended
2026-11-08T09:52:57Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
879 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
198.5 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3442/load_day/2025-01-16/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:50:50Z [load_day 2025-01-16] attempt 1 started
2026-11-08T09:50:50Z [load_day 2025-01-16] 2025-01-16: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:51:00Z [load_day 2025-01-16] 2025-01-16 hour 0: 201931 events in 0 files, snapshot none (task 9042 ms: download 5646 ms overlapping gunzip 1449 ms, parse 5821 ms, sort 0 ms, write 0 ms, index 931 ms: 6 candidates, 94492 repo-hours, 1270 releases; waiting 517 ms; commit 0 ms)
2026-11-08T09:51:01Z [load_day 2025-01-16] 2025-01-16 hour 1: 215061 events in 0 files, snapshot none (task 9462 ms: download 6351 ms overlapping gunzip 1375 ms, parse 6461 ms, sort 0 ms, write 0 ms, index 804 ms: 10 candidates, 113652 repo-hours, 916 releases; waiting 506 ms; commit 0 ms)
2026-11-08T09:51:08Z [load_day 2025-01-16] 2025-01-16 hour 2: 186233 events in 0 files, snapshot none (task 7189 ms: download 3814 ms overlapping gunzip 1025 ms, parse 4346 ms, sort 0 ms, write 0 ms, index 1049 ms: 6 candidates, 80515 repo-hours, 1057 releases; waiting 521 ms; commit 0 ms)
2026-11-08T09:51:08Z [load_day 2025-01-16] 2025-01-16 hour 3: 200562 events in 0 files, snapshot none (task 7485 ms: download 4331 ms overlapping gunzip 1084 ms, parse 4890 ms, sort 0 ms, write 0 ms, index 644 ms: 8 candidates, 77335 repo-hours, 3944 releases; waiting 554 ms; commit 0 ms)
2026-11-08T09:51:15Z [load_day 2025-01-16] 2025-01-16 hour 4: 184663 events in 0 files, snapshot none (task 6358 ms: download 3936 ms overlapping gunzip 900 ms, parse 4145 ms, sort 0 ms, write 0 ms, index 577 ms: 5 candidates, 66084 repo-hours, 692 releases; waiting 483 ms; commit 0 ms)
2026-11-08T09:51:15Z [load_day 2025-01-16] 2025-01-16 hour 5: 188160 events in 0 files, snapshot none (task 6672 ms: download 4048 ms overlapping gunzip 1009 ms, parse 4219 ms, sort 0 ms, write 0 ms, index 621 ms: 4 candidates, 71775 repo-hours, 884 releases; waiting 538 ms; commit 0 ms)
2026-11-08T09:51:23Z [load_day 2025-01-16] 2025-01-16 hour 6: 213467 events in 0 files, snapshot none (task 7970 ms: download 5201 ms overlapping gunzip 1300 ms, parse 5431 ms, sort 0 ms, write 0 ms, index 680 ms: 8 candidates, 94102 repo-hours, 968 releases; waiting 314 ms; commit 0 ms)
2026-11-08T09:51:24Z [load_day 2025-01-16] 2025-01-16 hour 7: 210298 events in 0 files, snapshot none (task 8085 ms: download 5516 ms overlapping gunzip 1305 ms, parse 5356 ms, sort 0 ms, write 0 ms, index 606 ms: 5 candidates, 81689 repo-hours, 928 releases; waiting 435 ms; commit 0 ms)
2026-11-08T09:51:33Z [load_day 2025-01-16] 2025-01-16 hour 8: 229483 events in 0 files, snapshot none (task 9515 ms: download 6700 ms overlapping gunzip 1541 ms, parse 6409 ms, sort 0 ms, write 0 ms, index 749 ms: 11 candidates, 94453 repo-hours, 1190 releases; waiting 519 ms; commit 0 ms)
2026-11-08T09:51:35Z [load_day 2025-01-16] 2025-01-16 hour 9: 242452 events in 0 files, snapshot none (task 10817 ms: download 7360 ms overlapping gunzip 1677 ms, parse 6730 ms, sort 0 ms, write 0 ms, index 1448 ms: 8 candidates, 101864 repo-hours, 1418 releases; waiting 507 ms; commit 0 ms)
2026-11-08T09:51:42Z [load_day 2025-01-16] 2025-01-16 hour 10: 234252 events in 0 files, snapshot none (task 8285 ms: download 5462 ms overlapping gunzip 1338 ms, parse 5633 ms, sort 0 ms, write 0 ms, index 694 ms: 6 candidates, 95145 repo-hours, 1297 releases; waiting 201 ms; commit 0 ms)
2026-11-08T09:51:44Z [load_day 2025-01-16] 2025-01-16 hour 11: 227571 events in 0 files, snapshot none (task 7962 ms: download 5483 ms overlapping gunzip 1282 ms, parse 5269 ms, sort 0 ms, write 0 ms, index 661 ms: 4 candidates, 88972 repo-hours, 1196 releases; waiting 485 ms; commit 0 ms)
2026-11-08T09:51:50Z [load_day 2025-01-16] 2025-01-16 hour 12: 276712 events in 0 files, snapshot none (task 7814 ms: download 5011 ms overlapping gunzip 1204 ms, parse 5128 ms, sort 0 ms, write 0 ms, index 1010 ms: 5 candidates, 137677 repo-hours, 1280 releases; waiting 262 ms; commit 0 ms)
2026-11-08T09:51:53Z [load_day 2025-01-16] 2025-01-16 hour 13: 260574 events in 0 files, snapshot none (task 8277 ms: download 5680 ms overlapping gunzip 1251 ms, parse 5475 ms, sort 0 ms, write 0 ms, index 811 ms: 3 candidates, 119314 repo-hours, 1396 releases; waiting 519 ms; commit 0 ms)
2026-11-08T09:52:01Z [load_day 2025-01-16] 2025-01-16 hour 14: 254197 events in 0 files, snapshot none (task 10075 ms: download 6212 ms overlapping gunzip 1565 ms, parse 6625 ms, sort 0 ms, write 0 ms, index 1037 ms: 10 candidates, 104837 repo-hours, 1531 releases; waiting 521 ms; commit 0 ms)
2026-11-08T09:52:04Z [load_day 2025-01-16] 2025-01-16 hour 15: 256401 events in 0 files, snapshot none (task 10220 ms: download 7433 ms overlapping gunzip 1574 ms, parse 6876 ms, sort 0 ms, write 0 ms, index 959 ms: 4 candidates, 109632 repo-hours, 1437 releases; waiting 525 ms; commit 0 ms)
2026-11-08T09:52:12Z [load_day 2025-01-16] 2025-01-16 hour 16: 250045 events in 0 files, snapshot none (task 10352 ms: download 7225 ms overlapping gunzip 1651 ms, parse 7025 ms, sort 0 ms, write 0 ms, index 839 ms: 8 candidates, 104166 repo-hours, 1321 releases; waiting 503 ms; commit 0 ms)
2026-11-08T09:52:14Z [load_day 2025-01-16] 2025-01-16 hour 17: 243337 events in 0 files, snapshot none (task 9828 ms: download 7045 ms overlapping gunzip 1532 ms, parse 6766 ms, sort 0 ms, write 0 ms, index 961 ms: 9 candidates, 96997 repo-hours, 1242 releases; waiting 319 ms; commit 0 ms)
2026-11-08T09:52:26Z [load_day 2025-01-16] 2025-01-16 hour 18: 245790 events in 0 files, snapshot none (task 13423 ms: download 10727 ms overlapping gunzip 1388 ms, parse 6505 ms, sort 0 ms, write 0 ms, index 752 ms: 13 candidates, 109033 repo-hours, 1331 releases; waiting 4472 ms; commit 0 ms)
2026-11-08T09:52:26Z [load_day 2025-01-16] 2025-01-16 hour 19: 218895 events in 0 files, snapshot none (task 8009 ms: download 4622 ms overlapping gunzip 1258 ms, parse 5280 ms, sort 0 ms, write 0 ms, index 941 ms: 16 candidates, 85289 repo-hours, 1288 releases; waiting 231 ms; commit 0 ms)
2026-11-08T09:52:35Z [load_day 2025-01-16] 2025-01-16 hour 20: 219908 events in 0 files, snapshot none (task 9298 ms: download 6549 ms overlapping gunzip 1481 ms, parse 6415 ms, sort 0 ms, write 0 ms, index 673 ms: 10 candidates, 85341 repo-hours, 1207 releases; waiting 512 ms; commit 0 ms)
2026-11-08T09:52:35Z [load_day 2025-01-16] 2025-01-16 hour 21: 220691 events in 0 files, snapshot none (task 9173 ms: download 6604 ms overlapping gunzip 1480 ms, parse 6247 ms, sort 0 ms, write 0 ms, index 623 ms: 12 candidates, 85675 repo-hours, 1428 releases; waiting 539 ms; commit 0 ms)
2026-11-08T09:52:44Z [load_day 2025-01-16] 2025-01-16 hour 22: 195221 events in 0 files, snapshot none (task 8772 ms: download 5861 ms overlapping gunzip 1446 ms, parse 5844 ms, sort 0 ms, write 0 ms, index 560 ms: 12 candidates, 71390 repo-hours, 1331 releases; waiting 480 ms; commit 0 ms)
2026-11-08T09:52:44Z [load_day 2025-01-16] 2025-01-16 hour 23: 184192 events in 0 files, snapshot none (task 8183 ms: download 4926 ms overlapping gunzip 1270 ms, parse 5486 ms, sort 0 ms, write 0 ms, index 673 ms: 7 candidates, 66699 repo-hours, 1064 releases; waiting 524 ms; commit 0 ms)
2026-11-08T09:52:55Z [load_day 2025-01-16] 2025-01-16: repo_hour merged from 24 files to 1 (2236128 rows, 10116 ms)
2026-11-08T09:52:57Z [load_day 2025-01-16] 2025-01-16: index committed in 12896 ms (24 + 1 + 24 files)
2026-11-08T09:52:57Z [load_day 2025-01-16] 2025-01-16: 5360096 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:52:57Z [load_day 2025-01-16] attempt 1 succeeded