orcaLog in

Runs · run 3429

load_day 2025-01-13, attempt 1 succeeded

Host
73ccef5e07c2:236889
Started
2026-11-08T09:47:35Z
Ended
2026-11-08T09:49:52Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
795 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
215.4 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3429/load_day/2025-01-13/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:47:35Z [load_day 2025-01-13] attempt 1 started
2026-11-08T09:47:36Z [load_day 2025-01-13] 2025-01-13: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:47:44Z [load_day 2025-01-13] 2025-01-13 hour 0: 177910 events in 0 files, snapshot none (task 7159 ms: download 4437 ms overlapping gunzip 1095 ms, parse 4304 ms, sort 0 ms, write 0 ms, index 784 ms: 4 candidates, 83239 repo-hours, 1175 releases; waiting 665 ms; commit 0 ms)
2026-11-08T09:47:45Z [load_day 2025-01-13] 2025-01-13 hour 1: 203894 events in 0 files, snapshot none (task 7813 ms: download 5127 ms overlapping gunzip 1177 ms, parse 4981 ms, sort 0 ms, write 0 ms, index 933 ms: 9 candidates, 111863 repo-hours, 914 releases; waiting 508 ms; commit 0 ms)
2026-11-08T09:47:53Z [load_day 2025-01-13] 2025-01-13 hour 2: 173202 events in 0 files, snapshot none (task 8155 ms: download 4947 ms overlapping gunzip 1315 ms, parse 5382 ms, sort 0 ms, write 0 ms, index 628 ms: 5 candidates, 77249 repo-hours, 896 releases; waiting 522 ms; commit 0 ms)
2026-11-08T09:47:53Z [load_day 2025-01-13] 2025-01-13 hour 3: 191021 events in 0 files, snapshot none (task 7988 ms: download 5180 ms overlapping gunzip 1405 ms, parse 5224 ms, sort 0 ms, write 0 ms, index 628 ms: 5 candidates, 76423 repo-hours, 3993 releases; waiting 504 ms; commit 0 ms)
2026-11-08T09:48:01Z [load_day 2025-01-13] 2025-01-13 hour 4: 178359 events in 0 files, snapshot none (task 7857 ms: download 5397 ms overlapping gunzip 1361 ms, parse 5249 ms, sort 0 ms, write 0 ms, index 451 ms: 12 candidates, 64263 repo-hours, 759 releases; waiting 485 ms; commit 0 ms)
2026-11-08T09:48:02Z [load_day 2025-01-13] 2025-01-13 hour 5: 185212 events in 0 files, snapshot none (task 8086 ms: download 5522 ms overlapping gunzip 1404 ms, parse 5397 ms, sort 0 ms, write 0 ms, index 503 ms: 5 candidates, 69604 repo-hours, 705 releases; waiting 521 ms; commit 0 ms)
2026-11-08T09:48:11Z [load_day 2025-01-13] 2025-01-13 hour 6: 209786 events in 0 files, snapshot none (task 9313 ms: download 6717 ms overlapping gunzip 1435 ms, parse 5724 ms, sort 0 ms, write 0 ms, index 798 ms: 8 candidates, 90564 repo-hours, 1007 releases; waiting 1104 ms; commit 0 ms)
2026-11-08T09:48:12Z [load_day 2025-01-13] 2025-01-13 hour 7: 211495 events in 0 files, snapshot none (task 9426 ms: download 6417 ms overlapping gunzip 1505 ms, parse 6013 ms, sort 0 ms, write 0 ms, index 935 ms: 4 candidates, 80915 repo-hours, 1076 releases; waiting 509 ms; commit 0 ms)
2026-11-08T09:48:22Z [load_day 2025-01-13] 2025-01-13 hour 8: 227610 events in 0 files, snapshot none (task 10020 ms: download 7101 ms overlapping gunzip 1743 ms, parse 6587 ms, sort 0 ms, write 0 ms, index 839 ms: 3 candidates, 93103 repo-hours, 1188 releases; waiting 510 ms; commit 0 ms)
2026-11-08T09:48:23Z [load_day 2025-01-13] 2025-01-13 hour 9: 242254 events in 0 files, snapshot none (task 10842 ms: download 7971 ms overlapping gunzip 1816 ms, parse 7387 ms, sort 0 ms, write 0 ms, index 763 ms: 11 candidates, 100507 repo-hours, 1356 releases; waiting 478 ms; commit 0 ms)
2026-11-08T09:48:32Z [load_day 2025-01-13] 2025-01-13 hour 10: 237921 events in 0 files, snapshot none (task 9291 ms: download 6886 ms overlapping gunzip 1621 ms, parse 6516 ms, sort 0 ms, write 0 ms, index 712 ms: 5 candidates, 96030 repo-hours, 1173 releases; waiting 182 ms; commit 0 ms)
2026-11-08T09:48:33Z [load_day 2025-01-13] 2025-01-13 hour 11: 243841 events in 0 files, snapshot none (task 8900 ms: download 6437 ms overlapping gunzip 1545 ms, parse 6128 ms, sort 0 ms, write 0 ms, index 673 ms: 6 candidates, 89246 repo-hours, 1190 releases; waiting 258 ms; commit 0 ms)
2026-11-08T09:48:41Z [load_day 2025-01-13] 2025-01-13 hour 12: 280832 events in 0 files, snapshot none (task 8713 ms: download 5827 ms overlapping gunzip 1358 ms, parse 5517 ms, sort 0 ms, write 0 ms, index 992 ms: 9 candidates, 133979 repo-hours, 1342 releases; waiting 561 ms; commit 0 ms)
2026-11-08T09:48:42Z [load_day 2025-01-13] 2025-01-13 hour 13: 271827 events in 0 files, snapshot none (task 8493 ms: download 5894 ms overlapping gunzip 1413 ms, parse 5500 ms, sort 0 ms, write 0 ms, index 820 ms: 4 candidates, 115384 repo-hours, 1389 releases; waiting 506 ms; commit 0 ms)
2026-11-08T09:48:54Z [load_day 2025-01-13] 2025-01-13 hour 14: 266731 events in 0 files, snapshot none (task 12638 ms: download 8969 ms overlapping gunzip 2038 ms, parse 8487 ms, sort 0 ms, write 0 ms, index 1396 ms: 11 candidates, 104480 repo-hours, 1383 releases; waiting 485 ms; commit 0 ms)
2026-11-08T09:48:55Z [load_day 2025-01-13] 2025-01-13 hour 15: 265419 events in 0 files, snapshot none (task 12980 ms: download 9064 ms overlapping gunzip 2197 ms, parse 8980 ms, sort 0 ms, write 0 ms, index 1259 ms: 5 candidates, 108858 repo-hours, 1524 releases; waiting 216 ms; commit 0 ms)
2026-11-08T09:49:08Z [load_day 2025-01-13] 2025-01-13 hour 16: 260559 events in 0 files, snapshot none (task 13080 ms: download 10157 ms overlapping gunzip 2278 ms, parse 9134 ms, sort 0 ms, write 0 ms, index 793 ms: 10 candidates, 104949 repo-hours, 1480 releases; waiting 476 ms; commit 0 ms)
2026-11-08T09:49:08Z [load_day 2025-01-13] 2025-01-13 hour 17: 243403 events in 0 files, snapshot none (task 12281 ms: download 9747 ms overlapping gunzip 2264 ms, parse 8563 ms, sort 0 ms, write 0 ms, index 712 ms: 8 candidates, 96375 repo-hours, 1142 releases; waiting 502 ms; commit 0 ms)
2026-11-08T09:49:19Z [load_day 2025-01-13] 2025-01-13 hour 18: 240584 events in 0 files, snapshot none (task 10833 ms: download 8159 ms overlapping gunzip 1920 ms, parse 7191 ms, sort 0 ms, write 0 ms, index 973 ms: 6 candidates, 105819 repo-hours, 1208 releases; waiting 527 ms; commit 0 ms)
2026-11-08T09:49:19Z [load_day 2025-01-13] 2025-01-13 hour 19: 222112 events in 0 files, snapshot none (task 10331 ms: download 7414 ms overlapping gunzip 1710 ms, parse 6767 ms, sort 0 ms, write 0 ms, index 993 ms: 12 candidates, 83867 repo-hours, 1175 releases; waiting 509 ms; commit 0 ms)
2026-11-08T09:49:30Z [load_day 2025-01-13] 2025-01-13 hour 20: 226117 events in 0 files, snapshot none (task 10271 ms: download 7314 ms overlapping gunzip 1599 ms, parse 6630 ms, sort 0 ms, write 0 ms, index 1004 ms: 16 candidates, 89257 repo-hours, 1194 releases; waiting 709 ms; commit 0 ms)
2026-11-08T09:49:30Z [load_day 2025-01-13] 2025-01-13 hour 21: 222448 events in 0 files, snapshot none (task 10221 ms: download 7449 ms overlapping gunzip 1772 ms, parse 6784 ms, sort 0 ms, write 0 ms, index 895 ms: 11 candidates, 94912 repo-hours, 1250 releases; waiting 476 ms; commit 0 ms)
2026-11-08T09:49:39Z [load_day 2025-01-13] 2025-01-13 hour 22: 199926 events in 0 files, snapshot none (task 8597 ms: download 6133 ms overlapping gunzip 1435 ms, parse 5708 ms, sort 0 ms, write 0 ms, index 652 ms: 6 candidates, 72692 repo-hours, 1314 releases; waiting 510 ms; commit 0 ms)
2026-11-08T09:49:39Z [load_day 2025-01-13] 2025-01-13 hour 23: 147252 events in 0 files, snapshot none (task 6112 ms: download 3853 ms overlapping gunzip 1049 ms, parse 3828 ms, sort 0 ms, write 0 ms, index 429 ms: 5 candidates, 58310 repo-hours, 808 releases; waiting 505 ms; commit 0 ms)
2026-11-08T09:49:49Z [load_day 2025-01-13] 2025-01-13: repo_hour merged from 24 files to 1 (2201888 rows, 10009 ms)
2026-11-08T09:49:52Z [load_day 2025-01-13] 2025-01-13: index committed in 13250 ms (24 + 1 + 24 files)
2026-11-08T09:49:52Z [load_day 2025-01-13] 2025-01-13: 5329715 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:49:52Z [load_day 2025-01-13] attempt 1 succeeded