orcaLog in

Runs · run 3900

load_day 2025-05-14, attempt 1 succeeded

Host
73ccef5e07c2:304644
Started
2026-11-08T11:56:03Z
Ended
2026-11-08T11:58:24Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
810 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
212.5 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3900/load_day/2025-05-14/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:56:03Z [load_day 2025-05-14] attempt 1 started
2026-11-08T11:56:04Z [load_day 2025-05-14] 2025-05-14: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:56:13Z [load_day 2025-05-14] 2025-05-14 hour 0: 199618 events in 0 files, snapshot none (task 8128 ms: download 5020 ms overlapping gunzip 1256 ms, parse 5441 ms, sort 0 ms, write 0 ms, index 868 ms: 6 candidates, 93843 repo-hours, 1261 releases; waiting 221 ms; commit 0 ms)
2026-11-08T11:56:13Z [load_day 2025-05-14] 2025-05-14 hour 1: 226816 events in 0 files, snapshot none (task 8680 ms: download 5590 ms overlapping gunzip 1289 ms, parse 5510 ms, sort 0 ms, write 0 ms, index 783 ms: 9 candidates, 125215 repo-hours, 1114 releases; waiting 714 ms; commit 0 ms)
2026-11-08T11:56:22Z [load_day 2025-05-14] 2025-05-14 hour 2: 203867 events in 0 files, snapshot none (task 8469 ms: download 5158 ms overlapping gunzip 1290 ms, parse 5399 ms, sort 0 ms, write 0 ms, index 767 ms: 5 candidates, 95120 repo-hours, 1115 releases; waiting 656 ms; commit 0 ms)
2026-11-08T11:56:22Z [load_day 2025-05-14] 2025-05-14 hour 3: 208850 events in 0 files, snapshot none (task 7396 ms: download 4240 ms overlapping gunzip 1154 ms, parse 4754 ms, sort 0 ms, write 0 ms, index 865 ms: 4 candidates, 90167 repo-hours, 2951 releases; waiting 307 ms; commit 0 ms)
2026-11-08T11:56:30Z [load_day 2025-05-14] 2025-05-14 hour 4: 200166 events in 0 files, snapshot none (task 7624 ms: download 4413 ms overlapping gunzip 1226 ms, parse 5097 ms, sort 0 ms, write 0 ms, index 703 ms: 8 candidates, 79867 repo-hours, 806 releases; waiting 273 ms; commit 0 ms)
2026-11-08T11:56:30Z [load_day 2025-05-14] 2025-05-14 hour 5: 218575 events in 0 files, snapshot none (task 8108 ms: download 5144 ms overlapping gunzip 1210 ms, parse 5274 ms, sort 0 ms, write 0 ms, index 802 ms: 6 candidates, 87925 repo-hours, 981 releases; waiting 529 ms; commit 0 ms)
2026-11-08T11:56:41Z [load_day 2025-05-14] 2025-05-14 hour 6: 241982 events in 0 files, snapshot none (task 10398 ms: download 6567 ms overlapping gunzip 1642 ms, parse 6711 ms, sort 0 ms, write 0 ms, index 1319 ms: 3 candidates, 111010 repo-hours, 1213 releases; waiting 503 ms; commit 0 ms)
2026-11-08T11:56:42Z [load_day 2025-05-14] 2025-05-14 hour 7: 247782 events in 0 files, snapshot none (task 10941 ms: download 7353 ms overlapping gunzip 1770 ms, parse 7373 ms, sort 0 ms, write 0 ms, index 831 ms: 6 candidates, 104235 repo-hours, 1160 releases; waiting 617 ms; commit 0 ms)
2026-11-08T11:56:55Z [load_day 2025-05-14] 2025-05-14 hour 8: 256802 events in 0 files, snapshot none (task 13538 ms: download 9894 ms overlapping gunzip 2142 ms, parse 9013 ms, sort 0 ms, write 0 ms, index 1114 ms: 11 candidates, 114406 repo-hours, 1347 releases; waiting 928 ms; commit 0 ms)
2026-11-08T11:56:55Z [load_day 2025-05-14] 2025-05-14 hour 9: 259088 events in 0 files, snapshot none (task 12783 ms: download 9495 ms overlapping gunzip 2160 ms, parse 9148 ms, sort 0 ms, write 0 ms, index 841 ms: 4 candidates, 113910 repo-hours, 1397 releases; waiting 296 ms; commit 0 ms)
2026-11-08T11:57:06Z [load_day 2025-05-14] 2025-05-14 hour 10: 243643 events in 0 files, snapshot none (task 10469 ms: download 7007 ms overlapping gunzip 1639 ms, parse 7342 ms, sort 0 ms, write 0 ms, index 949 ms: 12 candidates, 105756 repo-hours, 1231 releases; waiting 195 ms; commit 0 ms)
2026-11-08T11:57:06Z [load_day 2025-05-14] 2025-05-14 hour 11: 249499 events in 0 files, snapshot none (task 10585 ms: download 7318 ms overlapping gunzip 1665 ms, parse 7228 ms, sort 0 ms, write 0 ms, index 922 ms: 10 candidates, 104860 repo-hours, 1280 releases; waiting 481 ms; commit 0 ms)
2026-11-08T11:57:16Z [load_day 2025-05-14] 2025-05-14 hour 12: 279377 events in 0 files, snapshot none (task 9430 ms: download 6515 ms overlapping gunzip 1432 ms, parse 6172 ms, sort 0 ms, write 0 ms, index 1070 ms: 12 candidates, 145981 repo-hours, 1439 releases; waiting 520 ms; commit 0 ms)
2026-11-08T11:57:17Z [load_day 2025-05-14] 2025-05-14 hour 13: 273057 events in 0 files, snapshot none (task 10005 ms: download 7074 ms overlapping gunzip 1527 ms, parse 6629 ms, sort 0 ms, write 0 ms, index 1021 ms: 7 candidates, 134657 repo-hours, 1396 releases; waiting 466 ms; commit 0 ms)
2026-11-08T11:57:25Z [load_day 2025-05-14] 2025-05-14 hour 14: 268628 events in 0 files, snapshot none (task 8907 ms: download 6041 ms overlapping gunzip 1382 ms, parse 5690 ms, sort 0 ms, write 0 ms, index 865 ms: 8 candidates, 119125 repo-hours, 1453 releases; waiting 522 ms; commit 0 ms)
2026-11-08T11:57:26Z [load_day 2025-05-14] 2025-05-14 hour 15: 268737 events in 0 files, snapshot none (task 8716 ms: download 5879 ms overlapping gunzip 1353 ms, parse 5538 ms, sort 0 ms, write 0 ms, index 811 ms: 13 candidates, 120972 repo-hours, 1441 releases; waiting 538 ms; commit 0 ms)
2026-11-08T11:57:37Z [load_day 2025-05-14] 2025-05-14 hour 16: 263411 events in 0 files, snapshot none (task 10637 ms: download 7526 ms overlapping gunzip 1677 ms, parse 7168 ms, sort 0 ms, write 0 ms, index 964 ms: 7 candidates, 114159 repo-hours, 1204 releases; waiting 516 ms; commit 0 ms)
2026-11-08T11:57:37Z [load_day 2025-05-14] 2025-05-14 hour 17: 253540 events in 0 files, snapshot none (task 10304 ms: download 7316 ms overlapping gunzip 1621 ms, parse 6753 ms, sort 0 ms, write 0 ms, index 820 ms: 10 candidates, 104500 repo-hours, 1617 releases; waiting 694 ms; commit 0 ms)
2026-11-08T11:57:49Z [load_day 2025-05-14] 2025-05-14 hour 18: 258852 events in 0 files, snapshot none (task 11774 ms: download 8750 ms overlapping gunzip 1822 ms, parse 8141 ms, sort 0 ms, write 0 ms, index 936 ms: 8 candidates, 115615 repo-hours, 1319 releases; waiting 517 ms; commit 0 ms)
2026-11-08T11:57:49Z [load_day 2025-05-14] 2025-05-14 hour 19: 240093 events in 0 files, snapshot none (task 10496 ms: download 7601 ms overlapping gunzip 1772 ms, parse 7354 ms, sort 0 ms, write 0 ms, index 782 ms: 9 candidates, 95257 repo-hours, 1211 releases; waiting 301 ms; commit 0 ms)
2026-11-08T11:58:00Z [load_day 2025-05-14] 2025-05-14 hour 20: 233916 events in 0 files, snapshot none (task 10852 ms: download 7247 ms overlapping gunzip 1732 ms, parse 7219 ms, sort 0 ms, write 0 ms, index 1246 ms: 8 candidates, 93467 repo-hours, 1135 releases; waiting 281 ms; commit 0 ms)
2026-11-08T11:58:01Z [load_day 2025-05-14] 2025-05-14 hour 21: 219790 events in 0 files, snapshot none (task 10958 ms: download 7328 ms overlapping gunzip 1667 ms, parse 7229 ms, sort 0 ms, write 0 ms, index 1122 ms: 7 candidates, 88428 repo-hours, 1336 releases; waiting 507 ms; commit 0 ms)
2026-11-08T11:58:10Z [load_day 2025-05-14] 2025-05-14 hour 22: 204225 events in 0 files, snapshot none (task 9185 ms: download 6256 ms overlapping gunzip 1423 ms, parse 6097 ms, sort 0 ms, write 0 ms, index 892 ms: 5 candidates, 76734 repo-hours, 1121 releases; waiting 473 ms; commit 0 ms)
2026-11-08T11:58:10Z [load_day 2025-05-14] 2025-05-14 hour 23: 193417 events in 0 files, snapshot none (task 8950 ms: download 5841 ms overlapping gunzip 1403 ms, parse 5933 ms, sort 0 ms, write 0 ms, index 997 ms: 10 candidates, 73943 repo-hours, 1038 releases; waiting 322 ms; commit 0 ms)
2026-11-08T11:58:21Z [load_day 2025-05-14] 2025-05-14: repo_hour merged from 24 files to 1 (2509152 rows, 11318 ms)
2026-11-08T11:58:24Z [load_day 2025-05-14] 2025-05-14: index committed in 14094 ms (24 + 1 + 24 files)
2026-11-08T11:58:24Z [load_day 2025-05-14] 2025-05-14: 5713731 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:58:24Z [load_day 2025-05-14] attempt 1 succeeded