orcaLog in

Runs · run 3789

load_day 2025-04-15, attempt 1 succeeded

Host
73ccef5e07c2:288099
Started
2026-11-08T11:25:33Z
Ended
2026-11-08T11:27:48Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
853 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
207.8 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3789/load_day/2025-04-15/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:25:33Z [load_day 2025-04-15] attempt 1 started
2026-11-08T11:25:35Z [load_day 2025-04-15] 2025-04-15: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:25:45Z [load_day 2025-04-15] 2025-04-15 hour 0: 209311 events in 0 files, snapshot none (task 10163 ms: download 6674 ms overlapping gunzip 1648 ms, parse 6870 ms, sort 0 ms, write 0 ms, index 798 ms: 4 candidates, 97578 repo-hours, 1224 releases; waiting 506 ms; commit 0 ms)
2026-11-08T11:25:45Z [load_day 2025-04-15] 2025-04-15 hour 1: 227193 events in 0 files, snapshot none (task 8834 ms: download 5516 ms overlapping gunzip 1255 ms, parse 5734 ms, sort 0 ms, write 0 ms, index 1121 ms: 5 candidates, 126599 repo-hours, 989 releases; waiting 517 ms; commit 0 ms)
2026-11-08T11:25:56Z [load_day 2025-04-15] 2025-04-15 hour 2: 203449 events in 0 files, snapshot none (task 9673 ms: download 6528 ms overlapping gunzip 1493 ms, parse 6335 ms, sort 0 ms, write 0 ms, index 784 ms: 6 candidates, 91984 repo-hours, 990 releases; waiting 740 ms; commit 0 ms)
2026-11-08T11:25:56Z [load_day 2025-04-15] 2025-04-15 hour 3: 213040 events in 0 files, snapshot none (task 8437 ms: download 5305 ms overlapping gunzip 1309 ms, parse 5353 ms, sort 0 ms, write 0 ms, index 996 ms: 6 candidates, 91994 repo-hours, 3020 releases; waiting 530 ms; commit 0 ms)
2026-11-08T11:26:04Z [load_day 2025-04-15] 2025-04-15 hour 4: 189161 events in 0 files, snapshot none (task 7455 ms: download 4116 ms overlapping gunzip 1110 ms, parse 4809 ms, sort 0 ms, write 0 ms, index 703 ms: 4 candidates, 77148 repo-hours, 838 releases; waiting 543 ms; commit 0 ms)
2026-11-08T11:26:04Z [load_day 2025-04-15] 2025-04-15 hour 5: 203747 events in 0 files, snapshot none (task 7521 ms: download 4209 ms overlapping gunzip 1150 ms, parse 4647 ms, sort 0 ms, write 0 ms, index 887 ms: 4 candidates, 83389 repo-hours, 986 releases; waiting 533 ms; commit 0 ms)
2026-11-08T11:26:13Z [load_day 2025-04-15] 2025-04-15 hour 6: 238232 events in 0 files, snapshot none (task 8705 ms: download 5491 ms overlapping gunzip 1396 ms, parse 5431 ms, sort 0 ms, write 0 ms, index 925 ms: 3 candidates, 108102 repo-hours, 1231 releases; waiting 571 ms; commit 0 ms)
2026-11-08T11:26:17Z [load_day 2025-04-15] 2025-04-15 hour 7: 244060 events in 0 files, snapshot none (task 12427 ms: download 8611 ms overlapping gunzip 1560 ms, parse 6505 ms, sort 0 ms, write 0 ms, index 1047 ms: 3 candidates, 101133 repo-hours, 1128 releases; waiting 2950 ms; commit 0 ms)
2026-11-08T11:26:23Z [load_day 2025-04-15] 2025-04-15 hour 8: 253772 events in 0 files, snapshot none (task 9146 ms: download 6496 ms overlapping gunzip 1464 ms, parse 6077 ms, sort 0 ms, write 0 ms, index 817 ms: 5 candidates, 108139 repo-hours, 1394 releases; waiting 492 ms; commit 0 ms)
2026-11-08T11:26:25Z [load_day 2025-04-15] 2025-04-15 hour 9: 247793 events in 0 files, snapshot none (task 7888 ms: download 5171 ms overlapping gunzip 1219 ms, parse 4996 ms, sort 0 ms, write 0 ms, index 800 ms: 12 candidates, 108001 repo-hours, 1372 releases; waiting 517 ms; commit 0 ms)
2026-11-08T11:26:30Z [load_day 2025-04-15] 2025-04-15 hour 10: 243550 events in 0 files, snapshot none (task 7217 ms: download 4434 ms overlapping gunzip 1226 ms, parse 4983 ms, sort 0 ms, write 0 ms, index 789 ms: 9 candidates, 104306 repo-hours, 1291 releases; waiting 10 ms; commit 0 ms)
2026-11-08T11:26:34Z [load_day 2025-04-15] 2025-04-15 hour 11: 245253 events in 0 files, snapshot none (task 8239 ms: download 5563 ms overlapping gunzip 1318 ms, parse 5394 ms, sort 0 ms, write 0 ms, index 746 ms: 2 candidates, 100105 repo-hours, 1286 releases; waiting 485 ms; commit 0 ms)
2026-11-08T11:26:40Z [load_day 2025-04-15] 2025-04-15 hour 12: 276552 events in 0 files, snapshot none (task 8818 ms: download 4878 ms overlapping gunzip 1241 ms, parse 5375 ms, sort 0 ms, write 0 ms, index 1977 ms: 8 candidates, 144447 repo-hours, 1388 releases; waiting 23 ms; commit 0 ms)
2026-11-08T11:26:46Z [load_day 2025-04-15] 2025-04-15 hour 13: 266067 events in 0 files, snapshot none (task 11420 ms: download 6888 ms overlapping gunzip 1734 ms, parse 7420 ms, sort 0 ms, write 0 ms, index 1793 ms: 6 candidates, 131625 repo-hours, 1272 releases; waiting 17 ms; commit 0 ms)
2026-11-08T11:26:53Z [load_day 2025-04-15] 2025-04-15 hour 14: 262530 events in 0 files, snapshot none (task 12885 ms: download 9004 ms overlapping gunzip 2068 ms, parse 9144 ms, sort 0 ms, write 0 ms, index 1434 ms: 8 candidates, 117481 repo-hours, 1389 releases; waiting 14 ms; commit 0 ms)
2026-11-08T11:26:58Z [load_day 2025-04-15] 2025-04-15 hour 15: 268691 events in 0 files, snapshot none (task 11062 ms: download 8000 ms overlapping gunzip 1740 ms, parse 8015 ms, sort 0 ms, write 0 ms, index 1066 ms: 16 candidates, 121003 repo-hours, 1442 releases; waiting 28 ms; commit 0 ms)
2026-11-08T11:27:04Z [load_day 2025-04-15] 2025-04-15 hour 16: 262595 events in 0 files, snapshot none (task 10546 ms: download 6910 ms overlapping gunzip 1782 ms, parse 7324 ms, sort 0 ms, write 0 ms, index 1199 ms: 6 candidates, 114047 repo-hours, 1595 releases; waiting 25 ms; commit 0 ms)
2026-11-08T11:27:08Z [load_day 2025-04-15] 2025-04-15 hour 17: 253971 events in 0 files, snapshot none (task 9661 ms: download 6146 ms overlapping gunzip 1552 ms, parse 6680 ms, sort 0 ms, write 0 ms, index 1169 ms: 7 candidates, 105544 repo-hours, 1094 releases; waiting 21 ms; commit 0 ms)
2026-11-08T11:27:15Z [load_day 2025-04-15] 2025-04-15 hour 18: 255649 events in 0 files, snapshot none (task 10552 ms: download 7457 ms overlapping gunzip 1758 ms, parse 7718 ms, sort 0 ms, write 0 ms, index 865 ms: 13 candidates, 115315 repo-hours, 1310 releases; waiting 0 ms; commit 0 ms)
2026-11-08T11:27:17Z [load_day 2025-04-15] 2025-04-15 hour 19: 238894 events in 0 files, snapshot none (task 8753 ms: download 5692 ms overlapping gunzip 1301 ms, parse 5944 ms, sort 0 ms, write 0 ms, index 1254 ms: 6 candidates, 96177 repo-hours, 1299 releases; waiting 26 ms; commit 0 ms)
2026-11-08T11:27:25Z [load_day 2025-04-15] 2025-04-15 hour 20: 231031 events in 0 files, snapshot none (task 9024 ms: download 5825 ms overlapping gunzip 1605 ms, parse 6458 ms, sort 0 ms, write 0 ms, index 735 ms: 9 candidates, 93901 repo-hours, 1286 releases; waiting 17 ms; commit 0 ms)
2026-11-08T11:27:26Z [load_day 2025-04-15] 2025-04-15 hour 21: 215739 events in 0 files, snapshot none (task 8056 ms: download 5407 ms overlapping gunzip 1368 ms, parse 5796 ms, sort 0 ms, write 0 ms, index 657 ms: 0 candidates, 87514 repo-hours, 1164 releases; waiting 0 ms; commit 0 ms)
2026-11-08T11:27:33Z [load_day 2025-04-15] 2025-04-15 hour 22: 197127 events in 0 files, snapshot none (task 8054 ms: download 5087 ms overlapping gunzip 1186 ms, parse 5512 ms, sort 0 ms, write 0 ms, index 538 ms: 5 candidates, 75561 repo-hours, 1092 releases; waiting 526 ms; commit 0 ms)
2026-11-08T11:27:34Z [load_day 2025-04-15] 2025-04-15 hour 23: 186945 events in 0 files, snapshot none (task 7532 ms: download 5134 ms overlapping gunzip 1232 ms, parse 5493 ms, sort 0 ms, write 0 ms, index 576 ms: 4 candidates, 72367 repo-hours, 1222 releases; waiting 29 ms; commit 0 ms)
2026-11-08T11:27:45Z [load_day 2025-04-15] 2025-04-15: repo_hour merged from 24 files to 1 (2473460 rows, 10728 ms)
2026-11-08T11:27:48Z [load_day 2025-04-15] 2025-04-15: index committed in 13999 ms (23 + 1 + 24 files)
2026-11-08T11:27:48Z [load_day 2025-04-15] 2025-04-15: 5634352 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:27:48Z [load_day 2025-04-15] attempt 1 succeeded