orcaLog in

Runs · run 3469

load_day 2025-01-23, attempt 1 succeeded

Host
73ccef5e07c2:242380
Started
2026-11-08T09:57:31Z
Ended
2026-11-08T09:59:37Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
834 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
199.0 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3469/load_day/2025-01-23/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:57:31Z [load_day 2025-01-23] attempt 1 started
2026-11-08T09:57:32Z [load_day 2025-01-23] 2025-01-23: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:57:41Z [load_day 2025-01-23] 2025-01-23 hour 0: 199832 events in 0 files, snapshot none (task 8130 ms: download 5152 ms overlapping gunzip 1292 ms, parse 5385 ms, sort 0 ms, write 0 ms, index 714 ms: 5 candidates, 97233 repo-hours, 1326 releases; waiting 500 ms; commit 0 ms)
2026-11-08T09:57:41Z [load_day 2025-01-23] 2025-01-23 hour 1: 213144 events in 0 files, snapshot none (task 8051 ms: download 5120 ms overlapping gunzip 1286 ms, parse 5306 ms, sort 0 ms, write 0 ms, index 871 ms: 4 candidates, 114388 repo-hours, 926 releases; waiting 259 ms; commit 0 ms)
2026-11-08T09:57:49Z [load_day 2025-01-23] 2025-01-23 hour 2: 184862 events in 0 files, snapshot none (task 7896 ms: download 4945 ms overlapping gunzip 1294 ms, parse 5174 ms, sort 0 ms, write 0 ms, index 642 ms: 6 candidates, 82102 repo-hours, 893 releases; waiting 556 ms; commit 0 ms)
2026-11-08T09:57:49Z [load_day 2025-01-23] 2025-01-23 hour 3: 201844 events in 0 files, snapshot none (task 7913 ms: download 5070 ms overlapping gunzip 1294 ms, parse 5180 ms, sort 0 ms, write 0 ms, index 643 ms: 6 candidates, 80219 repo-hours, 4018 releases; waiting 517 ms; commit 0 ms)
2026-11-08T09:57:58Z [load_day 2025-01-23] 2025-01-23 hour 4: 187099 events in 0 files, snapshot none (task 8024 ms: download 4688 ms overlapping gunzip 1282 ms, parse 5219 ms, sort 0 ms, write 0 ms, index 753 ms: 6 candidates, 69468 repo-hours, 733 releases; waiting 519 ms; commit 0 ms)
2026-11-08T09:57:59Z [load_day 2025-01-23] 2025-01-23 hour 5: 200381 events in 0 files, snapshot none (task 8952 ms: download 5400 ms overlapping gunzip 1417 ms, parse 6016 ms, sort 0 ms, write 0 ms, index 793 ms: 3 candidates, 75240 repo-hours, 885 releases; waiting 472 ms; commit 0 ms)
2026-11-08T09:58:05Z [load_day 2025-01-23] 2025-01-23 hour 6: 222606 events in 0 files, snapshot none (task 6748 ms: download 3695 ms overlapping gunzip 1059 ms, parse 4349 ms, sort 0 ms, write 0 ms, index 942 ms: 8 candidates, 96087 repo-hours, 1060 releases; waiting 182 ms; commit 0 ms)
2026-11-08T09:58:08Z [load_day 2025-01-23] 2025-01-23 hour 7: 215082 events in 0 files, snapshot none (task 8010 ms: download 4615 ms overlapping gunzip 1180 ms, parse 5018 ms, sort 0 ms, write 0 ms, index 1265 ms: 5 candidates, 84363 repo-hours, 1029 releases; waiting 253 ms; commit 0 ms)
2026-11-08T09:58:14Z [load_day 2025-01-23] 2025-01-23 hour 8: 230259 events in 0 files, snapshot none (task 8071 ms: download 5430 ms overlapping gunzip 1265 ms, parse 5246 ms, sort 0 ms, write 0 ms, index 781 ms: 14 candidates, 93860 repo-hours, 1157 releases; waiting 512 ms; commit 0 ms)
2026-11-08T09:58:18Z [load_day 2025-01-23] 2025-01-23 hour 9: 245796 events in 0 files, snapshot none (task 9711 ms: download 5785 ms overlapping gunzip 1555 ms, parse 6210 ms, sort 0 ms, write 0 ms, index 1080 ms: 11 candidates, 104302 repo-hours, 1400 releases; waiting 590 ms; commit 0 ms)
2026-11-08T09:58:23Z [load_day 2025-01-23] 2025-01-23 hour 10: 238677 events in 0 files, snapshot none (task 8857 ms: download 6137 ms overlapping gunzip 1378 ms, parse 6086 ms, sort 0 ms, write 0 ms, index 926 ms: 5 candidates, 100226 repo-hours, 1177 releases; waiting 206 ms; commit 0 ms)
2026-11-08T09:58:27Z [load_day 2025-01-23] 2025-01-23 hour 11: 225918 events in 0 files, snapshot none (task 8887 ms: download 4932 ms overlapping gunzip 1287 ms, parse 5639 ms, sort 0 ms, write 0 ms, index 1169 ms: 9 candidates, 91130 repo-hours, 1353 releases; waiting 488 ms; commit 0 ms)
2026-11-08T09:58:34Z [load_day 2025-01-23] 2025-01-23 hour 12: 267620 events in 0 files, snapshot none (task 10525 ms: download 6720 ms overlapping gunzip 1520 ms, parse 6778 ms, sort 0 ms, write 0 ms, index 1678 ms: 7 candidates, 135035 repo-hours, 1220 releases; waiting 198 ms; commit 0 ms)
2026-11-08T09:58:38Z [load_day 2025-01-23] 2025-01-23 hour 13: 256754 events in 0 files, snapshot none (task 10403 ms: download 6182 ms overlapping gunzip 1494 ms, parse 6559 ms, sort 0 ms, write 0 ms, index 1771 ms: 3 candidates, 118809 repo-hours, 1372 releases; waiting 355 ms; commit 0 ms)
2026-11-08T09:58:45Z [load_day 2025-01-23] 2025-01-23 hour 14: 257126 events in 0 files, snapshot none (task 9959 ms: download 6933 ms overlapping gunzip 1552 ms, parse 6640 ms, sort 0 ms, write 0 ms, index 893 ms: 6 candidates, 107859 repo-hours, 1333 releases; waiting 510 ms; commit 0 ms)
2026-11-08T09:58:48Z [load_day 2025-01-23] 2025-01-23 hour 15: 262408 events in 0 files, snapshot none (task 8808 ms: download 6127 ms overlapping gunzip 1360 ms, parse 5750 ms, sort 0 ms, write 0 ms, index 887 ms: 9 candidates, 114050 repo-hours, 1434 releases; waiting 544 ms; commit 0 ms)
2026-11-08T09:58:54Z [load_day 2025-01-23] 2025-01-23 hour 16: 255853 events in 0 files, snapshot none (task 8204 ms: download 5468 ms overlapping gunzip 1302 ms, parse 5258 ms, sort 0 ms, write 0 ms, index 858 ms: 8 candidates, 106636 repo-hours, 1390 releases; waiting 522 ms; commit 0 ms)
2026-11-08T09:58:57Z [load_day 2025-01-23] 2025-01-23 hour 17: 249083 events in 0 files, snapshot none (task 8762 ms: download 5119 ms overlapping gunzip 1211 ms, parse 5005 ms, sort 0 ms, write 0 ms, index 1769 ms: 9 candidates, 101352 repo-hours, 1162 releases; waiting 521 ms; commit 0 ms)
2026-11-08T09:59:05Z [load_day 2025-01-23] 2025-01-23 hour 18: 248194 events in 0 files, snapshot none (task 11272 ms: download 7734 ms overlapping gunzip 1766 ms, parse 7280 ms, sort 0 ms, write 0 ms, index 1474 ms: 9 candidates, 112188 repo-hours, 1196 releases; waiting 472 ms; commit 0 ms)
2026-11-08T09:59:07Z [load_day 2025-01-23] 2025-01-23 hour 19: 222516 events in 0 files, snapshot none (task 8886 ms: download 5439 ms overlapping gunzip 1476 ms, parse 5916 ms, sort 0 ms, write 0 ms, index 936 ms: 15 candidates, 87143 repo-hours, 1219 releases; waiting 170 ms; commit 0 ms)
2026-11-08T09:59:15Z [load_day 2025-01-23] 2025-01-23 hour 20: 220854 events in 0 files, snapshot none (task 9269 ms: download 5684 ms overlapping gunzip 1459 ms, parse 6546 ms, sort 0 ms, write 0 ms, index 1030 ms: 10 candidates, 88092 repo-hours, 1009 releases; waiting 9 ms; commit 0 ms)
2026-11-08T09:59:16Z [load_day 2025-01-23] 2025-01-23 hour 21: 218320 events in 0 files, snapshot none (task 8507 ms: download 5761 ms overlapping gunzip 1432 ms, parse 6071 ms, sort 0 ms, write 0 ms, index 754 ms: 10 candidates, 87525 repo-hours, 1168 releases; waiting 26 ms; commit 0 ms)
2026-11-08T09:59:24Z [load_day 2025-01-23] 2025-01-23 hour 22: 200756 events in 0 files, snapshot none (task 8249 ms: download 5461 ms overlapping gunzip 1384 ms, parse 5969 ms, sort 0 ms, write 0 ms, index 677 ms: 11 candidates, 76467 repo-hours, 1225 releases; waiting 16 ms; commit 0 ms)
2026-11-08T09:59:24Z [load_day 2025-01-23] 2025-01-23 hour 23: 188675 events in 0 files, snapshot none (task 7775 ms: download 4551 ms overlapping gunzip 1334 ms, parse 5522 ms, sort 0 ms, write 0 ms, index 712 ms: 9 candidates, 70377 repo-hours, 1000 releases; waiting 16 ms; commit 0 ms)
2026-11-08T09:59:34Z [load_day 2025-01-23] 2025-01-23: repo_hour merged from 24 files to 1 (2294151 rows, 10066 ms)
2026-11-08T09:59:37Z [load_day 2025-01-23] 2025-01-23: index committed in 12728 ms (24 + 1 + 24 files)
2026-11-08T09:59:37Z [load_day 2025-01-23] 2025-01-23: 5413659 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:59:37Z [load_day 2025-01-23] attempt 1 succeeded