orcaLog in

Runs · run 3786

load_day 2025-04-14, attempt 1 succeeded

Host
73ccef5e07c2:287508
Started
2026-11-08T11:24:12Z
Ended
2026-11-08T11:26:35Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
885 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
229.7 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3786/load_day/2025-04-14/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:24:12Z [load_day 2025-04-14] attempt 1 started
2026-11-08T11:24:13Z [load_day 2025-04-14] 2025-04-14: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:24:22Z [load_day 2025-04-14] 2025-04-14 hour 0: 183065 events in 0 files, snapshot none (task 7854 ms: download 4370 ms overlapping gunzip 1241 ms, parse 5208 ms, sort 0 ms, write 0 ms, index 748 ms: 12 candidates, 83645 repo-hours, 1414 releases; waiting 348 ms; commit 0 ms)
2026-11-08T11:24:22Z [load_day 2025-04-14] 2025-04-14 hour 1: 222941 events in 0 files, snapshot none (task 8387 ms: download 4806 ms overlapping gunzip 1261 ms, parse 5347 ms, sort 0 ms, write 0 ms, index 915 ms: 6 candidates, 122007 repo-hours, 1204 releases; waiting 515 ms; commit 0 ms)
2026-11-08T11:24:30Z [load_day 2025-04-14] 2025-04-14 hour 2: 196309 events in 0 files, snapshot none (task 7719 ms: download 4758 ms overlapping gunzip 1240 ms, parse 5041 ms, sort 0 ms, write 0 ms, index 733 ms: 6 candidates, 86605 repo-hours, 950 releases; waiting 484 ms; commit 0 ms)
2026-11-08T11:24:31Z [load_day 2025-04-14] 2025-04-14 hour 3: 209724 events in 0 files, snapshot none (task 8268 ms: download 5548 ms overlapping gunzip 1308 ms, parse 5386 ms, sort 0 ms, write 0 ms, index 762 ms: 5 candidates, 87242 repo-hours, 3014 releases; waiting 515 ms; commit 0 ms)
2026-11-08T11:24:39Z [load_day 2025-04-14] 2025-04-14 hour 4: 194028 events in 0 files, snapshot none (task 8315 ms: download 5346 ms overlapping gunzip 1244 ms, parse 5113 ms, sort 0 ms, write 0 ms, index 604 ms: 3 candidates, 72624 repo-hours, 806 releases; waiting 993 ms; commit 0 ms)
2026-11-08T11:24:40Z [load_day 2025-04-14] 2025-04-14 hour 5: 207659 events in 0 files, snapshot none (task 8401 ms: download 5858 ms overlapping gunzip 1366 ms, parse 5563 ms, sort 0 ms, write 0 ms, index 695 ms: 7 candidates, 79525 repo-hours, 921 releases; waiting 542 ms; commit 0 ms)
2026-11-08T11:24:50Z [load_day 2025-04-14] 2025-04-14 hour 6: 235429 events in 0 files, snapshot none (task 10570 ms: download 6451 ms overlapping gunzip 1705 ms, parse 6851 ms, sort 0 ms, write 0 ms, index 1183 ms: 8 candidates, 103998 repo-hours, 1123 releases; waiting 611 ms; commit 0 ms)
2026-11-08T11:24:51Z [load_day 2025-04-14] 2025-04-14 hour 7: 242762 events in 0 files, snapshot none (task 10679 ms: download 7939 ms overlapping gunzip 1857 ms, parse 7419 ms, sort 0 ms, write 0 ms, index 718 ms: 11 candidates, 98357 repo-hours, 1105 releases; waiting 452 ms; commit 0 ms)
2026-11-08T11:25:02Z [load_day 2025-04-14] 2025-04-14 hour 8: 248958 events in 0 files, snapshot none (task 11325 ms: download 8142 ms overlapping gunzip 1779 ms, parse 7361 ms, sort 0 ms, write 0 ms, index 1154 ms: 8 candidates, 106352 repo-hours, 1262 releases; waiting 534 ms; commit 0 ms)
2026-11-08T11:25:04Z [load_day 2025-04-14] 2025-04-14 hour 9: 260429 events in 0 files, snapshot none (task 11717 ms: download 8369 ms overlapping gunzip 1913 ms, parse 7896 ms, sort 0 ms, write 0 ms, index 1147 ms: 10 candidates, 109366 repo-hours, 1343 releases; waiting 465 ms; commit 0 ms)
2026-11-08T11:25:13Z [load_day 2025-04-14] 2025-04-14 hour 10: 251472 events in 0 files, snapshot none (task 10992 ms: download 7666 ms overlapping gunzip 1767 ms, parse 7347 ms, sort 0 ms, write 0 ms, index 1011 ms: 14 candidates, 104085 repo-hours, 1283 releases; waiting 521 ms; commit 0 ms)
2026-11-08T11:25:15Z [load_day 2025-04-14] 2025-04-14 hour 11: 253106 events in 0 files, snapshot none (task 10624 ms: download 7718 ms overlapping gunzip 1772 ms, parse 7331 ms, sort 0 ms, write 0 ms, index 905 ms: 6 candidates, 101633 repo-hours, 1185 releases; waiting 263 ms; commit 0 ms)
2026-11-08T11:25:24Z [load_day 2025-04-14] 2025-04-14 hour 12: 281854 events in 0 files, snapshot none (task 10322 ms: download 7483 ms overlapping gunzip 1609 ms, parse 6884 ms, sort 0 ms, write 0 ms, index 997 ms: 11 candidates, 142535 repo-hours, 1373 releases; waiting 552 ms; commit 0 ms)
2026-11-08T11:25:26Z [load_day 2025-04-14] 2025-04-14 hour 13: 273125 events in 0 files, snapshot none (task 10354 ms: download 7583 ms overlapping gunzip 1788 ms, parse 6998 ms, sort 0 ms, write 0 ms, index 929 ms: 5 candidates, 130140 repo-hours, 1511 releases; waiting 313 ms; commit 0 ms)
2026-11-08T11:25:33Z [load_day 2025-04-14] 2025-04-14 hour 14: 268791 events in 0 files, snapshot none (task 8897 ms: download 6360 ms overlapping gunzip 1466 ms, parse 5789 ms, sort 0 ms, write 0 ms, index 816 ms: 12 candidates, 114686 repo-hours, 1431 releases; waiting 563 ms; commit 0 ms)
2026-11-08T11:25:35Z [load_day 2025-04-14] 2025-04-14 hour 15: 268415 events in 0 files, snapshot none (task 9021 ms: download 6405 ms overlapping gunzip 1482 ms, parse 5932 ms, sort 0 ms, write 0 ms, index 867 ms: 14 candidates, 118107 repo-hours, 1553 releases; waiting 515 ms; commit 0 ms)
2026-11-08T11:25:46Z [load_day 2025-04-14] 2025-04-14 hour 16: 260207 events in 0 files, snapshot none (task 11523 ms: download 8522 ms overlapping gunzip 1910 ms, parse 7739 ms, sort 0 ms, write 0 ms, index 834 ms: 8 candidates, 111437 repo-hours, 1299 releases; waiting 685 ms; commit 0 ms)
2026-11-08T11:25:47Z [load_day 2025-04-14] 2025-04-14 hour 17: 254771 events in 0 files, snapshot none (task 11182 ms: download 8527 ms overlapping gunzip 1940 ms, parse 7630 ms, sort 0 ms, write 0 ms, index 816 ms: 10 candidates, 104105 repo-hours, 1273 releases; waiting 477 ms; commit 0 ms)
2026-11-08T11:25:59Z [load_day 2025-04-14] 2025-04-14 hour 18: 264761 events in 0 files, snapshot none (task 12458 ms: download 9353 ms overlapping gunzip 2064 ms, parse 8232 ms, sort 0 ms, write 0 ms, index 1369 ms: 5 candidates, 119392 repo-hours, 1430 releases; waiting 555 ms; commit 0 ms)
2026-11-08T11:25:59Z [load_day 2025-04-14] 2025-04-14 hour 19: 245779 events in 0 files, snapshot none (task 10739 ms: download 8065 ms overlapping gunzip 1815 ms, parse 7162 ms, sort 0 ms, write 0 ms, index 965 ms: 5 candidates, 100259 repo-hours, 1247 releases; waiting 504 ms; commit 0 ms)
2026-11-08T11:26:09Z [load_day 2025-04-14] 2025-04-14 hour 20: 239476 events in 0 files, snapshot none (task 10046 ms: download 7170 ms overlapping gunzip 1722 ms, parse 6571 ms, sort 0 ms, write 0 ms, index 898 ms: 13 candidates, 98036 repo-hours, 1183 releases; waiting 587 ms; commit 0 ms)
2026-11-08T11:26:10Z [load_day 2025-04-14] 2025-04-14 hour 21: 225700 events in 0 files, snapshot none (task 10509 ms: download 7579 ms overlapping gunzip 1815 ms, parse 6927 ms, sort 0 ms, write 0 ms, index 863 ms: 1 candidates, 89865 repo-hours, 1308 releases; waiting 525 ms; commit 0 ms)
2026-11-08T11:26:21Z [load_day 2025-04-14] 2025-04-14 hour 22: 210468 events in 0 files, snapshot none (task 11259 ms: download 8598 ms overlapping gunzip 1399 ms, parse 5705 ms, sort 0 ms, write 0 ms, index 634 ms: 1 candidates, 81022 repo-hours, 1099 releases; waiting 3198 ms; commit 0 ms)
2026-11-08T11:26:21Z [load_day 2025-04-14] 2025-04-14 hour 23: 200292 events in 0 files, snapshot none (task 8177 ms: download 5236 ms overlapping gunzip 1299 ms, parse 5313 ms, sort 0 ms, write 0 ms, index 709 ms: 10 candidates, 76661 repo-hours, 1178 releases; waiting 545 ms; commit 0 ms)
2026-11-08T11:26:32Z [load_day 2025-04-14] 2025-04-14: repo_hour merged from 24 files to 1 (2441684 rows, 10947 ms)
2026-11-08T11:26:35Z [load_day 2025-04-14] 2025-04-14: index committed in 13989 ms (24 + 1 + 24 files)
2026-11-08T11:26:35Z [load_day 2025-04-14] 2025-04-14: 5699521 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:26:35Z [load_day 2025-04-14] attempt 1 succeeded