orcaLog in

Runs · run 3932

load_day 2025-05-22, attempt 1 succeeded

Host
73ccef5e07c2:309679
Started
2026-11-08T12:04:50Z
Ended
2026-11-08T12:07:11Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
780 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
211.4 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3932/load_day/2025-05-22/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:04:50Z [load_day 2025-05-22] attempt 1 started
2026-11-08T12:04:51Z [load_day 2025-05-22] 2025-05-22: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:05:00Z [load_day 2025-05-22] 2025-05-22 hour 0: 201915 events in 0 files, snapshot none (task 9128 ms: download 6439 ms overlapping gunzip 1130 ms, parse 4992 ms, sort 0 ms, write 0 ms, index 731 ms: 11 candidates, 94466 repo-hours, 1278 releases; waiting 1950 ms; commit 0 ms)
2026-11-08T12:05:00Z [load_day 2025-05-22] 2025-05-22 hour 1: 227929 events in 0 files, snapshot none (task 7670 ms: download 4426 ms overlapping gunzip 1106 ms, parse 4824 ms, sort 0 ms, write 0 ms, index 943 ms: 10 candidates, 125215 repo-hours, 1018 releases; waiting 482 ms; commit 0 ms)
2026-11-08T12:05:11Z [load_day 2025-05-22] 2025-05-22 hour 2: 201892 events in 0 files, snapshot none (task 10180 ms: download 5834 ms overlapping gunzip 1545 ms, parse 6222 ms, sort 0 ms, write 0 ms, index 1298 ms: 9 candidates, 92341 repo-hours, 940 releases; waiting 859 ms; commit 0 ms)
2026-11-08T12:05:11Z [load_day 2025-05-22] 2025-05-22 hour 3: 209088 events in 0 files, snapshot none (task 9615 ms: download 5268 ms overlapping gunzip 1456 ms, parse 6035 ms, sort 0 ms, write 0 ms, index 1288 ms: 8 candidates, 91636 repo-hours, 2934 releases; waiting 526 ms; commit 0 ms)
2026-11-08T12:05:21Z [load_day 2025-05-22] 2025-05-22 hour 4: 198604 events in 0 files, snapshot none (task 8939 ms: download 5945 ms overlapping gunzip 1170 ms, parse 5026 ms, sort 0 ms, write 0 ms, index 599 ms: 16 candidates, 78363 repo-hours, 926 releases; waiting 1813 ms; commit 0 ms)
2026-11-08T12:05:21Z [load_day 2025-05-22] 2025-05-22 hour 5: 205702 events in 0 files, snapshot none (task 8157 ms: download 4751 ms overlapping gunzip 1232 ms, parse 5002 ms, sort 0 ms, write 0 ms, index 1063 ms: 8 candidates, 82891 repo-hours, 848 releases; waiting 533 ms; commit 0 ms)
2026-11-08T12:05:30Z [load_day 2025-05-22] 2025-05-22 hour 6: 218239 events in 0 files, snapshot none (task 8818 ms: download 5882 ms overlapping gunzip 1390 ms, parse 5824 ms, sort 0 ms, write 0 ms, index 844 ms: 5 candidates, 100832 repo-hours, 990 releases; waiting 470 ms; commit 0 ms)
2026-11-08T12:05:31Z [load_day 2025-05-22] 2025-05-22 hour 7: 232620 events in 0 files, snapshot none (task 10277 ms: download 6944 ms overlapping gunzip 1523 ms, parse 6721 ms, sort 0 ms, write 0 ms, index 1226 ms: 13 candidates, 101264 repo-hours, 973 releases; waiting 457 ms; commit 0 ms)
2026-11-08T12:05:41Z [load_day 2025-05-22] 2025-05-22 hour 8: 239796 events in 0 files, snapshot none (task 10791 ms: download 7577 ms overlapping gunzip 1699 ms, parse 7405 ms, sort 0 ms, write 0 ms, index 811 ms: 7 candidates, 106422 repo-hours, 1179 releases; waiting 458 ms; commit 0 ms)
2026-11-08T12:05:43Z [load_day 2025-05-22] 2025-05-22 hour 9: 248264 events in 0 files, snapshot none (task 10356 ms: download 7749 ms overlapping gunzip 1784 ms, parse 7295 ms, sort 0 ms, write 0 ms, index 774 ms: 10 candidates, 111508 repo-hours, 1350 releases; waiting 204 ms; commit 0 ms)
2026-11-08T12:05:53Z [load_day 2025-05-22] 2025-05-22 hour 10: 252072 events in 0 files, snapshot none (task 10878 ms: download 7689 ms overlapping gunzip 1775 ms, parse 7429 ms, sort 0 ms, write 0 ms, index 768 ms: 3 candidates, 107385 repo-hours, 1237 releases; waiting 581 ms; commit 0 ms)
2026-11-08T12:05:54Z [load_day 2025-05-22] 2025-05-22 hour 11: 245716 events in 0 files, snapshot none (task 10481 ms: download 7380 ms overlapping gunzip 1690 ms, parse 7221 ms, sort 0 ms, write 0 ms, index 827 ms: 5 candidates, 101844 repo-hours, 1183 releases; waiting 419 ms; commit 0 ms)
2026-11-08T12:06:04Z [load_day 2025-05-22] 2025-05-22 hour 12: 261910 events in 0 files, snapshot none (task 11187 ms: download 7668 ms overlapping gunzip 1633 ms, parse 7336 ms, sort 0 ms, write 0 ms, index 1178 ms: 8 candidates, 140005 repo-hours, 1308 releases; waiting 614 ms; commit 0 ms)
2026-11-08T12:06:05Z [load_day 2025-05-22] 2025-05-22 hour 13: 250097 events in 0 files, snapshot none (task 10962 ms: download 7942 ms overlapping gunzip 1744 ms, parse 7564 ms, sort 0 ms, write 0 ms, index 893 ms: 0 candidates, 127127 repo-hours, 1168 releases; waiting 483 ms; commit 0 ms)
2026-11-08T12:06:17Z [load_day 2025-05-22] 2025-05-22 hour 14: 249078 events in 0 files, snapshot none (task 11958 ms: download 9280 ms overlapping gunzip 1970 ms, parse 8350 ms, sort 0 ms, write 0 ms, index 830 ms: 6 candidates, 114987 repo-hours, 1345 releases; waiting 503 ms; commit 0 ms)
2026-11-08T12:06:17Z [load_day 2025-05-22] 2025-05-22 hour 15: 256131 events in 0 files, snapshot none (task 11647 ms: download 8836 ms overlapping gunzip 1868 ms, parse 8063 ms, sort 0 ms, write 0 ms, index 853 ms: 9 candidates, 117216 repo-hours, 1378 releases; waiting 498 ms; commit 0 ms)
2026-11-08T12:06:26Z [load_day 2025-05-22] 2025-05-22 hour 16: 253413 events in 0 files, snapshot none (task 8762 ms: download 6047 ms overlapping gunzip 1287 ms, parse 5541 ms, sort 0 ms, write 0 ms, index 773 ms: 12 candidates, 111201 repo-hours, 1188 releases; waiting 788 ms; commit 0 ms)
2026-11-08T12:06:26Z [load_day 2025-05-22] 2025-05-22 hour 17: 241108 events in 0 files, snapshot none (task 8587 ms: download 6086 ms overlapping gunzip 1300 ms, parse 5303 ms, sort 0 ms, write 0 ms, index 727 ms: 13 candidates, 102848 repo-hours, 1270 releases; waiting 965 ms; commit 0 ms)
2026-11-08T12:06:36Z [load_day 2025-05-22] 2025-05-22 hour 18: 251294 events in 0 files, snapshot none (task 9508 ms: download 5695 ms overlapping gunzip 1460 ms, parse 6238 ms, sort 0 ms, write 0 ms, index 1136 ms: 6 candidates, 114136 repo-hours, 1263 releases; waiting 349 ms; commit 0 ms)
2026-11-08T12:06:37Z [load_day 2025-05-22] 2025-05-22 hour 19: 237957 events in 0 files, snapshot none (task 9759 ms: download 6336 ms overlapping gunzip 1586 ms, parse 6507 ms, sort 0 ms, write 0 ms, index 923 ms: 12 candidates, 95237 repo-hours, 1163 releases; waiting 485 ms; commit 0 ms)
2026-11-08T12:06:46Z [load_day 2025-05-22] 2025-05-22 hour 20: 236048 events in 0 files, snapshot none (task 9268 ms: download 5790 ms overlapping gunzip 1489 ms, parse 6151 ms, sort 0 ms, write 0 ms, index 1007 ms: 15 candidates, 95841 repo-hours, 1076 releases; waiting 390 ms; commit 0 ms)
2026-11-08T12:06:47Z [load_day 2025-05-22] 2025-05-22 hour 21: 221439 events in 0 files, snapshot none (task 9460 ms: download 6546 ms overlapping gunzip 1507 ms, parse 6541 ms, sort 0 ms, write 0 ms, index 643 ms: 18 candidates, 89853 repo-hours, 1387 releases; waiting 494 ms; commit 0 ms)
2026-11-08T12:06:55Z [load_day 2025-05-22] 2025-05-22 hour 22: 200355 events in 0 files, snapshot none (task 8903 ms: download 5849 ms overlapping gunzip 1446 ms, parse 6042 ms, sort 0 ms, write 0 ms, index 641 ms: 13 candidates, 78307 repo-hours, 1546 releases; waiting 513 ms; commit 0 ms)
2026-11-08T12:06:56Z [load_day 2025-05-22] 2025-05-22 hour 23: 194986 events in 0 files, snapshot none (task 8584 ms: download 5883 ms overlapping gunzip 1358 ms, parse 5836 ms, sort 0 ms, write 0 ms, index 582 ms: 14 candidates, 76558 repo-hours, 1597 releases; waiting 527 ms; commit 0 ms)
2026-11-08T12:07:07Z [load_day 2025-05-22] 2025-05-22: repo_hour merged from 24 files to 1 (2457483 rows, 11367 ms)
2026-11-08T12:07:11Z [load_day 2025-05-22] 2025-05-22: index committed in 14556 ms (23 + 1 + 24 files)
2026-11-08T12:07:11Z [load_day 2025-05-22] 2025-05-22: 5535653 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:07:11Z [load_day 2025-05-22] attempt 1 succeeded