orcaLog in

Runs · run 3588

load_day 2025-02-21, attempt 1 succeeded

Host
73ccef5e07c2:258999
Started
2026-11-08T10:27:53Z
Ended
2026-11-08T10:29:58Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
902 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
198.5 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3588/load_day/2025-02-21/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:27:53Z [load_day 2025-02-21] attempt 1 started
2026-11-08T10:27:54Z [load_day 2025-02-21] 2025-02-21: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:28:03Z [load_day 2025-02-21] 2025-02-21 hour 0: 216730 events in 0 files, snapshot none (task 8448 ms: download 5258 ms overlapping gunzip 1273 ms, parse 5566 ms, sort 0 ms, write 0 ms, index 878 ms: 11 candidates, 100208 repo-hours, 1264 releases; waiting 502 ms; commit 0 ms)
2026-11-08T10:28:04Z [load_day 2025-02-21] 2025-02-21 hour 1: 229627 events in 0 files, snapshot none (task 9068 ms: download 4977 ms overlapping gunzip 1372 ms, parse 5713 ms, sort 0 ms, write 0 ms, index 1152 ms: 7 candidates, 123511 repo-hours, 954 releases; waiting 565 ms; commit 0 ms)
2026-11-08T10:28:12Z [load_day 2025-02-21] 2025-02-21 hour 2: 198108 events in 0 files, snapshot none (task 7792 ms: download 4385 ms overlapping gunzip 1068 ms, parse 4337 ms, sort 0 ms, write 0 ms, index 874 ms: 9 candidates, 88106 repo-hours, 941 releases; waiting 1216 ms; commit 0 ms)
2026-11-08T10:28:12Z [load_day 2025-02-21] 2025-02-21 hour 3: 215989 events in 0 files, snapshot none (task 7528 ms: download 3814 ms overlapping gunzip 1143 ms, parse 4543 ms, sort 0 ms, write 0 ms, index 1127 ms: 7 candidates, 86460 repo-hours, 3949 releases; waiting 433 ms; commit 0 ms)
2026-11-08T10:28:19Z [load_day 2025-02-21] 2025-02-21 hour 4: 197500 events in 0 files, snapshot none (task 6816 ms: download 3943 ms overlapping gunzip 1082 ms, parse 4655 ms, sort 0 ms, write 0 ms, index 566 ms: 3 candidates, 72871 repo-hours, 901 releases; waiting 286 ms; commit 0 ms)
2026-11-08T10:28:20Z [load_day 2025-02-21] 2025-02-21 hour 5: 202410 events in 0 files, snapshot none (task 6925 ms: download 4338 ms overlapping gunzip 1093 ms, parse 4394 ms, sort 0 ms, write 0 ms, index 701 ms: 5 candidates, 77655 repo-hours, 796 releases; waiting 480 ms; commit 0 ms)
2026-11-08T10:28:28Z [load_day 2025-02-21] 2025-02-21 hour 6: 238618 events in 0 files, snapshot none (task 8717 ms: download 5904 ms overlapping gunzip 1400 ms, parse 5808 ms, sort 0 ms, write 0 ms, index 706 ms: 4 candidates, 102061 repo-hours, 1012 releases; waiting 497 ms; commit 0 ms)
2026-11-08T10:28:29Z [load_day 2025-02-21] 2025-02-21 hour 7: 237983 events in 0 files, snapshot none (task 8613 ms: download 6060 ms overlapping gunzip 1340 ms, parse 5746 ms, sort 0 ms, write 0 ms, index 770 ms: 10 candidates, 90567 repo-hours, 1056 releases; waiting 502 ms; commit 0 ms)
2026-11-08T10:28:37Z [load_day 2025-02-21] 2025-02-21 hour 8: 249299 events in 0 files, snapshot none (task 7778 ms: download 5196 ms overlapping gunzip 1232 ms, parse 4918 ms, sort 0 ms, write 0 ms, index 741 ms: 10 candidates, 100544 repo-hours, 1209 releases; waiting 581 ms; commit 0 ms)
2026-11-08T10:28:37Z [load_day 2025-02-21] 2025-02-21 hour 9: 261573 events in 0 files, snapshot none (task 8277 ms: download 5654 ms overlapping gunzip 1262 ms, parse 5329 ms, sort 0 ms, write 0 ms, index 778 ms: 10 candidates, 109463 repo-hours, 1462 releases; waiting 639 ms; commit 0 ms)
2026-11-08T10:28:45Z [load_day 2025-02-21] 2025-02-21 hour 10: 249509 events in 0 files, snapshot none (task 7264 ms: download 4544 ms overlapping gunzip 1148 ms, parse 4770 ms, sort 0 ms, write 0 ms, index 889 ms: 10 candidates, 103818 repo-hours, 1250 releases; waiting 172 ms; commit 0 ms)
2026-11-08T10:28:45Z [load_day 2025-02-21] 2025-02-21 hour 11: 241494 events in 0 files, snapshot none (task 7537 ms: download 4697 ms overlapping gunzip 1161 ms, parse 4655 ms, sort 0 ms, write 0 ms, index 910 ms: 10 candidates, 97759 repo-hours, 1180 releases; waiting 540 ms; commit 0 ms)
2026-11-08T10:28:55Z [load_day 2025-02-21] 2025-02-21 hour 12: 278460 events in 0 files, snapshot none (task 9941 ms: download 5734 ms overlapping gunzip 1377 ms, parse 6188 ms, sort 0 ms, write 0 ms, index 1531 ms: 6 candidates, 139598 repo-hours, 1198 releases; waiting 513 ms; commit 0 ms)
2026-11-08T10:28:55Z [load_day 2025-02-21] 2025-02-21 hour 13: 266594 events in 0 files, snapshot none (task 9026 ms: download 5328 ms overlapping gunzip 1317 ms, parse 5740 ms, sort 0 ms, write 0 ms, index 1520 ms: 12 candidates, 120902 repo-hours, 1271 releases; waiting 186 ms; commit 0 ms)
2026-11-08T10:29:05Z [load_day 2025-02-21] 2025-02-21 hour 14: 261433 events in 0 files, snapshot none (task 9779 ms: download 6959 ms overlapping gunzip 1452 ms, parse 6593 ms, sort 0 ms, write 0 ms, index 863 ms: 7 candidates, 108801 repo-hours, 1282 releases; waiting 560 ms; commit 0 ms)
2026-11-08T10:29:05Z [load_day 2025-02-21] 2025-02-21 hour 15: 266780 events in 0 files, snapshot none (task 9780 ms: download 7009 ms overlapping gunzip 1569 ms, parse 6518 ms, sort 0 ms, write 0 ms, index 832 ms: 14 candidates, 117185 repo-hours, 1453 releases; waiting 520 ms; commit 0 ms)
2026-11-08T10:29:17Z [load_day 2025-02-21] 2025-02-21 hour 16: 259351 events in 0 files, snapshot none (task 10819 ms: download 7435 ms overlapping gunzip 1679 ms, parse 7070 ms, sort 0 ms, write 0 ms, index 1470 ms: 9 candidates, 110662 repo-hours, 1287 releases; waiting 279 ms; commit 0 ms)
2026-11-08T10:29:17Z [load_day 2025-02-21] 2025-02-21 hour 17: 252047 events in 0 files, snapshot none (task 10639 ms: download 7165 ms overlapping gunzip 1564 ms, parse 6954 ms, sort 0 ms, write 0 ms, index 1502 ms: 14 candidates, 103454 repo-hours, 1115 releases; waiting 392 ms; commit 0 ms)
2026-11-08T10:29:27Z [load_day 2025-02-21] 2025-02-21 hour 18: 250711 events in 0 files, snapshot none (task 9552 ms: download 6547 ms overlapping gunzip 1483 ms, parse 6101 ms, sort 0 ms, write 0 ms, index 822 ms: 8 candidates, 111594 repo-hours, 1169 releases; waiting 853 ms; commit 0 ms)
2026-11-08T10:29:27Z [load_day 2025-02-21] 2025-02-21 hour 19: 234121 events in 0 files, snapshot none (task 9231 ms: download 6261 ms overlapping gunzip 1420 ms, parse 6165 ms, sort 0 ms, write 0 ms, index 703 ms: 11 candidates, 90461 repo-hours, 1090 releases; waiting 504 ms; commit 0 ms)
2026-11-08T10:29:35Z [load_day 2025-02-21] 2025-02-21 hour 20: 217585 events in 0 files, snapshot none (task 8001 ms: download 5296 ms overlapping gunzip 1215 ms, parse 5298 ms, sort 0 ms, write 0 ms, index 676 ms: 8 candidates, 87674 repo-hours, 1087 releases; waiting 522 ms; commit 0 ms)
2026-11-08T10:29:36Z [load_day 2025-02-21] 2025-02-21 hour 21: 220271 events in 0 files, snapshot none (task 8287 ms: download 5670 ms overlapping gunzip 1251 ms, parse 5501 ms, sort 0 ms, write 0 ms, index 664 ms: 10 candidates, 87581 repo-hours, 1180 releases; waiting 521 ms; commit 0 ms)
2026-11-08T10:29:45Z [load_day 2025-02-21] 2025-02-21 hour 22: 208540 events in 0 files, snapshot none (task 8920 ms: download 6419 ms overlapping gunzip 1359 ms, parse 5554 ms, sort 0 ms, write 0 ms, index 586 ms: 9 candidates, 78680 repo-hours, 1148 releases; waiting 984 ms; commit 0 ms)
2026-11-08T10:29:45Z [load_day 2025-02-21] 2025-02-21 hour 23: 195963 events in 0 files, snapshot none (task 8091 ms: download 5249 ms overlapping gunzip 1255 ms, parse 5392 ms, sort 0 ms, write 0 ms, index 601 ms: 3 candidates, 72876 repo-hours, 1047 releases; waiting 524 ms; commit 0 ms)
2026-11-08T10:29:55Z [load_day 2025-02-21] 2025-02-21: repo_hour merged from 24 files to 1 (2382491 rows, 10481 ms)
2026-11-08T10:29:58Z [load_day 2025-02-21] 2025-02-21: index committed in 13033 ms (24 + 1 + 24 files)
2026-11-08T10:29:58Z [load_day 2025-02-21] 2025-02-21: 5650696 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:29:58Z [load_day 2025-02-21] attempt 1 succeeded