orcaLog in

Runs · run 3517

load_day 2025-02-04, attempt 1 succeeded

Host
73ccef5e07c2:248988
Started
2026-11-08T10:09:14Z
Ended
2026-11-08T10:11:28Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
889 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
206.3 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3517/load_day/2025-02-04/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:09:14Z [load_day 2025-02-04] attempt 1 started
2026-11-08T10:09:15Z [load_day 2025-02-04] 2025-02-04: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:09:24Z [load_day 2025-02-04] 2025-02-04 hour 0: 211114 events in 0 files, snapshot none (task 8102 ms: download 5200 ms overlapping gunzip 1287 ms, parse 5257 ms, sort 0 ms, write 0 ms, index 801 ms: 9 candidates, 99669 repo-hours, 1312 releases; waiting 505 ms; commit 0 ms)
2026-11-08T10:09:24Z [load_day 2025-02-04] 2025-02-04 hour 1: 227515 events in 0 files, snapshot none (task 7950 ms: download 5021 ms overlapping gunzip 1145 ms, parse 5074 ms, sort 0 ms, write 0 ms, index 935 ms: 9 candidates, 115455 repo-hours, 1075 releases; waiting 487 ms; commit 0 ms)
2026-11-08T10:09:33Z [load_day 2025-02-04] 2025-02-04 hour 2: 192989 events in 0 files, snapshot none (task 9082 ms: download 5404 ms overlapping gunzip 1372 ms, parse 5933 ms, sort 0 ms, write 0 ms, index 994 ms: 8 candidates, 82442 repo-hours, 1052 releases; waiting 500 ms; commit 0 ms)
2026-11-08T10:09:33Z [load_day 2025-02-04] 2025-02-04 hour 3: 201996 events in 0 files, snapshot none (task 9095 ms: download 5806 ms overlapping gunzip 1452 ms, parse 6074 ms, sort 0 ms, write 0 ms, index 824 ms: 7 candidates, 78058 repo-hours, 4083 releases; waiting 507 ms; commit 0 ms)
2026-11-08T10:09:41Z [load_day 2025-02-04] 2025-02-04 hour 4: 187930 events in 0 files, snapshot none (task 7441 ms: download 3771 ms overlapping gunzip 1143 ms, parse 4721 ms, sort 0 ms, write 0 ms, index 705 ms: 7 candidates, 70334 repo-hours, 823 releases; waiting 516 ms; commit 0 ms)
2026-11-08T10:09:42Z [load_day 2025-02-04] 2025-02-04 hour 5: 188769 events in 0 files, snapshot none (task 7830 ms: download 4376 ms overlapping gunzip 1146 ms, parse 5094 ms, sort 0 ms, write 0 ms, index 826 ms: 3 candidates, 72461 repo-hours, 963 releases; waiting 510 ms; commit 0 ms)
2026-11-08T10:09:51Z [load_day 2025-02-04] 2025-02-04 hour 6: 210875 events in 0 files, snapshot none (task 8916 ms: download 5962 ms overlapping gunzip 1427 ms, parse 5831 ms, sort 0 ms, write 0 ms, index 744 ms: 7 candidates, 91708 repo-hours, 1259 releases; waiting 515 ms; commit 0 ms)
2026-11-08T10:09:51Z [load_day 2025-02-04] 2025-02-04 hour 7: 212353 events in 0 files, snapshot none (task 9090 ms: download 6223 ms overlapping gunzip 1524 ms, parse 5986 ms, sort 0 ms, write 0 ms, index 590 ms: 4 candidates, 81430 repo-hours, 1233 releases; waiting 505 ms; commit 0 ms)
2026-11-08T10:10:02Z [load_day 2025-02-04] 2025-02-04 hour 8: 230160 events in 0 files, snapshot none (task 11291 ms: download 7858 ms overlapping gunzip 1773 ms, parse 7817 ms, sort 0 ms, write 0 ms, index 972 ms: 6 candidates, 93472 repo-hours, 1110 releases; waiting 380 ms; commit 0 ms)
2026-11-08T10:10:03Z [load_day 2025-02-04] 2025-02-04 hour 9: 253628 events in 0 files, snapshot none (task 11492 ms: download 8262 ms overlapping gunzip 1834 ms, parse 7924 ms, sort 0 ms, write 0 ms, index 824 ms: 9 candidates, 102192 repo-hours, 1590 releases; waiting 467 ms; commit 0 ms)
2026-11-08T10:10:14Z [load_day 2025-02-04] 2025-02-04 hour 10: 249088 events in 0 files, snapshot none (task 10770 ms: download 7779 ms overlapping gunzip 1687 ms, parse 7445 ms, sort 0 ms, write 0 ms, index 789 ms: 5 candidates, 98449 repo-hours, 1524 releases; waiting 589 ms; commit 0 ms)
2026-11-08T10:10:14Z [load_day 2025-02-04] 2025-02-04 hour 11: 241566 events in 0 files, snapshot none (task 10453 ms: download 7610 ms overlapping gunzip 1754 ms, parse 7175 ms, sort 0 ms, write 0 ms, index 714 ms: 4 candidates, 93798 repo-hours, 1282 releases; waiting 537 ms; commit 0 ms)
2026-11-08T10:10:25Z [load_day 2025-02-04] 2025-02-04 hour 12: 281608 events in 0 files, snapshot none (task 10660 ms: download 7438 ms overlapping gunzip 1599 ms, parse 7241 ms, sort 0 ms, write 0 ms, index 1060 ms: 13 candidates, 140359 repo-hours, 1569 releases; waiting 461 ms; commit 0 ms)
2026-11-08T10:10:25Z [load_day 2025-02-04] 2025-02-04 hour 13: 269308 events in 0 files, snapshot none (task 10191 ms: download 7378 ms overlapping gunzip 1596 ms, parse 7124 ms, sort 0 ms, write 0 ms, index 845 ms: 12 candidates, 123109 repo-hours, 1304 releases; waiting 382 ms; commit 0 ms)
2026-11-08T10:10:34Z [load_day 2025-02-04] 2025-02-04 hour 14: 260087 events in 0 files, snapshot none (task 8360 ms: download 5727 ms overlapping gunzip 1356 ms, parse 5370 ms, sort 0 ms, write 0 ms, index 810 ms: 18 candidates, 109132 repo-hours, 1412 releases; waiting 533 ms; commit 0 ms)
2026-11-08T10:10:34Z [load_day 2025-02-04] 2025-02-04 hour 15: 263329 events in 0 files, snapshot none (task 8423 ms: download 5800 ms overlapping gunzip 1324 ms, parse 5674 ms, sort 0 ms, write 0 ms, index 846 ms: 12 candidates, 114496 repo-hours, 1701 releases; waiting 306 ms; commit 0 ms)
2026-11-08T10:10:43Z [load_day 2025-02-04] 2025-02-04 hour 16: 261553 events in 0 files, snapshot none (task 8721 ms: download 5958 ms overlapping gunzip 1404 ms, parse 5799 ms, sort 0 ms, write 0 ms, index 846 ms: 7 candidates, 111422 repo-hours, 1586 releases; waiting 371 ms; commit 0 ms)
2026-11-08T10:10:43Z [load_day 2025-02-04] 2025-02-04 hour 17: 248227 events in 0 files, snapshot none (task 8413 ms: download 5916 ms overlapping gunzip 1261 ms, parse 5118 ms, sort 0 ms, write 0 ms, index 784 ms: 12 candidates, 103218 repo-hours, 1399 releases; waiting 948 ms; commit 0 ms)
2026-11-08T10:10:55Z [load_day 2025-02-04] 2025-02-04 hour 18: 262019 events in 0 files, snapshot none (task 11419 ms: download 8610 ms overlapping gunzip 1820 ms, parse 7463 ms, sort 0 ms, write 0 ms, index 1080 ms: 7 candidates, 114864 repo-hours, 1486 releases; waiting 827 ms; commit 0 ms)
2026-11-08T10:10:55Z [load_day 2025-02-04] 2025-02-04 hour 19: 233095 events in 0 files, snapshot none (task 10043 ms: download 7426 ms overlapping gunzip 1555 ms, parse 7066 ms, sort 0 ms, write 0 ms, index 698 ms: 9 candidates, 91789 repo-hours, 1304 releases; waiting 470 ms; commit 0 ms)
2026-11-08T10:11:05Z [load_day 2025-02-04] 2025-02-04 hour 20: 229906 events in 0 files, snapshot none (task 9963 ms: download 6148 ms overlapping gunzip 1625 ms, parse 6497 ms, sort 0 ms, write 0 ms, index 1145 ms: 15 candidates, 91868 repo-hours, 1150 releases; waiting 360 ms; commit 0 ms)
2026-11-08T10:11:05Z [load_day 2025-02-04] 2025-02-04 hour 21: 225444 events in 0 files, snapshot none (task 9886 ms: download 6534 ms overlapping gunzip 1573 ms, parse 6658 ms, sort 0 ms, write 0 ms, index 873 ms: 5 candidates, 90506 repo-hours, 1374 releases; waiting 497 ms; commit 0 ms)
2026-11-08T10:11:14Z [load_day 2025-02-04] 2025-02-04 hour 22: 207660 events in 0 files, snapshot none (task 8421 ms: download 5216 ms overlapping gunzip 1378 ms, parse 5459 ms, sort 0 ms, write 0 ms, index 895 ms: 5 candidates, 78879 repo-hours, 1399 releases; waiting 480 ms; commit 0 ms)
2026-11-08T10:11:14Z [load_day 2025-02-04] 2025-02-04 hour 23: 187087 events in 0 files, snapshot none (task 7908 ms: download 4059 ms overlapping gunzip 1213 ms, parse 5073 ms, sort 0 ms, write 0 ms, index 869 ms: 11 candidates, 70213 repo-hours, 1084 releases; waiting 479 ms; commit 0 ms)
2026-11-08T10:11:25Z [load_day 2025-02-04] 2025-02-04: repo_hour merged from 24 files to 1 (2319323 rows, 10386 ms)
2026-11-08T10:11:28Z [load_day 2025-02-04] 2025-02-04: index committed in 13514 ms (24 + 1 + 24 files)
2026-11-08T10:11:28Z [load_day 2025-02-04] 2025-02-04: 5537306 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:11:28Z [load_day 2025-02-04] attempt 1 succeeded