orcaLog in

Runs · run 3543

load_day 2025-02-10, attempt 1 succeeded

Host
73ccef5e07c2:252424
Started
2026-11-08T10:15:18Z
Ended
2026-11-08T10:17:50Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
930 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
233.1 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3543/load_day/2025-02-10/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:15:18Z [load_day 2025-02-10] attempt 1 started
2026-11-08T10:15:19Z [load_day 2025-02-10] 2025-02-10: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:15:28Z [load_day 2025-02-10] 2025-02-10 hour 0: 202383 events in 0 files, snapshot none (task 8547 ms: download 5541 ms overlapping gunzip 1417 ms, parse 5291 ms, sort 0 ms, write 0 ms, index 800 ms: 9 candidates, 92982 repo-hours, 1187 releases; waiting 707 ms; commit 0 ms)
2026-11-08T10:15:28Z [load_day 2025-02-10] 2025-02-10 hour 1: 222350 events in 0 files, snapshot none (task 8285 ms: download 5506 ms overlapping gunzip 1367 ms, parse 5199 ms, sort 0 ms, write 0 ms, index 944 ms: 10 candidates, 117919 repo-hours, 979 releases; waiting 492 ms; commit 0 ms)
2026-11-08T10:15:37Z [load_day 2025-02-10] 2025-02-10 hour 2: 197225 events in 0 files, snapshot none (task 8462 ms: download 5478 ms overlapping gunzip 1460 ms, parse 5485 ms, sort 0 ms, write 0 ms, index 691 ms: 14 candidates, 83108 repo-hours, 836 releases; waiting 503 ms; commit 0 ms)
2026-11-08T10:15:37Z [load_day 2025-02-10] 2025-02-10 hour 3: 216173 events in 0 files, snapshot none (task 8450 ms: download 6015 ms overlapping gunzip 1409 ms, parse 5929 ms, sort 0 ms, write 0 ms, index 631 ms: 5 candidates, 82392 repo-hours, 3837 releases; waiting 271 ms; commit 0 ms)
2026-11-08T10:15:46Z [load_day 2025-02-10] 2025-02-10 hour 4: 207230 events in 0 files, snapshot none (task 8411 ms: download 5891 ms overlapping gunzip 1459 ms, parse 5421 ms, sort 0 ms, write 0 ms, index 616 ms: 5 candidates, 72152 repo-hours, 685 releases; waiting 590 ms; commit 0 ms)
2026-11-08T10:15:47Z [load_day 2025-02-10] 2025-02-10 hour 5: 218774 events in 0 files, snapshot none (task 9492 ms: download 6889 ms overlapping gunzip 1498 ms, parse 6240 ms, sort 0 ms, write 0 ms, index 793 ms: 7 candidates, 78855 repo-hours, 810 releases; waiting 607 ms; commit 0 ms)
2026-11-08T10:15:55Z [load_day 2025-02-10] 2025-02-10 hour 6: 235962 events in 0 files, snapshot none (task 8728 ms: download 5857 ms overlapping gunzip 1361 ms, parse 5551 ms, sort 0 ms, write 0 ms, index 968 ms: 8 candidates, 100927 repo-hours, 1139 releases; waiting 500 ms; commit 0 ms)
2026-11-08T10:15:57Z [load_day 2025-02-10] 2025-02-10 hour 7: 234374 events in 0 files, snapshot none (task 9497 ms: download 6412 ms overlapping gunzip 1578 ms, parse 6285 ms, sort 0 ms, write 0 ms, index 890 ms: 10 candidates, 88373 repo-hours, 886 releases; waiting 470 ms; commit 0 ms)
2026-11-08T10:16:07Z [load_day 2025-02-10] 2025-02-10 hour 8: 249619 events in 0 files, snapshot none (task 11686 ms: download 6948 ms overlapping gunzip 1923 ms, parse 7421 ms, sort 0 ms, write 0 ms, index 1474 ms: 8 candidates, 99729 repo-hours, 1062 releases; waiting 548 ms; commit 0 ms)
2026-11-08T10:16:09Z [load_day 2025-02-10] 2025-02-10 hour 9: 266084 events in 0 files, snapshot none (task 11845 ms: download 8825 ms overlapping gunzip 1935 ms, parse 7944 ms, sort 0 ms, write 0 ms, index 1172 ms: 9 candidates, 108522 repo-hours, 1464 releases; waiting 491 ms; commit 0 ms)
2026-11-08T10:16:21Z [load_day 2025-02-10] 2025-02-10 hour 10: 260537 events in 0 files, snapshot none (task 12985 ms: download 10122 ms overlapping gunzip 2271 ms, parse 9150 ms, sort 0 ms, write 0 ms, index 692 ms: 6 candidates, 103074 repo-hours, 1288 releases; waiting 484 ms; commit 0 ms)
2026-11-08T10:16:22Z [load_day 2025-02-10] 2025-02-10 hour 11: 251401 events in 0 files, snapshot none (task 11878 ms: download 9411 ms overlapping gunzip 2125 ms, parse 8255 ms, sort 0 ms, write 0 ms, index 747 ms: 9 candidates, 96966 repo-hours, 1240 releases; waiting 511 ms; commit 0 ms)
2026-11-08T10:16:33Z [load_day 2025-02-10] 2025-02-10 hour 12: 283901 events in 0 files, snapshot none (task 11697 ms: download 7404 ms overlapping gunzip 1893 ms, parse 7446 ms, sort 0 ms, write 0 ms, index 1607 ms: 9 candidates, 140197 repo-hours, 1389 releases; waiting 457 ms; commit 0 ms)
2026-11-08T10:16:34Z [load_day 2025-02-10] 2025-02-10 hour 13: 275926 events in 0 files, snapshot none (task 11632 ms: download 8640 ms overlapping gunzip 1974 ms, parse 7881 ms, sort 0 ms, write 0 ms, index 1006 ms: 8 candidates, 124636 repo-hours, 1319 releases; waiting 495 ms; commit 0 ms)
2026-11-08T10:16:47Z [load_day 2025-02-10] 2025-02-10 hour 14: 264931 events in 0 files, snapshot none (task 13309 ms: download 10586 ms overlapping gunzip 1568 ms, parse 6381 ms, sort 0 ms, write 0 ms, index 794 ms: 4 candidates, 111721 repo-hours, 1374 releases; waiting 4132 ms; commit 0 ms)
2026-11-08T10:16:47Z [load_day 2025-02-10] 2025-02-10 hour 15: 273029 events in 0 files, snapshot none (task 9347 ms: download 6449 ms overlapping gunzip 1520 ms, parse 6047 ms, sort 0 ms, write 0 ms, index 934 ms: 11 candidates, 115175 repo-hours, 1401 releases; waiting 534 ms; commit 0 ms)
2026-11-08T10:17:00Z [load_day 2025-02-10] 2025-02-10 hour 16: 263739 events in 0 files, snapshot none (task 12602 ms: download 9811 ms overlapping gunzip 2124 ms, parse 8486 ms, sort 0 ms, write 0 ms, index 883 ms: 18 candidates, 110941 repo-hours, 1210 releases; waiting 696 ms; commit 0 ms)
2026-11-08T10:17:00Z [load_day 2025-02-10] 2025-02-10 hour 17: 260781 events in 0 files, snapshot none (task 11500 ms: download 8641 ms overlapping gunzip 1882 ms, parse 7952 ms, sort 0 ms, write 0 ms, index 821 ms: 15 candidates, 106600 repo-hours, 1202 releases; waiting 513 ms; commit 0 ms)
2026-11-08T10:17:14Z [load_day 2025-02-10] 2025-02-10 hour 18: 265103 events in 0 files, snapshot none (task 13859 ms: download 9596 ms overlapping gunzip 2347 ms, parse 9778 ms, sort 0 ms, write 0 ms, index 1271 ms: 9 candidates, 117626 repo-hours, 1568 releases; waiting 178 ms; commit 0 ms)
2026-11-08T10:17:14Z [load_day 2025-02-10] 2025-02-10 hour 19: 244663 events in 0 files, snapshot none (task 13934 ms: download 9457 ms overlapping gunzip 2390 ms, parse 9728 ms, sort 0 ms, write 0 ms, index 1079 ms: 7 candidates, 94714 repo-hours, 1124 releases; waiting 487 ms; commit 0 ms)
2026-11-08T10:17:26Z [load_day 2025-02-10] 2025-02-10 hour 20: 245091 events in 0 files, snapshot none (task 10903 ms: download 7740 ms overlapping gunzip 1964 ms, parse 7580 ms, sort 0 ms, write 0 ms, index 769 ms: 12 candidates, 94490 repo-hours, 1148 releases; waiting 364 ms; commit 0 ms)
2026-11-08T10:17:26Z [load_day 2025-02-10] 2025-02-10 hour 21: 244231 events in 0 files, snapshot none (task 11024 ms: download 8204 ms overlapping gunzip 1867 ms, parse 7460 ms, sort 0 ms, write 0 ms, index 804 ms: 11 candidates, 94814 repo-hours, 1199 releases; waiting 593 ms; commit 0 ms)
2026-11-08T10:17:37Z [load_day 2025-02-10] 2025-02-10 hour 22: 223552 events in 0 files, snapshot none (task 10490 ms: download 7683 ms overlapping gunzip 1806 ms, parse 7009 ms, sort 0 ms, write 0 ms, index 723 ms: 15 candidates, 83532 repo-hours, 1178 releases; waiting 666 ms; commit 0 ms)
2026-11-08T10:17:37Z [load_day 2025-02-10] 2025-02-10 hour 23: 208716 events in 0 files, snapshot none (task 10198 ms: download 6956 ms overlapping gunzip 1728 ms, parse 6602 ms, sort 0 ms, write 0 ms, index 729 ms: 8 candidates, 76405 repo-hours, 1055 releases; waiting 497 ms; commit 0 ms)
2026-11-08T10:17:47Z [load_day 2025-02-10] 2025-02-10: repo_hour merged from 24 files to 1 (2395850 rows, 10415 ms)
2026-11-08T10:17:50Z [load_day 2025-02-10] 2025-02-10: index committed in 13575 ms (24 + 1 + 24 files)
2026-11-08T10:17:50Z [load_day 2025-02-10] 2025-02-10: 5815775 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:17:50Z [load_day 2025-02-10] attempt 1 succeeded