orcaLog in

Runs · run 3540

load_day 2025-02-09, attempt 1 succeeded

Host
73ccef5e07c2:252273
Started
2026-11-08T10:15:07Z
Ended
2026-11-08T10:16:45Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
811 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
140.0 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3540/load_day/2025-02-09/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:15:07Z [load_day 2025-02-09] attempt 1 started
2026-11-08T10:15:08Z [load_day 2025-02-09] 2025-02-09: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:15:13Z [load_day 2025-02-09] 2025-02-09 hour 0: 172710 events in 0 files, snapshot none (task 5037 ms: download 2472 ms overlapping gunzip 656 ms, parse 2990 ms, sort 0 ms, write 0 ms, index 580 ms: 3 candidates, 84690 repo-hours, 1332 releases; waiting 517 ms; commit 0 ms)
2026-11-08T10:15:13Z [load_day 2025-02-09] 2025-02-09 hour 1: 191345 events in 0 files, snapshot none (task 5150 ms: download 2508 ms overlapping gunzip 660 ms, parse 3021 ms, sort 0 ms, write 0 ms, index 755 ms: 9 candidates, 107198 repo-hours, 1017 releases; waiting 487 ms; commit 0 ms)
2026-11-08T10:15:18Z [load_day 2025-02-09] 2025-02-09 hour 2: 152449 events in 0 files, snapshot none (task 4174 ms: download 2224 ms overlapping gunzip 538 ms, parse 2267 ms, sort 0 ms, write 0 ms, index 517 ms: 4 candidates, 65611 repo-hours, 697 releases; waiting 606 ms; commit 0 ms)
2026-11-08T10:15:18Z [load_day 2025-02-09] 2025-02-09 hour 3: 177453 events in 0 files, snapshot none (task 4363 ms: download 2649 ms overlapping gunzip 553 ms, parse 2472 ms, sort 0 ms, write 0 ms, index 525 ms: 2 candidates, 65867 repo-hours, 3841 releases; waiting 526 ms; commit 0 ms)
2026-11-08T10:15:24Z [load_day 2025-02-09] 2025-02-09 hour 4: 166133 events in 0 files, snapshot none (task 5476 ms: download 2725 ms overlapping gunzip 790 ms, parse 3335 ms, sort 0 ms, write 0 ms, index 627 ms: 5 candidates, 56454 repo-hours, 636 releases; waiting 492 ms; commit 0 ms)
2026-11-08T10:15:25Z [load_day 2025-02-09] 2025-02-09 hour 5: 170065 events in 0 files, snapshot none (task 6098 ms: download 2873 ms overlapping gunzip 886 ms, parse 3753 ms, sort 0 ms, write 0 ms, index 628 ms: 5 candidates, 59248 repo-hours, 661 releases; waiting 512 ms; commit 0 ms)
2026-11-08T10:15:30Z [load_day 2025-02-09] 2025-02-09 hour 6: 188233 events in 0 files, snapshot none (task 5507 ms: download 2770 ms overlapping gunzip 702 ms, parse 3181 ms, sort 0 ms, write 0 ms, index 829 ms: 4 candidates, 78166 repo-hours, 1002 releases; waiting 496 ms; commit 0 ms)
2026-11-08T10:15:31Z [load_day 2025-02-09] 2025-02-09 hour 7: 176485 events in 0 files, snapshot none (task 5094 ms: download 2872 ms overlapping gunzip 644 ms, parse 2791 ms, sort 0 ms, write 0 ms, index 821 ms: 3 candidates, 60989 repo-hours, 640 releases; waiting 507 ms; commit 0 ms)
2026-11-08T10:15:37Z [load_day 2025-02-09] 2025-02-09 hour 8: 187487 events in 0 files, snapshot none (task 6841 ms: download 4020 ms overlapping gunzip 1040 ms, parse 4440 ms, sort 0 ms, write 0 ms, index 531 ms: 5 candidates, 67874 repo-hours, 775 releases; waiting 493 ms; commit 0 ms)
2026-11-08T10:15:37Z [load_day 2025-02-09] 2025-02-09 hour 9: 205807 events in 0 files, snapshot none (task 6150 ms: download 3706 ms overlapping gunzip 986 ms, parse 3997 ms, sort 0 ms, write 0 ms, index 630 ms: 5 candidates, 76848 repo-hours, 961 releases; waiting 265 ms; commit 0 ms)
2026-11-08T10:15:45Z [load_day 2025-02-09] 2025-02-09 hour 10: 205985 events in 0 files, snapshot none (task 6990 ms: download 3968 ms overlapping gunzip 1059 ms, parse 4272 ms, sort 0 ms, write 0 ms, index 739 ms: 5 candidates, 80845 repo-hours, 821 releases; waiting 640 ms; commit 0 ms)
2026-11-08T10:15:45Z [load_day 2025-02-09] 2025-02-09 hour 11: 194723 events in 0 files, snapshot none (task 7017 ms: download 4232 ms overlapping gunzip 994 ms, parse 4620 ms, sort 0 ms, write 0 ms, index 635 ms: 5 candidates, 70125 repo-hours, 837 releases; waiting 474 ms; commit 0 ms)
2026-11-08T10:15:52Z [load_day 2025-02-09] 2025-02-09 hour 12: 265845 events in 0 files, snapshot none (task 7193 ms: download 3411 ms overlapping gunzip 908 ms, parse 4389 ms, sort 0 ms, write 0 ms, index 1185 ms: 12 candidates, 124722 repo-hours, 1231 releases; waiting 376 ms; commit 0 ms)
2026-11-08T10:15:53Z [load_day 2025-02-09] 2025-02-09 hour 13: 233504 events in 0 files, snapshot none (task 7622 ms: download 4188 ms overlapping gunzip 1170 ms, parse 4753 ms, sort 0 ms, write 0 ms, index 967 ms: 6 candidates, 103255 repo-hours, 906 releases; waiting 500 ms; commit 0 ms)
2026-11-08T10:16:02Z [load_day 2025-02-09] 2025-02-09 hour 14: 225122 events in 0 files, snapshot none (task 8692 ms: download 4650 ms overlapping gunzip 1268 ms, parse 5388 ms, sort 0 ms, write 0 ms, index 1010 ms: 10 candidates, 88059 repo-hours, 1050 releases; waiting 530 ms; commit 0 ms)
2026-11-08T10:16:02Z [load_day 2025-02-09] 2025-02-09 hour 15: 230836 events in 0 files, snapshot none (task 7640 ms: download 3632 ms overlapping gunzip 1056 ms, parse 4415 ms, sort 0 ms, write 0 ms, index 1261 ms: 6 candidates, 96479 repo-hours, 1178 releases; waiting 313 ms; commit 0 ms)
2026-11-08T10:16:09Z [load_day 2025-02-09] 2025-02-09 hour 16: 227329 events in 0 files, snapshot none (task 7175 ms: download 4268 ms overlapping gunzip 1150 ms, parse 4612 ms, sort 0 ms, write 0 ms, index 839 ms: 7 candidates, 90016 repo-hours, 1125 releases; waiting 213 ms; commit 0 ms)
2026-11-08T10:16:09Z [load_day 2025-02-09] 2025-02-09 hour 17: 225681 events in 0 files, snapshot none (task 7290 ms: download 4240 ms overlapping gunzip 1072 ms, parse 4442 ms, sort 0 ms, write 0 ms, index 968 ms: 12 candidates, 84286 repo-hours, 992 releases; waiting 496 ms; commit 0 ms)
2026-11-08T10:16:20Z [load_day 2025-02-09] 2025-02-09 hour 18: 233907 events in 0 files, snapshot none (task 9923 ms: download 5762 ms overlapping gunzip 1499 ms, parse 6581 ms, sort 0 ms, write 0 ms, index 1046 ms: 5 candidates, 99276 repo-hours, 1261 releases; waiting 469 ms; commit 0 ms)
2026-11-08T10:16:20Z [load_day 2025-02-09] 2025-02-09 hour 19: 203580 events in 0 files, snapshot none (task 8873 ms: download 4768 ms overlapping gunzip 1203 ms, parse 5900 ms, sort 0 ms, write 0 ms, index 1106 ms: 5 candidates, 75295 repo-hours, 909 releases; waiting 329 ms; commit 0 ms)
2026-11-08T10:16:28Z [load_day 2025-02-09] 2025-02-09 hour 20: 203142 events in 0 files, snapshot none (task 7487 ms: download 3537 ms overlapping gunzip 1112 ms, parse 4849 ms, sort 0 ms, write 0 ms, index 738 ms: 7 candidates, 76481 repo-hours, 1069 releases; waiting 509 ms; commit 0 ms)
2026-11-08T10:16:28Z [load_day 2025-02-09] 2025-02-09 hour 21: 201819 events in 0 files, snapshot none (task 7194 ms: download 3770 ms overlapping gunzip 1022 ms, parse 4383 ms, sort 0 ms, write 0 ms, index 979 ms: 5 candidates, 77592 repo-hours, 1117 releases; waiting 603 ms; commit 0 ms)
2026-11-08T10:16:34Z [load_day 2025-02-09] 2025-02-09 hour 22: 181076 events in 0 files, snapshot none (task 6287 ms: download 4017 ms overlapping gunzip 963 ms, parse 3927 ms, sort 0 ms, write 0 ms, index 578 ms: 6 candidates, 66445 repo-hours, 1097 releases; waiting 529 ms; commit 0 ms)
2026-11-08T10:16:34Z [load_day 2025-02-09] 2025-02-09 hour 23: 169328 events in 0 files, snapshot none (task 5856 ms: download 3285 ms overlapping gunzip 863 ms, parse 3866 ms, sort 0 ms, write 0 ms, index 461 ms: 6 candidates, 60960 repo-hours, 998 releases; waiting 447 ms; commit 0 ms)
2026-11-08T10:16:43Z [load_day 2025-02-09] 2025-02-09: repo_hour merged from 24 files to 1 (1916781 rows, 8699 ms)
2026-11-08T10:16:45Z [load_day 2025-02-09] 2025-02-09: index committed in 11243 ms (24 + 1 + 24 files)
2026-11-08T10:16:45Z [load_day 2025-02-09] 2025-02-09: 4790044 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:16:45Z [load_day 2025-02-09] attempt 1 succeeded