orcaLog in

Runs · run 4581

load_day 2025-11-05, attempt 1 succeeded

Host
73ccef5e07c2:401171
Started
2026-11-08T14:23:51Z
Ended
2026-11-08T14:24:57Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
688 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
73.1 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4581/load_day/2025-11-05/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:23:51Z [load_day 2025-11-05] attempt 1 started
2026-11-08T14:23:52Z [load_day 2025-11-05] 2025-11-05: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:23:57Z [load_day 2025-11-05] 2025-11-05 hour 0: 138878 events in 0 files, snapshot none (task 3544 ms: download 2503 ms overlapping gunzip 406 ms, parse 1366 ms, sort 0 ms, write 0 ms, index 539 ms: 5 candidates, 71845 repo-hours, 718 releases; waiting 941 ms; commit 0 ms)
2026-11-08T14:23:57Z [load_day 2025-11-05] 2025-11-05 hour 1: 147751 events in 0 files, snapshot none (task 3540 ms: download 2343 ms overlapping gunzip 411 ms, parse 1315 ms, sort 0 ms, write 0 ms, index 649 ms: 7 candidates, 89708 repo-hours, 650 releases; waiting 887 ms; commit 0 ms)
2026-11-08T14:24:03Z [load_day 2025-11-05] 2025-11-05 hour 2: 141621 events in 0 files, snapshot none (task 3826 ms: download 2136 ms overlapping gunzip 548 ms, parse 1721 ms, sort 0 ms, write 0 ms, index 564 ms: 8 candidates, 71244 repo-hours, 528 releases; waiting 343 ms; commit 0 ms)
2026-11-08T14:24:04Z [load_day 2025-11-05] 2025-11-05 hour 3: 143759 events in 0 files, snapshot none (task 4283 ms: download 2486 ms overlapping gunzip 496 ms, parse 1544 ms, sort 0 ms, write 0 ms, index 1247 ms: 5 candidates, 69849 repo-hours, 1523 releases; waiting 687 ms; commit 0 ms)
2026-11-08T14:24:07Z [load_day 2025-11-05] 2025-11-05 hour 4: 145843 events in 0 files, snapshot none (task 3465 ms: download 2027 ms overlapping gunzip 442 ms, parse 1412 ms, sort 0 ms, write 0 ms, index 552 ms: 6 candidates, 65073 repo-hours, 441 releases; waiting 672 ms; commit 0 ms)
2026-11-08T14:24:08Z [load_day 2025-11-05] 2025-11-05 hour 5: 143462 events in 0 files, snapshot none (task 3436 ms: download 1985 ms overlapping gunzip 516 ms, parse 1551 ms, sort 0 ms, write 0 ms, index 617 ms: 8 candidates, 66787 repo-hours, 472 releases; waiting 531 ms; commit 0 ms)
2026-11-08T14:24:11Z [load_day 2025-11-05] 2025-11-05 hour 6: 149683 events in 0 files, snapshot none (task 3306 ms: download 1908 ms overlapping gunzip 411 ms, parse 1306 ms, sort 0 ms, write 0 ms, index 849 ms: 5 candidates, 76491 repo-hours, 622 releases; waiting 488 ms; commit 0 ms)
2026-11-08T14:24:11Z [load_day 2025-11-05] 2025-11-05 hour 7: 145362 events in 0 files, snapshot none (task 3229 ms: download 1960 ms overlapping gunzip 481 ms, parse 1306 ms, sort 0 ms, write 0 ms, index 614 ms: 5 candidates, 71382 repo-hours, 507 releases; waiting 542 ms; commit 0 ms)
2026-11-08T14:24:15Z [load_day 2025-11-05] 2025-11-05 hour 8: 158785 events in 0 files, snapshot none (task 2748 ms: download 1845 ms overlapping gunzip 298 ms, parse 992 ms, sort 0 ms, write 0 ms, index 498 ms: 6 candidates, 62737 repo-hours, 278 releases; waiting 586 ms; commit 0 ms)
2026-11-08T14:24:16Z [load_day 2025-11-05] 2025-11-05 hour 9: 146436 events in 0 files, snapshot none (task 3958 ms: download 2691 ms overlapping gunzip 521 ms, parse 1548 ms, sort 0 ms, write 0 ms, index 645 ms: 4 candidates, 75036 repo-hours, 616 releases; waiting 919 ms; commit 0 ms)
2026-11-08T14:24:19Z [load_day 2025-11-05] 2025-11-05 hour 10: 146601 events in 0 files, snapshot none (task 3677 ms: download 2489 ms overlapping gunzip 416 ms, parse 1262 ms, sort 0 ms, write 0 ms, index 707 ms: 7 candidates, 76946 repo-hours, 634 releases; waiting 953 ms; commit 0 ms)
2026-11-08T14:24:20Z [load_day 2025-11-05] 2025-11-05 hour 11: 141138 events in 0 files, snapshot none (task 4038 ms: download 2830 ms overlapping gunzip 472 ms, parse 1380 ms, sort 0 ms, write 0 ms, index 640 ms: 5 candidates, 71633 repo-hours, 586 releases; waiting 1227 ms; commit 0 ms)
2026-11-08T14:24:22Z [load_day 2025-11-05] 2025-11-05 hour 12: 156133 events in 0 files, snapshot none (task 2926 ms: download 1739 ms overlapping gunzip 315 ms, parse 1010 ms, sort 0 ms, write 0 ms, index 672 ms: 10 candidates, 95460 repo-hours, 476 releases; waiting 587 ms; commit 0 ms)
2026-11-08T14:24:25Z [load_day 2025-11-05] 2025-11-05 hour 13: 149346 events in 0 files, snapshot none (task 4528 ms: download 3253 ms overlapping gunzip 353 ms, parse 1103 ms, sort 0 ms, write 0 ms, index 659 ms: 8 candidates, 89815 repo-hours, 427 releases; waiting 2118 ms; commit 0 ms)
2026-11-08T14:24:27Z [load_day 2025-11-05] 2025-11-05 hour 14: 145402 events in 0 files, snapshot none (task 4651 ms: download 2699 ms overlapping gunzip 474 ms, parse 1407 ms, sort 0 ms, write 0 ms, index 649 ms: 9 candidates, 80176 repo-hours, 561 releases; waiting 1789 ms; commit 0 ms)
2026-11-08T14:24:30Z [load_day 2025-11-05] 2025-11-05 hour 15: 149343 events in 0 files, snapshot none (task 4202 ms: download 2945 ms overlapping gunzip 372 ms, parse 1152 ms, sort 0 ms, write 0 ms, index 649 ms: 7 candidates, 82858 repo-hours, 598 releases; waiting 1624 ms; commit 0 ms)
2026-11-08T14:24:31Z [load_day 2025-11-05] 2025-11-05 hour 16: 146221 events in 0 files, snapshot none (task 3033 ms: download 1580 ms overlapping gunzip 380 ms, parse 1157 ms, sort 0 ms, write 0 ms, index 662 ms: 4 candidates, 79335 repo-hours, 664 releases; waiting 503 ms; commit 0 ms)
2026-11-08T14:24:34Z [load_day 2025-11-05] 2025-11-05 hour 17: 143569 events in 0 files, snapshot none (task 3410 ms: download 2156 ms overlapping gunzip 413 ms, parse 1265 ms, sort 0 ms, write 0 ms, index 586 ms: 7 candidates, 74748 repo-hours, 555 releases; waiting 799 ms; commit 0 ms)
2026-11-08T14:24:35Z [load_day 2025-11-05] 2025-11-05 hour 18: 145956 events in 0 files, snapshot none (task 3823 ms: download 2670 ms overlapping gunzip 404 ms, parse 1303 ms, sort 0 ms, write 0 ms, index 709 ms: 5 candidates, 80282 repo-hours, 731 releases; waiting 1097 ms; commit 0 ms)
2026-11-08T14:24:38Z [load_day 2025-11-05] 2025-11-05 hour 19: 146114 events in 0 files, snapshot none (task 3686 ms: download 2235 ms overlapping gunzip 460 ms, parse 1431 ms, sort 0 ms, write 0 ms, index 746 ms: 4 candidates, 73204 repo-hours, 575 releases; waiting 753 ms; commit 0 ms)
2026-11-08T14:24:39Z [load_day 2025-11-05] 2025-11-05 hour 20: 145588 events in 0 files, snapshot none (task 3261 ms: download 1862 ms overlapping gunzip 460 ms, parse 1371 ms, sort 0 ms, write 0 ms, index 634 ms: 6 candidates, 73316 repo-hours, 709 releases; waiting 495 ms; commit 0 ms)
2026-11-08T14:24:42Z [load_day 2025-11-05] 2025-11-05 hour 21: 145158 events in 0 files, snapshot none (task 3418 ms: download 1992 ms overlapping gunzip 505 ms, parse 1654 ms, sort 0 ms, write 0 ms, index 558 ms: 6 candidates, 68698 repo-hours, 788 releases; waiting 416 ms; commit 0 ms)
2026-11-08T14:24:43Z [load_day 2025-11-05] 2025-11-05 hour 22: 141889 events in 0 files, snapshot none (task 3581 ms: download 2441 ms overlapping gunzip 442 ms, parse 1397 ms, sort 0 ms, write 0 ms, index 551 ms: 3 candidates, 66445 repo-hours, 704 releases; waiting 772 ms; commit 0 ms)
2026-11-08T14:24:45Z [load_day 2025-11-05] 2025-11-05 hour 23: 141855 events in 0 files, snapshot none (task 3235 ms: download 2284 ms overlapping gunzip 433 ms, parse 1303 ms, sort 0 ms, write 0 ms, index 506 ms: 6 candidates, 65485 repo-hours, 741 releases; waiting 700 ms; commit 0 ms)
2026-11-08T14:24:54Z [load_day 2025-11-05] 2025-11-05: repo_hour merged from 24 files to 1 (1798553 rows, 8187 ms)
2026-11-08T14:24:57Z [load_day 2025-11-05] 2025-11-05: index committed in 11135 ms (24 + 1 + 24 files)
2026-11-08T14:24:57Z [load_day 2025-11-05] 2025-11-05: 3505893 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:24:57Z [load_day 2025-11-05] attempt 1 succeeded