orcaLog in

Runs · run 4251

load_day 2025-08-09, attempt 1 succeeded

Host
73ccef5e07c2:357957
Started
2026-11-08T13:18:17Z
Ended
2026-11-08T13:19:47Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
612 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
123.4 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4251/load_day/2025-08-09/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:18:17Z [load_day 2025-08-09] attempt 1 started
2026-11-08T13:18:18Z [load_day 2025-08-09] 2025-08-09: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:18:25Z [load_day 2025-08-09] 2025-08-09 hour 0: 145164 events in 0 files, snapshot none (task 6333 ms: download 3714 ms overlapping gunzip 1022 ms, parse 3964 ms, sort 0 ms, write 0 ms, index 477 ms: 5 candidates, 65109 repo-hours, 941 releases; waiting 474 ms; commit 0 ms)
2026-11-08T13:18:25Z [load_day 2025-08-09] 2025-08-09 hour 1: 152627 events in 0 files, snapshot none (task 6603 ms: download 3974 ms overlapping gunzip 1035 ms, parse 4235 ms, sort 0 ms, write 0 ms, index 589 ms: 5 candidates, 83707 repo-hours, 670 releases; waiting 531 ms; commit 0 ms)
2026-11-08T13:18:31Z [load_day 2025-08-09] 2025-08-09 hour 2: 139330 events in 0 files, snapshot none (task 5836 ms: download 3000 ms overlapping gunzip 938 ms, parse 3493 ms, sort 0 ms, write 0 ms, index 664 ms: 4 candidates, 62702 repo-hours, 680 releases; waiting 381 ms; commit 0 ms)
2026-11-08T13:18:31Z [load_day 2025-08-09] 2025-08-09 hour 3: 140617 events in 0 files, snapshot none (task 5767 ms: download 3106 ms overlapping gunzip 857 ms, parse 3540 ms, sort 0 ms, write 0 ms, index 582 ms: 6 candidates, 55534 repo-hours, 1697 releases; waiting 571 ms; commit 0 ms)
2026-11-08T13:18:38Z [load_day 2025-08-09] 2025-08-09 hour 4: 146597 events in 0 files, snapshot none (task 6469 ms: download 4033 ms overlapping gunzip 872 ms, parse 3414 ms, sort 0 ms, write 0 ms, index 603 ms: 4 candidates, 55327 repo-hours, 967 releases; waiting 1348 ms; commit 0 ms)
2026-11-08T13:18:38Z [load_day 2025-08-09] 2025-08-09 hour 5: 142845 events in 0 files, snapshot none (task 6751 ms: download 4050 ms overlapping gunzip 991 ms, parse 3884 ms, sort 0 ms, write 0 ms, index 553 ms: 3 candidates, 53452 repo-hours, 571 releases; waiting 1044 ms; commit 0 ms)
2026-11-08T13:18:44Z [load_day 2025-08-09] 2025-08-09 hour 6: 146699 events in 0 files, snapshot none (task 5492 ms: download 2892 ms overlapping gunzip 764 ms, parse 2937 ms, sort 0 ms, write 0 ms, index 834 ms: 2 candidates, 65397 repo-hours, 843 releases; waiting 634 ms; commit 0 ms)
2026-11-08T13:18:44Z [load_day 2025-08-09] 2025-08-09 hour 7: 145980 events in 0 files, snapshot none (task 5256 ms: download 2735 ms overlapping gunzip 796 ms, parse 3134 ms, sort 0 ms, write 0 ms, index 452 ms: 1 candidates, 56310 repo-hours, 733 releases; waiting 461 ms; commit 0 ms)
2026-11-08T13:18:51Z [load_day 2025-08-09] 2025-08-09 hour 8: 143450 events in 0 files, snapshot none (task 6474 ms: download 3634 ms overlapping gunzip 1047 ms, parse 4002 ms, sort 0 ms, write 0 ms, index 609 ms: 6 candidates, 59301 repo-hours, 658 releases; waiting 504 ms; commit 0 ms)
2026-11-08T13:18:51Z [load_day 2025-08-09] 2025-08-09 hour 9: 148003 events in 0 files, snapshot none (task 6341 ms: download 3659 ms overlapping gunzip 1042 ms, parse 4001 ms, sort 0 ms, write 0 ms, index 422 ms: 9 candidates, 60561 repo-hours, 789 releases; waiting 499 ms; commit 0 ms)
2026-11-08T13:18:59Z [load_day 2025-08-09] 2025-08-09 hour 10: 149136 events in 0 files, snapshot none (task 7818 ms: download 4206 ms overlapping gunzip 1261 ms, parse 5064 ms, sort 0 ms, write 0 ms, index 689 ms: 4 candidates, 60646 repo-hours, 751 releases; waiting 515 ms; commit 0 ms)
2026-11-08T13:18:59Z [load_day 2025-08-09] 2025-08-09 hour 11: 150858 events in 0 files, snapshot none (task 7958 ms: download 4643 ms overlapping gunzip 1330 ms, parse 5374 ms, sort 0 ms, write 0 ms, index 418 ms: 7 candidates, 57464 repo-hours, 637 releases; waiting 492 ms; commit 0 ms)
2026-11-08T13:19:07Z [load_day 2025-08-09] 2025-08-09 hour 12: 160711 events in 0 files, snapshot none (task 6997 ms: download 3641 ms overlapping gunzip 1119 ms, parse 4067 ms, sort 0 ms, write 0 ms, index 754 ms: 5 candidates, 84755 repo-hours, 631 releases; waiting 756 ms; commit 0 ms)
2026-11-08T13:19:07Z [load_day 2025-08-09] 2025-08-09 hour 13: 157660 events in 0 files, snapshot none (task 6964 ms: download 4068 ms overlapping gunzip 1058 ms, parse 4070 ms, sort 0 ms, write 0 ms, index 633 ms: 13 candidates, 75555 repo-hours, 684 releases; waiting 857 ms; commit 0 ms)
2026-11-08T13:19:12Z [load_day 2025-08-09] 2025-08-09 hour 14: 154291 events in 0 files, snapshot none (task 5520 ms: download 3385 ms overlapping gunzip 816 ms, parse 3165 ms, sort 0 ms, write 0 ms, index 484 ms: 5 candidates, 65742 repo-hours, 700 releases; waiting 591 ms; commit 0 ms)
2026-11-08T13:19:14Z [load_day 2025-08-09] 2025-08-09 hour 15: 156166 events in 0 files, snapshot none (task 6259 ms: download 3859 ms overlapping gunzip 763 ms, parse 2998 ms, sort 0 ms, write 0 ms, index 540 ms: 9 candidates, 68643 repo-hours, 853 releases; waiting 1633 ms; commit 0 ms)
2026-11-08T13:19:18Z [load_day 2025-08-09] 2025-08-09 hour 16: 152135 events in 0 files, snapshot none (task 4721 ms: download 2960 ms overlapping gunzip 688 ms, parse 2632 ms, sort 0 ms, write 0 ms, index 536 ms: 5 candidates, 66538 repo-hours, 742 releases; waiting 541 ms; commit 0 ms)
2026-11-08T13:19:19Z [load_day 2025-08-09] 2025-08-09 hour 17: 153900 events in 0 files, snapshot none (task 4874 ms: download 3355 ms overlapping gunzip 687 ms, parse 2665 ms, sort 0 ms, write 0 ms, index 498 ms: 5 candidates, 64114 repo-hours, 662 releases; waiting 572 ms; commit 0 ms)
2026-11-08T13:19:24Z [load_day 2025-08-09] 2025-08-09 hour 18: 152626 events in 0 files, snapshot none (task 5770 ms: download 3560 ms overlapping gunzip 842 ms, parse 3297 ms, sort 0 ms, write 0 ms, index 575 ms: 5 candidates, 69596 repo-hours, 731 releases; waiting 708 ms; commit 0 ms)
2026-11-08T13:19:25Z [load_day 2025-08-09] 2025-08-09 hour 19: 149741 events in 0 files, snapshot none (task 5683 ms: download 3405 ms overlapping gunzip 950 ms, parse 3372 ms, sort 0 ms, write 0 ms, index 459 ms: 11 candidates, 55823 repo-hours, 667 releases; waiting 591 ms; commit 0 ms)
2026-11-08T13:19:30Z [load_day 2025-08-09] 2025-08-09 hour 20: 146937 events in 0 files, snapshot none (task 5850 ms: download 3143 ms overlapping gunzip 895 ms, parse 3580 ms, sort 0 ms, write 0 ms, index 538 ms: 6 candidates, 57255 repo-hours, 640 releases; waiting 527 ms; commit 0 ms)
2026-11-08T13:19:31Z [load_day 2025-08-09] 2025-08-09 hour 21: 147572 events in 0 files, snapshot none (task 5369 ms: download 3371 ms overlapping gunzip 858 ms, parse 3323 ms, sort 0 ms, write 0 ms, index 446 ms: 5 candidates, 54308 repo-hours, 831 releases; waiting 475 ms; commit 0 ms)
2026-11-08T13:19:37Z [load_day 2025-08-09] 2025-08-09 hour 22: 137334 events in 0 files, snapshot none (task 5685 ms: download 3463 ms overlapping gunzip 867 ms, parse 3398 ms, sort 0 ms, write 0 ms, index 407 ms: 6 candidates, 49204 repo-hours, 756 releases; waiting 627 ms; commit 0 ms)
2026-11-08T13:19:37Z [load_day 2025-08-09] 2025-08-09 hour 23: 131854 events in 0 files, snapshot none (task 4515 ms: download 2259 ms overlapping gunzip 699 ms, parse 2872 ms, sort 0 ms, write 0 ms, index 446 ms: 3 candidates, 46973 repo-hours, 776 releases; waiting 278 ms; commit 0 ms)
2026-11-08T13:19:44Z [load_day 2025-08-09] 2025-08-09: repo_hour merged from 24 files to 1 (1494016 rows, 7041 ms)
2026-11-08T13:19:47Z [load_day 2025-08-09] 2025-08-09: index committed in 9948 ms (24 + 1 + 24 files)
2026-11-08T13:19:47Z [load_day 2025-08-09] 2025-08-09: 3552233 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:19:47Z [load_day 2025-08-09] attempt 1 succeeded