orcaLog in

Runs · run 2385

load_day 2024-04-28, attempt 1 succeeded

Host
73ccef5e07c2:115551
Started
2026-11-08T05:50:19Z
Ended
2026-11-08T05:51:43Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
647 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
124.4 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2385/load_day/2024-04-28/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:50:19Z [load_day 2024-04-28] attempt 1 started
2026-11-08T05:50:20Z [load_day 2024-04-28] 2024-04-28: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:50:26Z [load_day 2024-04-28] 2024-04-28 hour 0: 168824 events in 0 files, snapshot none (task 5828 ms: download 2989 ms overlapping gunzip 764 ms, parse 3543 ms, sort 0 ms, write 0 ms, index 727 ms: 6 candidates, 77395 repo-hours, 1043 releases; waiting 509 ms; commit 0 ms)
2026-11-08T05:50:26Z [load_day 2024-04-28] 2024-04-28 hour 1: 171464 events in 0 files, snapshot none (task 5654 ms: download 2198 ms overlapping gunzip 723 ms, parse 3152 ms, sort 0 ms, write 0 ms, index 1163 ms: 5 candidates, 89413 repo-hours, 782 releases; waiting 272 ms; commit 0 ms)
2026-11-08T05:50:32Z [load_day 2024-04-28] 2024-04-28 hour 2: 153616 events in 0 files, snapshot none (task 4965 ms: download 2316 ms overlapping gunzip 638 ms, parse 2852 ms, sort 0 ms, write 0 ms, index 661 ms: 4 candidates, 51900 repo-hours, 859 releases; waiting 497 ms; commit 0 ms)
2026-11-08T05:50:32Z [load_day 2024-04-28] 2024-04-28 hour 3: 146096 events in 0 files, snapshot none (task 5097 ms: download 2968 ms overlapping gunzip 710 ms, parse 3020 ms, sort 0 ms, write 0 ms, index 524 ms: 4 candidates, 56651 repo-hours, 2151 releases; waiting 585 ms; commit 0 ms)
2026-11-08T05:50:37Z [load_day 2024-04-28] 2024-04-28 hour 4: 131530 events in 0 files, snapshot none (task 4474 ms: download 2091 ms overlapping gunzip 568 ms, parse 2504 ms, sort 0 ms, write 0 ms, index 592 ms: 5 candidates, 47328 repo-hours, 558 releases; waiting 509 ms; commit 0 ms)
2026-11-08T05:50:37Z [load_day 2024-04-28] 2024-04-28 hour 5: 141033 events in 0 files, snapshot none (task 4773 ms: download 2181 ms overlapping gunzip 681 ms, parse 2879 ms, sort 0 ms, write 0 ms, index 415 ms: 6 candidates, 51924 repo-hours, 745 releases; waiting 507 ms; commit 0 ms)
2026-11-08T05:50:42Z [load_day 2024-04-28] 2024-04-28 hour 6: 167210 events in 0 files, snapshot none (task 4327 ms: download 2185 ms overlapping gunzip 570 ms, parse 2497 ms, sort 0 ms, write 0 ms, index 507 ms: 5 candidates, 67089 repo-hours, 832 releases; waiting 503 ms; commit 0 ms)
2026-11-08T05:50:42Z [load_day 2024-04-28] 2024-04-28 hour 7: 163342 events in 0 files, snapshot none (task 4512 ms: download 2162 ms overlapping gunzip 597 ms, parse 2701 ms, sort 0 ms, write 0 ms, index 427 ms: 2 candidates, 59684 repo-hours, 838 releases; waiting 504 ms; commit 0 ms)
2026-11-08T05:50:47Z [load_day 2024-04-28] 2024-04-28 hour 8: 175497 events in 0 files, snapshot none (task 4993 ms: download 2994 ms overlapping gunzip 669 ms, parse 2955 ms, sort 0 ms, write 0 ms, index 416 ms: 3 candidates, 63023 repo-hours, 676 releases; waiting 650 ms; commit 0 ms)
2026-11-08T05:50:47Z [load_day 2024-04-28] 2024-04-28 hour 9: 177378 events in 0 files, snapshot none (task 4709 ms: download 3615 ms overlapping gunzip 622 ms, parse 2772 ms, sort 0 ms, write 0 ms, index 527 ms: 5 candidates, 67655 repo-hours, 848 releases; waiting 546 ms; commit 0 ms)
2026-11-08T05:50:53Z [load_day 2024-04-28] 2024-04-28 hour 10: 172469 events in 0 files, snapshot none (task 4979 ms: download 2679 ms overlapping gunzip 619 ms, parse 2778 ms, sort 0 ms, write 0 ms, index 1007 ms: 10 candidates, 65858 repo-hours, 845 releases; waiting 346 ms; commit 0 ms)
2026-11-08T05:50:53Z [load_day 2024-04-28] 2024-04-28 hour 11: 165717 events in 0 files, snapshot none (task 4932 ms: download 3559 ms overlapping gunzip 607 ms, parse 2718 ms, sort 0 ms, write 0 ms, index 654 ms: 3 candidates, 62634 repo-hours, 743 releases; waiting 632 ms; commit 0 ms)
2026-11-08T05:51:00Z [load_day 2024-04-28] 2024-04-28 hour 12: 236685 events in 0 files, snapshot none (task 6605 ms: download 3673 ms overlapping gunzip 888 ms, parse 4164 ms, sort 0 ms, write 0 ms, index 687 ms: 9 candidates, 100910 repo-hours, 862 releases; waiting 516 ms; commit 0 ms)
2026-11-08T05:51:00Z [load_day 2024-04-28] 2024-04-28 hour 13: 195483 events in 0 files, snapshot none (task 6281 ms: download 3667 ms overlapping gunzip 850 ms, parse 3945 ms, sort 0 ms, write 0 ms, index 672 ms: 10 candidates, 88677 repo-hours, 771 releases; waiting 478 ms; commit 0 ms)
2026-11-08T05:51:06Z [load_day 2024-04-28] 2024-04-28 hour 14: 187726 events in 0 files, snapshot none (task 6252 ms: download 3618 ms overlapping gunzip 975 ms, parse 3985 ms, sort 0 ms, write 0 ms, index 568 ms: 6 candidates, 71440 repo-hours, 851 releases; waiting 480 ms; commit 0 ms)
2026-11-08T05:51:07Z [load_day 2024-04-28] 2024-04-28 hour 15: 197847 events in 0 files, snapshot none (task 6836 ms: download 4129 ms overlapping gunzip 947 ms, parse 4500 ms, sort 0 ms, write 0 ms, index 584 ms: 9 candidates, 76116 repo-hours, 1062 releases; waiting 528 ms; commit 0 ms)
2026-11-08T05:51:14Z [load_day 2024-04-28] 2024-04-28 hour 16: 188133 events in 0 files, snapshot none (task 6517 ms: download 3550 ms overlapping gunzip 917 ms, parse 4069 ms, sort 0 ms, write 0 ms, index 813 ms: 8 candidates, 72077 repo-hours, 868 releases; waiting 520 ms; commit 0 ms)
2026-11-08T05:51:14Z [load_day 2024-04-28] 2024-04-28 hour 17: 181618 events in 0 files, snapshot none (task 6577 ms: download 3498 ms overlapping gunzip 897 ms, parse 4263 ms, sort 0 ms, write 0 ms, index 588 ms: 7 candidates, 67242 repo-hours, 795 releases; waiting 502 ms; commit 0 ms)
2026-11-08T05:51:21Z [load_day 2024-04-28] 2024-04-28 hour 18: 198582 events in 0 files, snapshot none (task 6662 ms: download 3351 ms overlapping gunzip 972 ms, parse 4198 ms, sort 0 ms, write 0 ms, index 659 ms: 16 candidates, 79225 repo-hours, 959 releases; waiting 531 ms; commit 0 ms)
2026-11-08T05:51:21Z [load_day 2024-04-28] 2024-04-28 hour 19: 176231 events in 0 files, snapshot none (task 6612 ms: download 3505 ms overlapping gunzip 923 ms, parse 4310 ms, sort 0 ms, write 0 ms, index 463 ms: 11 candidates, 64030 repo-hours, 791 releases; waiting 568 ms; commit 0 ms)
2026-11-08T05:51:27Z [load_day 2024-04-28] 2024-04-28 hour 20: 174147 events in 0 files, snapshot none (task 5489 ms: download 2916 ms overlapping gunzip 746 ms, parse 3438 ms, sort 0 ms, write 0 ms, index 481 ms: 13 candidates, 62471 repo-hours, 828 releases; waiting 528 ms; commit 0 ms)
2026-11-08T05:51:27Z [load_day 2024-04-28] 2024-04-28 hour 21: 164426 events in 0 files, snapshot none (task 4927 ms: download 2585 ms overlapping gunzip 686 ms, parse 3029 ms, sort 0 ms, write 0 ms, index 435 ms: 7 candidates, 63777 repo-hours, 904 releases; waiting 486 ms; commit 0 ms)
2026-11-08T05:51:33Z [load_day 2024-04-28] 2024-04-28 hour 22: 145067 events in 0 files, snapshot none (task 6134 ms: download 3041 ms overlapping gunzip 879 ms, parse 3887 ms, sort 0 ms, write 0 ms, index 531 ms: 8 candidates, 53505 repo-hours, 748 releases; waiting 488 ms; commit 0 ms)
2026-11-08T05:51:33Z [load_day 2024-04-28] 2024-04-28 hour 23: 143384 events in 0 files, snapshot none (task 5429 ms: download 2633 ms overlapping gunzip 692 ms, parse 3317 ms, sort 0 ms, write 0 ms, index 652 ms: 4 candidates, 49458 repo-hours, 709 releases; waiting 509 ms; commit 0 ms)
2026-11-08T05:51:41Z [load_day 2024-04-28] 2024-04-28: repo_hour merged from 24 files to 1 (1609482 rows, 7427 ms)
2026-11-08T05:51:43Z [load_day 2024-04-28] 2024-04-28: index committed in 9999 ms (24 + 1 + 24 files)
2026-11-08T05:51:43Z [load_day 2024-04-28] 2024-04-28: 4123505 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:51:43Z [load_day 2024-04-28] attempt 1 succeeded