orcaLog in

Runs · run 4308

load_day 2025-08-24, attempt 1 succeeded

Host
73ccef5e07c2:366561
Started
2026-11-08T13:31:58Z
Ended
2026-11-08T13:33:30Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
647 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
116.7 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4308/load_day/2025-08-24/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:31:58Z [load_day 2025-08-24] attempt 1 started
2026-11-08T13:31:59Z [load_day 2025-08-24] 2025-08-24: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:32:04Z [load_day 2025-08-24] 2025-08-24 hour 0: 145539 events in 0 files, snapshot none (task 4717 ms: download 2362 ms overlapping gunzip 683 ms, parse 2845 ms, sort 0 ms, write 0 ms, index 433 ms: 12 candidates, 57842 repo-hours, 983 releases; waiting 506 ms; commit 0 ms)
2026-11-08T13:32:04Z [load_day 2025-08-24] 2025-08-24 hour 1: 158748 events in 0 files, snapshot none (task 4732 ms: download 2041 ms overlapping gunzip 641 ms, parse 2897 ms, sort 0 ms, write 0 ms, index 573 ms: 2 candidates, 78346 repo-hours, 685 releases; waiting 299 ms; commit 0 ms)
2026-11-08T13:32:09Z [load_day 2025-08-24] 2025-08-24 hour 2: 146828 events in 0 files, snapshot none (task 4484 ms: download 2147 ms overlapping gunzip 608 ms, parse 2560 ms, sort 0 ms, write 0 ms, index 447 ms: 2 candidates, 58884 repo-hours, 692 releases; waiting 493 ms; commit 0 ms)
2026-11-08T13:32:10Z [load_day 2025-08-24] 2025-08-24 hour 3: 144240 events in 0 files, snapshot none (task 4929 ms: download 2844 ms overlapping gunzip 601 ms, parse 2614 ms, sort 0 ms, write 0 ms, index 398 ms: 7 candidates, 51506 repo-hours, 1794 releases; waiting 1066 ms; commit 0 ms)
2026-11-08T13:32:16Z [load_day 2025-08-24] 2025-08-24 hour 4: 146713 events in 0 files, snapshot none (task 6672 ms: download 3286 ms overlapping gunzip 973 ms, parse 4368 ms, sort 0 ms, write 0 ms, index 613 ms: 4 candidates, 51385 repo-hours, 585 releases; waiting 464 ms; commit 0 ms)
2026-11-08T13:32:16Z [load_day 2025-08-24] 2025-08-24 hour 5: 151531 events in 0 files, snapshot none (task 6357 ms: download 2937 ms overlapping gunzip 1027 ms, parse 4322 ms, sort 0 ms, write 0 ms, index 497 ms: 4 candidates, 51596 repo-hours, 569 releases; waiting 266 ms; commit 0 ms)
2026-11-08T13:32:23Z [load_day 2025-08-24] 2025-08-24 hour 6: 156135 events in 0 files, snapshot none (task 6231 ms: download 3340 ms overlapping gunzip 906 ms, parse 3947 ms, sort 0 ms, write 0 ms, index 595 ms: 5 candidates, 60924 repo-hours, 628 releases; waiting 525 ms; commit 0 ms)
2026-11-08T13:32:23Z [load_day 2025-08-24] 2025-08-24 hour 7: 157672 events in 0 files, snapshot none (task 6301 ms: download 3192 ms overlapping gunzip 977 ms, parse 4145 ms, sort 0 ms, write 0 ms, index 570 ms: 6 candidates, 54001 repo-hours, 512 releases; waiting 370 ms; commit 0 ms)
2026-11-08T13:32:29Z [load_day 2025-08-24] 2025-08-24 hour 8: 159037 events in 0 files, snapshot none (task 5674 ms: download 2305 ms overlapping gunzip 838 ms, parse 3587 ms, sort 0 ms, write 0 ms, index 721 ms: 5 candidates, 57568 repo-hours, 519 releases; waiting 232 ms; commit 0 ms)
2026-11-08T13:32:30Z [load_day 2025-08-24] 2025-08-24 hour 9: 159601 events in 0 files, snapshot none (task 6059 ms: download 2817 ms overlapping gunzip 946 ms, parse 3818 ms, sort 0 ms, write 0 ms, index 557 ms: 7 candidates, 57840 repo-hours, 720 releases; waiting 468 ms; commit 0 ms)
2026-11-08T13:32:37Z [load_day 2025-08-24] 2025-08-24 hour 10: 160807 events in 0 files, snapshot none (task 6816 ms: download 3621 ms overlapping gunzip 943 ms, parse 3821 ms, sort 0 ms, write 0 ms, index 699 ms: 5 candidates, 59607 repo-hours, 630 releases; waiting 1109 ms; commit 0 ms)
2026-11-08T13:32:37Z [load_day 2025-08-24] 2025-08-24 hour 11: 160075 events in 0 files, snapshot none (task 5830 ms: download 2467 ms overlapping gunzip 837 ms, parse 3559 ms, sort 0 ms, write 0 ms, index 631 ms: 9 candidates, 56341 repo-hours, 567 releases; waiting 537 ms; commit 0 ms)
2026-11-08T13:32:44Z [load_day 2025-08-24] 2025-08-24 hour 12: 172807 events in 0 files, snapshot none (task 6423 ms: download 3112 ms overlapping gunzip 827 ms, parse 3512 ms, sort 0 ms, write 0 ms, index 1470 ms: 4 candidates, 84839 repo-hours, 618 releases; waiting 337 ms; commit 0 ms)
2026-11-08T13:32:44Z [load_day 2025-08-24] 2025-08-24 hour 13: 158609 events in 0 files, snapshot none (task 6390 ms: download 2968 ms overlapping gunzip 854 ms, parse 3651 ms, sort 0 ms, write 0 ms, index 1123 ms: 7 candidates, 75988 repo-hours, 634 releases; waiting 502 ms; commit 0 ms)
2026-11-08T13:32:50Z [load_day 2025-08-24] 2025-08-24 hour 14: 154358 events in 0 files, snapshot none (task 6130 ms: download 3688 ms overlapping gunzip 916 ms, parse 3857 ms, sort 0 ms, write 0 ms, index 663 ms: 3 candidates, 70171 repo-hours, 749 releases; waiting 452 ms; commit 0 ms)
2026-11-08T13:32:50Z [load_day 2025-08-24] 2025-08-24 hour 15: 154319 events in 0 files, snapshot none (task 5999 ms: download 3518 ms overlapping gunzip 886 ms, parse 3754 ms, sort 0 ms, write 0 ms, index 608 ms: 5 candidates, 70792 repo-hours, 796 releases; waiting 457 ms; commit 0 ms)
2026-11-08T13:32:58Z [load_day 2025-08-24] 2025-08-24 hour 16: 156576 events in 0 files, snapshot none (task 6783 ms: download 4042 ms overlapping gunzip 1008 ms, parse 4087 ms, sort 0 ms, write 0 ms, index 548 ms: 7 candidates, 70840 repo-hours, 767 releases; waiting 867 ms; commit 0 ms)
2026-11-08T13:32:58Z [load_day 2025-08-24] 2025-08-24 hour 17: 155459 events in 0 files, snapshot none (task 6395 ms: download 3926 ms overlapping gunzip 1096 ms, parse 4119 ms, sort 0 ms, write 0 ms, index 618 ms: 9 candidates, 67551 repo-hours, 663 releases; waiting 255 ms; commit 0 ms)
2026-11-08T13:33:06Z [load_day 2025-08-24] 2025-08-24 hour 18: 155885 events in 0 files, snapshot none (task 7708 ms: download 4494 ms overlapping gunzip 1314 ms, parse 4823 ms, sort 0 ms, write 0 ms, index 774 ms: 9 candidates, 75157 repo-hours, 917 releases; waiting 538 ms; commit 0 ms)
2026-11-08T13:33:06Z [load_day 2025-08-24] 2025-08-24 hour 19: 150979 events in 0 files, snapshot none (task 6640 ms: download 3666 ms overlapping gunzip 1226 ms, parse 4071 ms, sort 0 ms, write 0 ms, index 724 ms: 7 candidates, 60987 repo-hours, 829 releases; waiting 336 ms; commit 0 ms)
2026-11-08T13:33:13Z [load_day 2025-08-24] 2025-08-24 hour 20: 149787 events in 0 files, snapshot none (task 6567 ms: download 3287 ms overlapping gunzip 1113 ms, parse 4138 ms, sort 0 ms, write 0 ms, index 503 ms: 5 candidates, 61495 repo-hours, 830 releases; waiting 512 ms; commit 0 ms)
2026-11-08T13:33:13Z [load_day 2025-08-24] 2025-08-24 hour 21: 143243 events in 0 files, snapshot none (task 5419 ms: download 2709 ms overlapping gunzip 789 ms, parse 3033 ms, sort 0 ms, write 0 ms, index 731 ms: 5 candidates, 57731 repo-hours, 829 releases; waiting 517 ms; commit 0 ms)
2026-11-08T13:33:19Z [load_day 2025-08-24] 2025-08-24 hour 22: 135377 events in 0 files, snapshot none (task 5228 ms: download 2727 ms overlapping gunzip 809 ms, parse 3262 ms, sort 0 ms, write 0 ms, index 380 ms: 9 candidates, 54227 repo-hours, 775 releases; waiting 505 ms; commit 0 ms)
2026-11-08T13:33:19Z [load_day 2025-08-24] 2025-08-24 hour 23: 139186 events in 0 files, snapshot none (task 5421 ms: download 3516 ms overlapping gunzip 689 ms, parse 2984 ms, sort 0 ms, write 0 ms, index 382 ms: 5 candidates, 55138 repo-hours, 741 releases; waiting 927 ms; commit 0 ms)
2026-11-08T13:33:27Z [load_day 2025-08-24] 2025-08-24: repo_hour merged from 24 files to 1 (1500756 rows, 7478 ms)
2026-11-08T13:33:30Z [load_day 2025-08-24] 2025-08-24: index committed in 11117 ms (24 + 1 + 24 files)
2026-11-08T13:33:30Z [load_day 2025-08-24] 2025-08-24: 3673511 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:33:30Z [load_day 2025-08-24] attempt 1 succeeded