orcaLog in

Runs · run 4280

load_day 2025-08-16, attempt 1 succeeded

Host
73ccef5e07c2:362253
Started
2026-11-08T13:24:40Z
Ended
2026-11-08T13:26:16Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
632 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
118.1 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4280/load_day/2025-08-16/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:24:40Z [load_day 2025-08-16] attempt 1 started
2026-11-08T13:24:41Z [load_day 2025-08-16] 2025-08-16: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:24:49Z [load_day 2025-08-16] 2025-08-16 hour 0: 139486 events in 0 files, snapshot none (task 7877 ms: download 4656 ms overlapping gunzip 1423 ms, parse 5275 ms, sort 0 ms, write 0 ms, index 515 ms: 9 candidates, 66987 repo-hours, 1169 releases; waiting 358 ms; commit 0 ms)
2026-11-08T13:24:49Z [load_day 2025-08-16] 2025-08-16 hour 1: 149790 events in 0 files, snapshot none (task 7576 ms: download 3342 ms overlapping gunzip 1182 ms, parse 4907 ms, sort 0 ms, write 0 ms, index 892 ms: 3 candidates, 86366 repo-hours, 738 releases; waiting 250 ms; commit 0 ms)
2026-11-08T13:24:56Z [load_day 2025-08-16] 2025-08-16 hour 2: 129901 events in 0 files, snapshot none (task 6439 ms: download 3797 ms overlapping gunzip 945 ms, parse 3919 ms, sort 0 ms, write 0 ms, index 784 ms: 5 candidates, 59335 repo-hours, 836 releases; waiting 530 ms; commit 0 ms)
2026-11-08T13:24:57Z [load_day 2025-08-16] 2025-08-16 hour 3: 139225 events in 0 files, snapshot none (task 6592 ms: download 3311 ms overlapping gunzip 924 ms, parse 4223 ms, sort 0 ms, write 0 ms, index 692 ms: 5 candidates, 60309 repo-hours, 2257 releases; waiting 484 ms; commit 0 ms)
2026-11-08T13:25:03Z [load_day 2025-08-16] 2025-08-16 hour 4: 136938 events in 0 files, snapshot none (task 5920 ms: download 3152 ms overlapping gunzip 872 ms, parse 3429 ms, sort 0 ms, write 0 ms, index 562 ms: 6 candidates, 56043 repo-hours, 741 releases; waiting 546 ms; commit 0 ms)
2026-11-08T13:25:03Z [load_day 2025-08-16] 2025-08-16 hour 5: 142146 events in 0 files, snapshot none (task 6616 ms: download 4432 ms overlapping gunzip 953 ms, parse 3763 ms, sort 0 ms, write 0 ms, index 449 ms: 3 candidates, 54687 repo-hours, 667 releases; waiting 1163 ms; commit 0 ms)
2026-11-08T13:25:09Z [load_day 2025-08-16] 2025-08-16 hour 6: 143367 events in 0 files, snapshot none (task 5631 ms: download 2643 ms overlapping gunzip 799 ms, parse 3272 ms, sort 0 ms, write 0 ms, index 672 ms: 7 candidates, 65537 repo-hours, 869 releases; waiting 362 ms; commit 0 ms)
2026-11-08T13:25:10Z [load_day 2025-08-16] 2025-08-16 hour 7: 145813 events in 0 files, snapshot none (task 5797 ms: download 2888 ms overlapping gunzip 938 ms, parse 3523 ms, sort 0 ms, write 0 ms, index 481 ms: 2 candidates, 59116 repo-hours, 845 releases; waiting 531 ms; commit 0 ms)
2026-11-08T13:25:14Z [load_day 2025-08-16] 2025-08-16 hour 8: 147477 events in 0 files, snapshot none (task 5019 ms: download 3656 ms overlapping gunzip 748 ms, parse 2851 ms, sort 0 ms, write 0 ms, index 455 ms: 4 candidates, 62772 repo-hours, 1062 releases; waiting 651 ms; commit 0 ms)
2026-11-08T13:25:15Z [load_day 2025-08-16] 2025-08-16 hour 9: 149643 events in 0 files, snapshot none (task 4847 ms: download 3148 ms overlapping gunzip 738 ms, parse 2670 ms, sort 0 ms, write 0 ms, index 454 ms: 7 candidates, 63561 repo-hours, 822 releases; waiting 712 ms; commit 0 ms)
2026-11-08T13:25:21Z [load_day 2025-08-16] 2025-08-16 hour 10: 149374 events in 0 files, snapshot none (task 6050 ms: download 4100 ms overlapping gunzip 663 ms, parse 2593 ms, sort 0 ms, write 0 ms, index 463 ms: 8 candidates, 63426 repo-hours, 727 releases; waiting 1999 ms; commit 0 ms)
2026-11-08T13:25:21Z [load_day 2025-08-16] 2025-08-16 hour 11: 146431 events in 0 files, snapshot none (task 4691 ms: download 3036 ms overlapping gunzip 610 ms, parse 2435 ms, sort 0 ms, write 0 ms, index 426 ms: 4 candidates, 58664 repo-hours, 619 releases; waiting 901 ms; commit 0 ms)
2026-11-08T13:25:26Z [load_day 2025-08-16] 2025-08-16 hour 12: 163004 events in 0 files, snapshot none (task 4773 ms: download 3234 ms overlapping gunzip 624 ms, parse 2562 ms, sort 0 ms, write 0 ms, index 629 ms: 8 candidates, 90058 repo-hours, 705 releases; waiting 567 ms; commit 0 ms)
2026-11-08T13:25:27Z [load_day 2025-08-16] 2025-08-16 hour 13: 163754 events in 0 files, snapshot none (task 5338 ms: download 3350 ms overlapping gunzip 659 ms, parse 2738 ms, sort 0 ms, write 0 ms, index 586 ms: 7 candidates, 80521 repo-hours, 704 releases; waiting 876 ms; commit 0 ms)
2026-11-08T13:25:32Z [load_day 2025-08-16] 2025-08-16 hour 14: 150204 events in 0 files, snapshot none (task 5474 ms: download 3016 ms overlapping gunzip 815 ms, parse 3198 ms, sort 0 ms, write 0 ms, index 610 ms: 10 candidates, 68348 repo-hours, 798 releases; waiting 542 ms; commit 0 ms)
2026-11-08T13:25:32Z [load_day 2025-08-16] 2025-08-16 hour 15: 154124 events in 0 files, snapshot none (task 4735 ms: download 2800 ms overlapping gunzip 676 ms, parse 2704 ms, sort 0 ms, write 0 ms, index 588 ms: 9 candidates, 69451 repo-hours, 811 releases; waiting 488 ms; commit 0 ms)
2026-11-08T13:25:38Z [load_day 2025-08-16] 2025-08-16 hour 16: 155344 events in 0 files, snapshot none (task 5397 ms: download 2410 ms overlapping gunzip 751 ms, parse 3059 ms, sort 0 ms, write 0 ms, index 1144 ms: 7 candidates, 68501 repo-hours, 786 releases; waiting 190 ms; commit 0 ms)
2026-11-08T13:25:39Z [load_day 2025-08-16] 2025-08-16 hour 17: 154901 events in 0 files, snapshot none (task 6498 ms: download 4040 ms overlapping gunzip 627 ms, parse 2813 ms, sort 0 ms, write 0 ms, index 439 ms: 12 candidates, 64539 repo-hours, 657 releases; waiting 2187 ms; commit 0 ms)
2026-11-08T13:25:53Z [load_day 2025-08-16] 2025-08-16 hour 18: 154611 events in 0 files, snapshot none (task 6128 ms: download 3429 ms overlapping gunzip 842 ms, parse 3768 ms, sort 0 ms, write 0 ms, index 855 ms: 7 candidates, 72635 repo-hours, 858 releases; waiting 353 ms; commit 0 ms)
2026-11-08T13:25:53Z [load_day 2025-08-16] 2025-08-16 hour 19: 147900 events in 0 files, snapshot none (task 5979 ms: download 3496 ms overlapping gunzip 851 ms, parse 3548 ms, sort 0 ms, write 0 ms, index 762 ms: 14 candidates, 59634 repo-hours, 682 releases; waiting 523 ms; commit 0 ms)
2026-11-08T13:25:59Z [load_day 2025-08-16] 2025-08-16 hour 20: 146021 events in 0 files, snapshot none (task 5936 ms: download 3405 ms overlapping gunzip 830 ms, parse 3382 ms, sort 0 ms, write 0 ms, index 722 ms: 20 candidates, 58720 repo-hours, 732 releases; waiting 725 ms; commit 0 ms)
2026-11-08T13:25:59Z [load_day 2025-08-16] 2025-08-16 hour 21: 142238 events in 0 files, snapshot none (task 5461 ms: download 2688 ms overlapping gunzip 804 ms, parse 3179 ms, sort 0 ms, write 0 ms, index 547 ms: 4 candidates, 53941 repo-hours, 849 releases; waiting 569 ms; commit 0 ms)
2026-11-08T13:26:05Z [load_day 2025-08-16] 2025-08-16 hour 22: 137713 events in 0 files, snapshot none (task 5961 ms: download 3425 ms overlapping gunzip 638 ms, parse 2709 ms, sort 0 ms, write 0 ms, index 387 ms: 2 candidates, 51775 repo-hours, 885 releases; waiting 1889 ms; commit 0 ms)
2026-11-08T13:26:05Z [load_day 2025-08-16] 2025-08-16 hour 23: 134290 events in 0 files, snapshot none (task 4623 ms: download 2777 ms overlapping gunzip 592 ms, parse 2550 ms, sort 0 ms, write 0 ms, index 645 ms: 5 candidates, 50785 repo-hours, 842 releases; waiting 520 ms; commit 0 ms)
2026-11-08T13:26:13Z [load_day 2025-08-16] 2025-08-16: repo_hour merged from 24 files to 1 (1545711 rows, 7368 ms)
2026-11-08T13:26:16Z [load_day 2025-08-16] 2025-08-16: index committed in 10117 ms (24 + 1 + 24 files)
2026-11-08T13:26:16Z [load_day 2025-08-16] 2025-08-16: 3523695 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:26:16Z [load_day 2025-08-16] attempt 1 succeeded