orcaLog in

Runs · run 3964

load_day 2025-05-30, attempt 1 succeeded

Host
73ccef5e07c2:314055
Started
2026-11-08T12:11:48Z
Ended
2026-11-08T12:13:14Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
674 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
141.7 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3964/load_day/2025-05-30/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:11:48Z [load_day 2025-05-30] attempt 1 started
2026-11-08T12:11:49Z [load_day 2025-05-30] 2025-05-30: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:11:57Z [load_day 2025-05-30] 2025-05-30 hour 0: 139802 events in 0 files, snapshot none (task 6756 ms: download 3534 ms overlapping gunzip 1087 ms, parse 4124 ms, sort 0 ms, write 0 ms, index 608 ms: 11 candidates, 70775 repo-hours, 932 releases; waiting 631 ms; commit 0 ms)
2026-11-08T12:11:57Z [load_day 2025-05-30] 2025-05-30 hour 1: 151648 events in 0 files, snapshot none (task 6119 ms: download 3134 ms overlapping gunzip 778 ms, parse 3467 ms, sort 0 ms, write 0 ms, index 1007 ms: 8 candidates, 89518 repo-hours, 689 releases; waiting 467 ms; commit 0 ms)
2026-11-08T12:12:03Z [load_day 2025-05-30] 2025-05-30 hour 2: 148326 events in 0 files, snapshot none (task 5225 ms: download 2693 ms overlapping gunzip 761 ms, parse 3136 ms, sort 0 ms, write 0 ms, index 555 ms: 7 candidates, 72350 repo-hours, 797 releases; waiting 371 ms; commit 0 ms)
2026-11-08T12:12:03Z [load_day 2025-05-30] 2025-05-30 hour 3: 146088 events in 0 files, snapshot none (task 5178 ms: download 2320 ms overlapping gunzip 765 ms, parse 3108 ms, sort 0 ms, write 0 ms, index 511 ms: 6 candidates, 69483 repo-hours, 2028 releases; waiting 199 ms; commit 0 ms)
2026-11-08T12:12:09Z [load_day 2025-05-30] 2025-05-30 hour 4: 141896 events in 0 files, snapshot none (task 5927 ms: download 3746 ms overlapping gunzip 769 ms, parse 3169 ms, sort 0 ms, write 0 ms, index 510 ms: 10 candidates, 62875 repo-hours, 683 releases; waiting 1168 ms; commit 0 ms)
2026-11-08T12:12:09Z [load_day 2025-05-30] 2025-05-30 hour 5: 137445 events in 0 files, snapshot none (task 5033 ms: download 3121 ms overlapping gunzip 730 ms, parse 2979 ms, sort 0 ms, write 0 ms, index 461 ms: 6 candidates, 62834 repo-hours, 628 releases; waiting 567 ms; commit 0 ms)
2026-11-08T12:12:15Z [load_day 2025-05-30] 2025-05-30 hour 6: 145789 events in 0 files, snapshot none (task 5079 ms: download 3266 ms overlapping gunzip 759 ms, parse 2857 ms, sort 0 ms, write 0 ms, index 639 ms: 7 candidates, 76198 repo-hours, 688 releases; waiting 577 ms; commit 0 ms)
2026-11-08T12:12:15Z [load_day 2025-05-30] 2025-05-30 hour 7: 153322 events in 0 files, snapshot none (task 5707 ms: download 3566 ms overlapping gunzip 815 ms, parse 3255 ms, sort 0 ms, write 0 ms, index 627 ms: 8 candidates, 73251 repo-hours, 780 releases; waiting 702 ms; commit 0 ms)
2026-11-08T12:12:21Z [load_day 2025-05-30] 2025-05-30 hour 8: 156973 events in 0 files, snapshot none (task 5892 ms: download 3375 ms overlapping gunzip 867 ms, parse 3431 ms, sort 0 ms, write 0 ms, index 609 ms: 11 candidates, 77384 repo-hours, 815 releases; waiting 628 ms; commit 0 ms)
2026-11-08T12:12:21Z [load_day 2025-05-30] 2025-05-30 hour 9: 160548 events in 0 files, snapshot none (task 5551 ms: download 3340 ms overlapping gunzip 811 ms, parse 3301 ms, sort 0 ms, write 0 ms, index 591 ms: 9 candidates, 79457 repo-hours, 997 releases; waiting 510 ms; commit 0 ms)
2026-11-08T12:12:28Z [load_day 2025-05-30] 2025-05-30 hour 10: 157310 events in 0 files, snapshot none (task 5953 ms: download 3451 ms overlapping gunzip 910 ms, parse 3435 ms, sort 0 ms, write 0 ms, index 646 ms: 16 candidates, 76829 repo-hours, 856 releases; waiting 632 ms; commit 0 ms)
2026-11-08T12:12:28Z [load_day 2025-05-30] 2025-05-30 hour 11: 159117 events in 0 files, snapshot none (task 5628 ms: download 3119 ms overlapping gunzip 813 ms, parse 3339 ms, sort 0 ms, write 0 ms, index 586 ms: 19 candidates, 74154 repo-hours, 854 releases; waiting 525 ms; commit 0 ms)
2026-11-08T12:12:34Z [load_day 2025-05-30] 2025-05-30 hour 12: 162313 events in 0 files, snapshot none (task 5457 ms: download 2974 ms overlapping gunzip 760 ms, parse 3230 ms, sort 0 ms, write 0 ms, index 698 ms: 5 candidates, 94936 repo-hours, 797 releases; waiting 524 ms; commit 0 ms)
2026-11-08T12:12:34Z [load_day 2025-05-30] 2025-05-30 hour 13: 163315 events in 0 files, snapshot none (task 5919 ms: download 3477 ms overlapping gunzip 831 ms, parse 3429 ms, sort 0 ms, write 0 ms, index 629 ms: 11 candidates, 88950 repo-hours, 822 releases; waiting 732 ms; commit 0 ms)
2026-11-08T12:12:40Z [load_day 2025-05-30] 2025-05-30 hour 14: 160133 events in 0 files, snapshot none (task 5928 ms: download 3378 ms overlapping gunzip 879 ms, parse 3565 ms, sort 0 ms, write 0 ms, index 660 ms: 9 candidates, 81133 repo-hours, 810 releases; waiting 517 ms; commit 0 ms)
2026-11-08T12:12:40Z [load_day 2025-05-30] 2025-05-30 hour 15: 163254 events in 0 files, snapshot none (task 5807 ms: download 3358 ms overlapping gunzip 856 ms, parse 3526 ms, sort 0 ms, write 0 ms, index 600 ms: 12 candidates, 82673 repo-hours, 958 releases; waiting 520 ms; commit 0 ms)
2026-11-08T12:12:46Z [load_day 2025-05-30] 2025-05-30 hour 16: 156241 events in 0 files, snapshot none (task 5653 ms: download 3641 ms overlapping gunzip 825 ms, parse 3353 ms, sort 0 ms, write 0 ms, index 661 ms: 10 candidates, 79153 repo-hours, 806 releases; waiting 509 ms; commit 0 ms)
2026-11-08T12:12:46Z [load_day 2025-05-30] 2025-05-30 hour 17: 157729 events in 0 files, snapshot none (task 5656 ms: download 3365 ms overlapping gunzip 825 ms, parse 3487 ms, sort 0 ms, write 0 ms, index 555 ms: 4 candidates, 73971 repo-hours, 794 releases; waiting 497 ms; commit 0 ms)
2026-11-08T12:12:52Z [load_day 2025-05-30] 2025-05-30 hour 18: 156668 events in 0 files, snapshot none (task 5304 ms: download 3039 ms overlapping gunzip 751 ms, parse 3075 ms, sort 0 ms, write 0 ms, index 602 ms: 11 candidates, 80217 repo-hours, 814 releases; waiting 525 ms; commit 0 ms)
2026-11-08T12:12:52Z [load_day 2025-05-30] 2025-05-30 hour 19: 155082 events in 0 files, snapshot none (task 5210 ms: download 2850 ms overlapping gunzip 770 ms, parse 3243 ms, sort 0 ms, write 0 ms, index 507 ms: 4 candidates, 69074 repo-hours, 780 releases; waiting 363 ms; commit 0 ms)
2026-11-08T12:12:58Z [load_day 2025-05-30] 2025-05-30 hour 20: 150104 events in 0 files, snapshot none (task 5463 ms: download 3281 ms overlapping gunzip 832 ms, parse 3357 ms, sort 0 ms, write 0 ms, index 500 ms: 12 candidates, 68998 repo-hours, 784 releases; waiting 507 ms; commit 0 ms)
2026-11-08T12:12:58Z [load_day 2025-05-30] 2025-05-30 hour 21: 146556 events in 0 files, snapshot none (task 5218 ms: download 2889 ms overlapping gunzip 794 ms, parse 3128 ms, sort 0 ms, write 0 ms, index 525 ms: 9 candidates, 66009 repo-hours, 893 releases; waiting 534 ms; commit 0 ms)
2026-11-08T12:13:03Z [load_day 2025-05-30] 2025-05-30 hour 22: 142146 events in 0 files, snapshot none (task 5029 ms: download 2988 ms overlapping gunzip 735 ms, parse 3062 ms, sort 0 ms, write 0 ms, index 454 ms: 13 candidates, 61580 repo-hours, 899 releases; waiting 519 ms; commit 0 ms)
2026-11-08T12:13:04Z [load_day 2025-05-30] 2025-05-30 hour 23: 136788 events in 0 files, snapshot none (task 5061 ms: download 2996 ms overlapping gunzip 662 ms, parse 2774 ms, sort 0 ms, write 0 ms, index 441 ms: 6 candidates, 56612 repo-hours, 889 releases; waiting 511 ms; commit 0 ms)
2026-11-08T12:13:11Z [load_day 2025-05-30] 2025-05-30: repo_hour merged from 24 files to 1 (1788414 rows, 7782 ms)
2026-11-08T12:13:14Z [load_day 2025-05-30] 2025-05-30: index committed in 10395 ms (24 + 1 + 24 files)
2026-11-08T12:13:14Z [load_day 2025-05-30] 2025-05-30: 3648593 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:13:14Z [load_day 2025-05-30] attempt 1 succeeded