orcaLog in

Runs · run 3288

load_day 2024-12-07, attempt 1 succeeded

Host
73ccef5e07c2:218507
Started
2026-11-08T09:15:16Z
Ended
2026-11-08T09:16:46Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
668 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
125.2 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3288/load_day/2024-12-07/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:15:16Z [load_day 2024-12-07] attempt 1 started
2026-11-08T09:15:18Z [load_day 2024-12-07] 2024-12-07: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:15:26Z [load_day 2024-12-07] 2024-12-07 hour 0: 171834 events in 0 files, snapshot none (task 7495 ms: download 4566 ms overlapping gunzip 1098 ms, parse 4740 ms, sort 0 ms, write 0 ms, index 827 ms: 6 candidates, 78881 repo-hours, 1261 releases; waiting 478 ms; commit 0 ms)
2026-11-08T09:15:26Z [load_day 2024-12-07] 2024-12-07 hour 1: 186310 events in 0 files, snapshot none (task 7587 ms: download 4074 ms overlapping gunzip 1126 ms, parse 4614 ms, sort 0 ms, write 0 ms, index 1121 ms: 8 candidates, 101785 repo-hours, 857 releases; waiting 447 ms; commit 0 ms)
2026-11-08T09:15:33Z [load_day 2024-12-07] 2024-12-07 hour 2: 152708 events in 0 files, snapshot none (task 6799 ms: download 3588 ms overlapping gunzip 1029 ms, parse 4416 ms, sort 0 ms, write 0 ms, index 573 ms: 6 candidates, 66386 repo-hours, 758 releases; waiting 480 ms; commit 0 ms)
2026-11-08T09:15:33Z [load_day 2024-12-07] 2024-12-07 hour 3: 167607 events in 0 files, snapshot none (task 6490 ms: download 3213 ms overlapping gunzip 970 ms, parse 4025 ms, sort 0 ms, write 0 ms, index 615 ms: 6 candidates, 67312 repo-hours, 3896 releases; waiting 483 ms; commit 0 ms)
2026-11-08T09:15:39Z [load_day 2024-12-07] 2024-12-07 hour 4: 150775 events in 0 files, snapshot none (task 5342 ms: download 2441 ms overlapping gunzip 737 ms, parse 3312 ms, sort 0 ms, write 0 ms, index 447 ms: 8 candidates, 56252 repo-hours, 577 releases; waiting 496 ms; commit 0 ms)
2026-11-08T09:15:39Z [load_day 2024-12-07] 2024-12-07 hour 5: 156134 events in 0 files, snapshot none (task 4973 ms: download 2143 ms overlapping gunzip 671 ms, parse 2836 ms, sort 0 ms, write 0 ms, index 673 ms: 7 candidates, 59177 repo-hours, 624 releases; waiting 520 ms; commit 0 ms)
2026-11-08T09:15:46Z [load_day 2024-12-07] 2024-12-07 hour 6: 180028 events in 0 files, snapshot none (task 5903 ms: download 3207 ms overlapping gunzip 871 ms, parse 3808 ms, sort 0 ms, write 0 ms, index 538 ms: 4 candidates, 77376 repo-hours, 933 releases; waiting 376 ms; commit 0 ms)
2026-11-08T09:15:46Z [load_day 2024-12-07] 2024-12-07 hour 7: 160283 events in 0 files, snapshot none (task 5576 ms: download 2984 ms overlapping gunzip 795 ms, parse 3469 ms, sort 0 ms, write 0 ms, index 500 ms: 5 candidates, 60387 repo-hours, 800 releases; waiting 484 ms; commit 0 ms)
2026-11-08T09:15:52Z [load_day 2024-12-07] 2024-12-07 hour 8: 163496 events in 0 files, snapshot none (task 6115 ms: download 3132 ms overlapping gunzip 846 ms, parse 3775 ms, sort 0 ms, write 0 ms, index 716 ms: 5 candidates, 63711 repo-hours, 809 releases; waiting 503 ms; commit 0 ms)
2026-11-08T09:15:53Z [load_day 2024-12-07] 2024-12-07 hour 9: 171383 events in 0 files, snapshot none (task 6324 ms: download 3518 ms overlapping gunzip 911 ms, parse 4027 ms, sort 0 ms, write 0 ms, index 518 ms: 3 candidates, 69136 repo-hours, 1023 releases; waiting 489 ms; commit 0 ms)
2026-11-08T09:15:57Z [load_day 2024-12-07] 2024-12-07 hour 10: 169458 events in 0 files, snapshot none (task 4379 ms: download 2139 ms overlapping gunzip 611 ms, parse 2621 ms, sort 0 ms, write 0 ms, index 640 ms: 5 candidates, 65691 repo-hours, 717 releases; waiting 227 ms; commit 0 ms)
2026-11-08T09:15:58Z [load_day 2024-12-07] 2024-12-07 hour 11: 171389 events in 0 files, snapshot none (task 5277 ms: download 3425 ms overlapping gunzip 669 ms, parse 2912 ms, sort 0 ms, write 0 ms, index 535 ms: 6 candidates, 63904 repo-hours, 729 releases; waiting 580 ms; commit 0 ms)
2026-11-08T09:16:04Z [load_day 2024-12-07] 2024-12-07 hour 12: 230213 events in 0 files, snapshot none (task 6846 ms: download 3813 ms overlapping gunzip 917 ms, parse 4356 ms, sort 0 ms, write 0 ms, index 762 ms: 5 candidates, 114546 repo-hours, 860 releases; waiting 486 ms; commit 0 ms)
2026-11-08T09:16:05Z [load_day 2024-12-07] 2024-12-07 hour 13: 207623 events in 0 files, snapshot none (task 6392 ms: download 3683 ms overlapping gunzip 880 ms, parse 4048 ms, sort 0 ms, write 0 ms, index 720 ms: 12 candidates, 94142 repo-hours, 787 releases; waiting 500 ms; commit 0 ms)
2026-11-08T09:16:12Z [load_day 2024-12-07] 2024-12-07 hour 14: 192321 events in 0 files, snapshot none (task 7056 ms: download 4306 ms overlapping gunzip 1052 ms, parse 4499 ms, sort 0 ms, write 0 ms, index 636 ms: 6 candidates, 75380 repo-hours, 764 releases; waiting 511 ms; commit 0 ms)
2026-11-08T09:16:13Z [load_day 2024-12-07] 2024-12-07 hour 15: 207367 events in 0 files, snapshot none (task 6601 ms: download 3982 ms overlapping gunzip 978 ms, parse 4183 ms, sort 0 ms, write 0 ms, index 619 ms: 4 candidates, 83340 repo-hours, 934 releases; waiting 527 ms; commit 0 ms)
2026-11-08T09:16:18Z [load_day 2024-12-07] 2024-12-07 hour 16: 198131 events in 0 files, snapshot none (task 5727 ms: download 2821 ms overlapping gunzip 809 ms, parse 3427 ms, sort 0 ms, write 0 ms, index 714 ms: 9 candidates, 76060 repo-hours, 927 releases; waiting 507 ms; commit 0 ms)
2026-11-08T09:16:19Z [load_day 2024-12-07] 2024-12-07 hour 17: 191123 events in 0 files, snapshot none (task 5582 ms: download 2966 ms overlapping gunzip 755 ms, parse 3156 ms, sort 0 ms, write 0 ms, index 512 ms: 6 candidates, 70770 repo-hours, 851 releases; waiting 506 ms; commit 0 ms)
2026-11-08T09:16:23Z [load_day 2024-12-07] 2024-12-07 hour 18: 198167 events in 0 files, snapshot none (task 4893 ms: download 2543 ms overlapping gunzip 669 ms, parse 2892 ms, sort 0 ms, write 0 ms, index 597 ms: 10 candidates, 84890 repo-hours, 939 releases; waiting 514 ms; commit 0 ms)
2026-11-08T09:16:25Z [load_day 2024-12-07] 2024-12-07 hour 19: 174816 events in 0 files, snapshot none (task 5363 ms: download 4370 ms overlapping gunzip 630 ms, parse 2742 ms, sort 0 ms, write 0 ms, index 459 ms: 8 candidates, 62613 repo-hours, 866 releases; waiting 1251 ms; commit 0 ms)
2026-11-08T09:16:28Z [load_day 2024-12-07] 2024-12-07 hour 20: 169643 events in 0 files, snapshot none (task 4545 ms: download 2455 ms overlapping gunzip 581 ms, parse 2620 ms, sort 0 ms, write 0 ms, index 474 ms: 8 candidates, 62827 repo-hours, 719 releases; waiting 511 ms; commit 0 ms)
2026-11-08T09:16:30Z [load_day 2024-12-07] 2024-12-07 hour 21: 167732 events in 0 files, snapshot none (task 4965 ms: download 2563 ms overlapping gunzip 581 ms, parse 2643 ms, sort 0 ms, write 0 ms, index 907 ms: 4 candidates, 64361 repo-hours, 973 releases; waiting 527 ms; commit 0 ms)
2026-11-08T09:16:33Z [load_day 2024-12-07] 2024-12-07 hour 22: 149638 events in 0 files, snapshot none (task 4379 ms: download 2370 ms overlapping gunzip 561 ms, parse 2420 ms, sort 0 ms, write 0 ms, index 501 ms: 4 candidates, 54592 repo-hours, 962 releases; waiting 533 ms; commit 0 ms)
2026-11-08T09:16:35Z [load_day 2024-12-07] 2024-12-07 hour 23: 144139 events in 0 files, snapshot none (task 4247 ms: download 2095 ms overlapping gunzip 529 ms, parse 2496 ms, sort 0 ms, write 0 ms, index 415 ms: 5 candidates, 52954 repo-hours, 625 releases; waiting 519 ms; commit 0 ms)
2026-11-08T09:16:43Z [load_day 2024-12-07] 2024-12-07: repo_hour merged from 24 files to 1 (1726473 rows, 7940 ms)
2026-11-08T09:16:45Z [load_day 2024-12-07] 2024-12-07: index committed in 10596 ms (24 + 1 + 24 files)
2026-11-08T09:16:45Z [load_day 2024-12-07] 2024-12-07: 4232318 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:16:45Z [load_day 2024-12-07] attempt 1 succeeded