orcaLog in

Runs · run 3319

load_day 2024-12-14, attempt 1 succeeded

Host
73ccef5e07c2:222792
Started
2026-11-08T09:22:18Z
Ended
2026-11-08T09:23:44Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
682 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
120.8 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3319/load_day/2024-12-14/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:22:19Z [load_day 2024-12-14] attempt 1 started
2026-11-08T09:22:19Z [load_day 2024-12-14] 2024-12-14: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:22:26Z [load_day 2024-12-14] 2024-12-14 hour 0: 168700 events in 0 files, snapshot none (task 6219 ms: download 2997 ms overlapping gunzip 945 ms, parse 3878 ms, sort 0 ms, write 0 ms, index 766 ms: 14 candidates, 78204 repo-hours, 1178 releases; waiting 328 ms; commit 0 ms)
2026-11-08T09:22:26Z [load_day 2024-12-14] 2024-12-14 hour 1: 181119 events in 0 files, snapshot none (task 6388 ms: download 2845 ms overlapping gunzip 853 ms, parse 3873 ms, sort 0 ms, write 0 ms, index 1042 ms: 4 candidates, 98402 repo-hours, 785 releases; waiting 234 ms; commit 0 ms)
2026-11-08T09:22:32Z [load_day 2024-12-14] 2024-12-14 hour 2: 134897 events in 0 files, snapshot none (task 5380 ms: download 2483 ms overlapping gunzip 757 ms, parse 3223 ms, sort 0 ms, write 0 ms, index 503 ms: 4 candidates, 60080 repo-hours, 644 releases; waiting 486 ms; commit 0 ms)
2026-11-08T09:22:33Z [load_day 2024-12-14] 2024-12-14 hour 3: 158619 events in 0 files, snapshot none (task 5771 ms: download 4517 ms overlapping gunzip 833 ms, parse 3204 ms, sort 0 ms, write 0 ms, index 440 ms: 4 candidates, 63010 repo-hours, 3959 releases; waiting 827 ms; commit 0 ms)
2026-11-08T09:22:39Z [load_day 2024-12-14] 2024-12-14 hour 4: 144257 events in 0 files, snapshot none (task 6151 ms: download 3135 ms overlapping gunzip 965 ms, parse 3968 ms, sort 0 ms, write 0 ms, index 387 ms: 4 candidates, 51528 repo-hours, 608 releases; waiting 499 ms; commit 0 ms)
2026-11-08T09:22:39Z [load_day 2024-12-14] 2024-12-14 hour 5: 143755 events in 0 files, snapshot none (task 5259 ms: download 2972 ms overlapping gunzip 768 ms, parse 3226 ms, sort 0 ms, write 0 ms, index 461 ms: 0 candidates, 53305 repo-hours, 639 releases; waiting 475 ms; commit 0 ms)
2026-11-08T09:22:45Z [load_day 2024-12-14] 2024-12-14 hour 6: 166644 events in 0 files, snapshot none (task 5174 ms: download 2031 ms overlapping gunzip 657 ms, parse 2824 ms, sort 0 ms, write 0 ms, index 856 ms: 1 candidates, 71509 repo-hours, 975 releases; waiting 495 ms; commit 0 ms)
2026-11-08T09:22:45Z [load_day 2024-12-14] 2024-12-14 hour 7: 154419 events in 0 files, snapshot none (task 4484 ms: download 2909 ms overlapping gunzip 570 ms, parse 2335 ms, sort 0 ms, write 0 ms, index 610 ms: 4 candidates, 55741 repo-hours, 823 releases; waiting 466 ms; commit 0 ms)
2026-11-08T09:22:50Z [load_day 2024-12-14] 2024-12-14 hour 8: 163888 events in 0 files, snapshot none (task 5009 ms: download 2606 ms overlapping gunzip 765 ms, parse 3028 ms, sort 0 ms, write 0 ms, index 415 ms: 2 candidates, 61434 repo-hours, 777 releases; waiting 479 ms; commit 0 ms)
2026-11-08T09:22:51Z [load_day 2024-12-14] 2024-12-14 hour 9: 178940 events in 0 files, snapshot none (task 5557 ms: download 2973 ms overlapping gunzip 851 ms, parse 3611 ms, sort 0 ms, write 0 ms, index 530 ms: 5 candidates, 70848 repo-hours, 1013 releases; waiting 197 ms; commit 0 ms)
2026-11-08T09:22:57Z [load_day 2024-12-14] 2024-12-14 hour 10: 169203 events in 0 files, snapshot none (task 6136 ms: download 3350 ms overlapping gunzip 931 ms, parse 3818 ms, sort 0 ms, write 0 ms, index 538 ms: 5 candidates, 65512 repo-hours, 802 releases; waiting 509 ms; commit 0 ms)
2026-11-08T09:22:57Z [load_day 2024-12-14] 2024-12-14 hour 11: 169724 events in 0 files, snapshot none (task 5285 ms: download 3121 ms overlapping gunzip 803 ms, parse 3452 ms, sort 0 ms, write 0 ms, index 455 ms: 8 candidates, 61689 repo-hours, 744 releases; waiting 212 ms; commit 0 ms)
2026-11-08T09:23:03Z [load_day 2024-12-14] 2024-12-14 hour 12: 223729 events in 0 files, snapshot none (task 5333 ms: download 2671 ms overlapping gunzip 725 ms, parse 3089 ms, sort 0 ms, write 0 ms, index 745 ms: 6 candidates, 110691 repo-hours, 839 releases; waiting 482 ms; commit 0 ms)
2026-11-08T09:23:03Z [load_day 2024-12-14] 2024-12-14 hour 13: 199907 events in 0 files, snapshot none (task 4880 ms: download 2176 ms overlapping gunzip 671 ms, parse 3077 ms, sort 0 ms, write 0 ms, index 683 ms: 8 candidates, 90095 repo-hours, 706 releases; waiting 184 ms; commit 0 ms)
2026-11-08T09:23:08Z [load_day 2024-12-14] 2024-12-14 hour 14: 190180 events in 0 files, snapshot none (task 5109 ms: download 2684 ms overlapping gunzip 698 ms, parse 3079 ms, sort 0 ms, write 0 ms, index 557 ms: 3 candidates, 72469 repo-hours, 903 releases; waiting 511 ms; commit 0 ms)
2026-11-08T09:23:09Z [load_day 2024-12-14] 2024-12-14 hour 15: 203689 events in 0 files, snapshot none (task 5560 ms: download 2977 ms overlapping gunzip 789 ms, parse 3369 ms, sort 0 ms, write 0 ms, index 642 ms: 15 candidates, 81685 repo-hours, 966 releases; waiting 462 ms; commit 0 ms)
2026-11-08T09:23:15Z [load_day 2024-12-14] 2024-12-14 hour 16: 195639 events in 0 files, snapshot none (task 6390 ms: download 2893 ms overlapping gunzip 845 ms, parse 3705 ms, sort 0 ms, write 0 ms, index 1123 ms: 3 candidates, 74180 repo-hours, 979 releases; waiting 501 ms; commit 0 ms)
2026-11-08T09:23:15Z [load_day 2024-12-14] 2024-12-14 hour 17: 187851 events in 0 files, snapshot none (task 6072 ms: download 2921 ms overlapping gunzip 787 ms, parse 3618 ms, sort 0 ms, write 0 ms, index 849 ms: 2 candidates, 67934 repo-hours, 700 releases; waiting 516 ms; commit 0 ms)
2026-11-08T09:23:23Z [load_day 2024-12-14] 2024-12-14 hour 18: 204511 events in 0 files, snapshot none (task 6807 ms: download 3893 ms overlapping gunzip 953 ms, parse 4354 ms, sort 0 ms, write 0 ms, index 804 ms: 4 candidates, 86122 repo-hours, 884 releases; waiting 477 ms; commit 0 ms)
2026-11-08T09:23:23Z [load_day 2024-12-14] 2024-12-14 hour 19: 176275 events in 0 files, snapshot none (task 6023 ms: download 3227 ms overlapping gunzip 888 ms, parse 3899 ms, sort 0 ms, write 0 ms, index 651 ms: 9 candidates, 59953 repo-hours, 681 releases; waiting 266 ms; commit 0 ms)
2026-11-08T09:23:28Z [load_day 2024-12-14] 2024-12-14 hour 20: 167511 events in 0 files, snapshot none (task 5320 ms: download 2879 ms overlapping gunzip 828 ms, parse 3473 ms, sort 0 ms, write 0 ms, index 444 ms: 6 candidates, 59832 repo-hours, 695 releases; waiting 266 ms; commit 0 ms)
2026-11-08T09:23:29Z [load_day 2024-12-14] 2024-12-14 hour 21: 162767 events in 0 files, snapshot none (task 5375 ms: download 2920 ms overlapping gunzip 747 ms, parse 3271 ms, sort 0 ms, write 0 ms, index 485 ms: 4 candidates, 60880 repo-hours, 806 releases; waiting 518 ms; commit 0 ms)
2026-11-08T09:23:34Z [load_day 2024-12-14] 2024-12-14 hour 22: 143314 events in 0 files, snapshot none (task 5392 ms: download 2494 ms overlapping gunzip 737 ms, parse 3364 ms, sort 0 ms, write 0 ms, index 458 ms: 9 candidates, 50503 repo-hours, 861 releases; waiting 543 ms; commit 0 ms)
2026-11-08T09:23:34Z [load_day 2024-12-14] 2024-12-14 hour 23: 142310 events in 0 files, snapshot none (task 4836 ms: download 2053 ms overlapping gunzip 688 ms, parse 3096 ms, sort 0 ms, write 0 ms, index 543 ms: 5 candidates, 54457 repo-hours, 663 releases; waiting 197 ms; commit 0 ms)
2026-11-08T09:23:42Z [load_day 2024-12-14] 2024-12-14: repo_hour merged from 24 files to 1 (1660063 rows, 7349 ms)
2026-11-08T09:23:44Z [load_day 2024-12-14] 2024-12-14: index committed in 9991 ms (23 + 1 + 24 files)
2026-11-08T09:23:44Z [load_day 2024-12-14] 2024-12-14: 4131848 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:23:44Z [load_day 2024-12-14] attempt 1 succeeded