orcaLog in

Runs · run 3778

load_day 2025-04-12, attempt 1 succeeded

Host
73ccef5e07c2:286226
Started
2026-11-08T11:22:10Z
Ended
2026-11-08T11:23:52Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
696 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
137.2 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3778/load_day/2025-04-12/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:22:10Z [load_day 2025-04-12] attempt 1 started
2026-11-08T11:22:11Z [load_day 2025-04-12] 2025-04-12: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:22:19Z [load_day 2025-04-12] 2025-04-12 hour 0: 175952 events in 0 files, snapshot none (task 7217 ms: download 4132 ms overlapping gunzip 1049 ms, parse 4695 ms, sort 0 ms, write 0 ms, index 704 ms: 8 candidates, 83202 repo-hours, 1194 releases; waiting 465 ms; commit 0 ms)
2026-11-08T11:22:19Z [load_day 2025-04-12] 2025-04-12 hour 1: 196179 events in 0 files, snapshot none (task 7627 ms: download 4483 ms overlapping gunzip 1167 ms, parse 4862 ms, sort 0 ms, write 0 ms, index 823 ms: 6 candidates, 109933 repo-hours, 977 releases; waiting 484 ms; commit 0 ms)
2026-11-08T11:22:27Z [load_day 2025-04-12] 2025-04-12 hour 2: 164637 events in 0 files, snapshot none (task 6964 ms: download 4057 ms overlapping gunzip 1019 ms, parse 4596 ms, sort 0 ms, write 0 ms, index 611 ms: 4 candidates, 72116 repo-hours, 771 releases; waiting 463 ms; commit 0 ms)
2026-11-08T11:22:27Z [load_day 2025-04-12] 2025-04-12 hour 3: 186988 events in 0 files, snapshot none (task 6890 ms: download 4095 ms overlapping gunzip 1172 ms, parse 4437 ms, sort 0 ms, write 0 ms, index 631 ms: 2 candidates, 71131 repo-hours, 2881 releases; waiting 373 ms; commit 0 ms)
2026-11-08T11:22:34Z [load_day 2025-04-12] 2025-04-12 hour 4: 170617 events in 0 files, snapshot none (task 6793 ms: download 3478 ms overlapping gunzip 1050 ms, parse 4444 ms, sort 0 ms, write 0 ms, index 515 ms: 6 candidates, 60882 repo-hours, 658 releases; waiting 540 ms; commit 0 ms)
2026-11-08T11:22:35Z [load_day 2025-04-12] 2025-04-12 hour 5: 173165 events in 0 files, snapshot none (task 7556 ms: download 3960 ms overlapping gunzip 1071 ms, parse 4846 ms, sort 0 ms, write 0 ms, index 781 ms: 4 candidates, 63951 repo-hours, 777 releases; waiting 487 ms; commit 0 ms)
2026-11-08T11:22:41Z [load_day 2025-04-12] 2025-04-12 hour 6: 187320 events in 0 files, snapshot none (task 6284 ms: download 3165 ms overlapping gunzip 834 ms, parse 3770 ms, sort 0 ms, write 0 ms, index 895 ms: 1 candidates, 80388 repo-hours, 1061 releases; waiting 501 ms; commit 0 ms)
2026-11-08T11:22:41Z [load_day 2025-04-12] 2025-04-12 hour 7: 182362 events in 0 files, snapshot none (task 5880 ms: download 2785 ms overlapping gunzip 811 ms, parse 3346 ms, sort 0 ms, write 0 ms, index 920 ms: 1 candidates, 68810 repo-hours, 981 releases; waiting 489 ms; commit 0 ms)
2026-11-08T11:22:48Z [load_day 2025-04-12] 2025-04-12 hour 8: 185565 events in 0 files, snapshot none (task 6668 ms: download 3949 ms overlapping gunzip 984 ms, parse 4334 ms, sort 0 ms, write 0 ms, index 613 ms: 1 candidates, 73877 repo-hours, 1004 releases; waiting 500 ms; commit 0 ms)
2026-11-08T11:22:48Z [load_day 2025-04-12] 2025-04-12 hour 9: 194826 events in 0 files, snapshot none (task 6835 ms: download 4066 ms overlapping gunzip 1016 ms, parse 4411 ms, sort 0 ms, write 0 ms, index 635 ms: 3 candidates, 79314 repo-hours, 1188 releases; waiting 506 ms; commit 0 ms)
2026-11-08T11:22:56Z [load_day 2025-04-12] 2025-04-12 hour 10: 191633 events in 0 files, snapshot none (task 7581 ms: download 4404 ms overlapping gunzip 1210 ms, parse 4936 ms, sort 0 ms, write 0 ms, index 665 ms: 7 candidates, 76491 repo-hours, 887 releases; waiting 501 ms; commit 0 ms)
2026-11-08T11:22:57Z [load_day 2025-04-12] 2025-04-12 hour 11: 188478 events in 0 files, snapshot none (task 7722 ms: download 4345 ms overlapping gunzip 1197 ms, parse 5129 ms, sort 0 ms, write 0 ms, index 647 ms: 5 candidates, 71441 repo-hours, 790 releases; waiting 464 ms; commit 0 ms)
2026-11-08T11:23:04Z [load_day 2025-04-12] 2025-04-12 hour 12: 245223 events in 0 files, snapshot none (task 6799 ms: download 3365 ms overlapping gunzip 927 ms, parse 4183 ms, sort 0 ms, write 0 ms, index 950 ms: 6 candidates, 122209 repo-hours, 1036 releases; waiting 511 ms; commit 0 ms)
2026-11-08T11:23:04Z [load_day 2025-04-12] 2025-04-12 hour 13: 221788 events in 0 files, snapshot none (task 6862 ms: download 3771 ms overlapping gunzip 979 ms, parse 4407 ms, sort 0 ms, write 0 ms, index 747 ms: 3 candidates, 100508 repo-hours, 850 releases; waiting 349 ms; commit 0 ms)
2026-11-08T11:23:11Z [load_day 2025-04-12] 2025-04-12 hour 14: 211803 events in 0 files, snapshot none (task 7256 ms: download 4302 ms overlapping gunzip 1107 ms, parse 4515 ms, sort 0 ms, write 0 ms, index 809 ms: 4 candidates, 83810 repo-hours, 869 releases; waiting 507 ms; commit 0 ms)
2026-11-08T11:23:12Z [load_day 2025-04-12] 2025-04-12 hour 15: 221011 events in 0 files, snapshot none (task 7345 ms: download 4398 ms overlapping gunzip 1101 ms, parse 4842 ms, sort 0 ms, write 0 ms, index 767 ms: 3 candidates, 91691 repo-hours, 1036 releases; waiting 339 ms; commit 0 ms)
2026-11-08T11:23:20Z [load_day 2025-04-12] 2025-04-12 hour 16: 211160 events in 0 files, snapshot none (task 7818 ms: download 4498 ms overlapping gunzip 1119 ms, parse 5170 ms, sort 0 ms, write 0 ms, index 722 ms: 5 candidates, 85292 repo-hours, 1155 releases; waiting 482 ms; commit 0 ms)
2026-11-08T11:23:20Z [load_day 2025-04-12] 2025-04-12 hour 17: 205274 events in 0 files, snapshot none (task 6748 ms: download 3663 ms overlapping gunzip 953 ms, parse 4330 ms, sort 0 ms, write 0 ms, index 882 ms: 2 candidates, 78127 repo-hours, 899 releases; waiting 268 ms; commit 0 ms)
2026-11-08T11:23:27Z [load_day 2025-04-12] 2025-04-12 hour 18: 211717 events in 0 files, snapshot none (task 6606 ms: download 3771 ms overlapping gunzip 988 ms, parse 4166 ms, sort 0 ms, write 0 ms, index 710 ms: 4 candidates, 92368 repo-hours, 961 releases; waiting 531 ms; commit 0 ms)
2026-11-08T11:23:27Z [load_day 2025-04-12] 2025-04-12 hour 19: 187659 events in 0 files, snapshot none (task 6402 ms: download 3533 ms overlapping gunzip 889 ms, parse 3938 ms, sort 0 ms, write 0 ms, index 618 ms: 3 candidates, 70406 repo-hours, 963 releases; waiting 579 ms; commit 0 ms)
2026-11-08T11:23:34Z [load_day 2025-04-12] 2025-04-12 hour 20: 181435 events in 0 files, snapshot none (task 6270 ms: download 3821 ms overlapping gunzip 923 ms, parse 3839 ms, sort 0 ms, write 0 ms, index 581 ms: 2 candidates, 69827 repo-hours, 819 releases; waiting 664 ms; commit 0 ms)
2026-11-08T11:23:34Z [load_day 2025-04-12] 2025-04-12 hour 21: 172455 events in 0 files, snapshot none (task 5431 ms: download 2902 ms overlapping gunzip 802 ms, parse 3617 ms, sort 0 ms, write 0 ms, index 518 ms: 3 candidates, 67724 repo-hours, 938 releases; waiting 209 ms; commit 0 ms)
2026-11-08T11:23:40Z [load_day 2025-04-12] 2025-04-12 hour 22: 156929 events in 0 files, snapshot none (task 5664 ms: download 2645 ms overlapping gunzip 773 ms, parse 3644 ms, sort 0 ms, write 0 ms, index 437 ms: 0 candidates, 57549 repo-hours, 884 releases; waiting 475 ms; commit 0 ms)
2026-11-08T11:23:40Z [load_day 2025-04-12] 2025-04-12 hour 23: 136679 events in 0 files, snapshot none (task 5197 ms: download 2270 ms overlapping gunzip 699 ms, parse 3146 ms, sort 0 ms, write 0 ms, index 466 ms: 1 candidates, 52751 repo-hours, 877 releases; waiting 469 ms; commit 0 ms)
2026-11-08T11:23:49Z [load_day 2025-04-12] 2025-04-12: repo_hour merged from 24 files to 1 (1883798 rows, 9409 ms)
2026-11-08T11:23:52Z [load_day 2025-04-12] 2025-04-12: index committed in 12020 ms (23 + 1 + 24 files)
2026-11-08T11:23:52Z [load_day 2025-04-12] 2025-04-12: 4560855 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:23:52Z [load_day 2025-04-12] attempt 1 succeeded