orcaLog in

Runs · run 4120

load_day 2025-07-07, attempt 1 succeeded

Host
73ccef5e07c2:338751
Started
2026-11-08T12:50:00Z
Ended
2026-11-08T12:51:43Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
713 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
152.3 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4120/load_day/2025-07-07/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:50:00Z [load_day 2025-07-07] attempt 1 started
2026-11-08T12:50:01Z [load_day 2025-07-07] 2025-07-07: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:50:07Z [load_day 2025-07-07] 2025-07-07 hour 0: 143172 events in 0 files, snapshot none (task 5628 ms: download 3410 ms overlapping gunzip 917 ms, parse 3484 ms, sort 0 ms, write 0 ms, index 494 ms: 8 candidates, 63571 repo-hours, 1140 releases; waiting 413 ms; commit 0 ms)
2026-11-08T12:50:07Z [load_day 2025-07-07] 2025-07-07 hour 1: 160155 events in 0 files, snapshot none (task 5394 ms: download 3047 ms overlapping gunzip 777 ms, parse 3082 ms, sort 0 ms, write 0 ms, index 667 ms: 13 candidates, 90593 repo-hours, 636 releases; waiting 513 ms; commit 0 ms)
2026-11-08T12:50:13Z [load_day 2025-07-07] 2025-07-07 hour 2: 149533 events in 0 files, snapshot none (task 5797 ms: download 3933 ms overlapping gunzip 891 ms, parse 3342 ms, sort 0 ms, write 0 ms, index 614 ms: 1 candidates, 73978 repo-hours, 706 releases; waiting 555 ms; commit 0 ms)
2026-11-08T12:50:13Z [load_day 2025-07-07] 2025-07-07 hour 3: 148522 events in 0 files, snapshot none (task 5451 ms: download 3067 ms overlapping gunzip 827 ms, parse 3144 ms, sort 0 ms, write 0 ms, index 520 ms: 4 candidates, 68583 repo-hours, 1038 releases; waiting 562 ms; commit 0 ms)
2026-11-08T12:50:20Z [load_day 2025-07-07] 2025-07-07 hour 4: 146553 events in 0 files, snapshot none (task 5887 ms: download 3130 ms overlapping gunzip 899 ms, parse 3455 ms, sort 0 ms, write 0 ms, index 730 ms: 8 candidates, 67325 repo-hours, 1592 releases; waiting 494 ms; commit 0 ms)
2026-11-08T12:50:20Z [load_day 2025-07-07] 2025-07-07 hour 5: 150173 events in 0 files, snapshot none (task 6123 ms: download 3860 ms overlapping gunzip 903 ms, parse 3548 ms, sort 0 ms, write 0 ms, index 658 ms: 5 candidates, 65493 repo-hours, 598 releases; waiting 720 ms; commit 0 ms)
2026-11-08T12:50:27Z [load_day 2025-07-07] 2025-07-07 hour 6: 159781 events in 0 files, snapshot none (task 6741 ms: download 3704 ms overlapping gunzip 1024 ms, parse 4196 ms, sort 0 ms, write 0 ms, index 766 ms: 10 candidates, 81586 repo-hours, 750 releases; waiting 521 ms; commit 0 ms)
2026-11-08T12:50:28Z [load_day 2025-07-07] 2025-07-07 hour 7: 163753 events in 0 files, snapshot none (task 7336 ms: download 4032 ms overlapping gunzip 1250 ms, parse 4737 ms, sort 0 ms, write 0 ms, index 620 ms: 5 candidates, 78239 repo-hours, 783 releases; waiting 456 ms; commit 0 ms)
2026-11-08T12:50:35Z [load_day 2025-07-07] 2025-07-07 hour 8: 163913 events in 0 files, snapshot none (task 7576 ms: download 4734 ms overlapping gunzip 1169 ms, parse 4653 ms, sort 0 ms, write 0 ms, index 704 ms: 9 candidates, 80907 repo-hours, 850 releases; waiting 731 ms; commit 0 ms)
2026-11-08T12:50:36Z [load_day 2025-07-07] 2025-07-07 hour 9: 164004 events in 0 files, snapshot none (task 7563 ms: download 5102 ms overlapping gunzip 1224 ms, parse 4864 ms, sort 0 ms, write 0 ms, index 617 ms: 4 candidates, 82897 repo-hours, 862 releases; waiting 529 ms; commit 0 ms)
2026-11-08T12:50:44Z [load_day 2025-07-07] 2025-07-07 hour 10: 162366 events in 0 files, snapshot none (task 8733 ms: download 6398 ms overlapping gunzip 993 ms, parse 4136 ms, sort 0 ms, write 0 ms, index 566 ms: 5 candidates, 78915 repo-hours, 797 releases; waiting 2711 ms; commit 0 ms)
2026-11-08T12:50:44Z [load_day 2025-07-07] 2025-07-07 hour 11: 160455 events in 0 files, snapshot none (task 6075 ms: download 3949 ms overlapping gunzip 953 ms, parse 3622 ms, sort 0 ms, write 0 ms, index 690 ms: 13 candidates, 76142 repo-hours, 759 releases; waiting 535 ms; commit 0 ms)
2026-11-08T12:50:50Z [load_day 2025-07-07] 2025-07-07 hour 12: 168773 events in 0 files, snapshot none (task 5795 ms: download 3491 ms overlapping gunzip 848 ms, parse 3383 ms, sort 0 ms, write 0 ms, index 736 ms: 9 candidates, 97789 repo-hours, 787 releases; waiting 518 ms; commit 0 ms)
2026-11-08T12:50:51Z [load_day 2025-07-07] 2025-07-07 hour 13: 167890 events in 0 files, snapshot none (task 6339 ms: download 3545 ms overlapping gunzip 922 ms, parse 3685 ms, sort 0 ms, write 0 ms, index 809 ms: 18 candidates, 91513 repo-hours, 805 releases; waiting 547 ms; commit 0 ms)
2026-11-08T12:50:59Z [load_day 2025-07-07] 2025-07-07 hour 14: 165996 events in 0 files, snapshot none (task 8015 ms: download 4346 ms overlapping gunzip 1294 ms, parse 5184 ms, sort 0 ms, write 0 ms, index 893 ms: 13 candidates, 83355 repo-hours, 898 releases; waiting 299 ms; commit 0 ms)
2026-11-08T12:50:59Z [load_day 2025-07-07] 2025-07-07 hour 15: 164257 events in 0 files, snapshot none (task 7147 ms: download 4009 ms overlapping gunzip 1144 ms, parse 4498 ms, sort 0 ms, write 0 ms, index 701 ms: 11 candidates, 83331 repo-hours, 819 releases; waiting 518 ms; commit 0 ms)
2026-11-08T12:51:07Z [load_day 2025-07-07] 2025-07-07 hour 16: 161029 events in 0 files, snapshot none (task 7777 ms: download 5094 ms overlapping gunzip 1168 ms, parse 4761 ms, sort 0 ms, write 0 ms, index 640 ms: 6 candidates, 81143 repo-hours, 743 releases; waiting 892 ms; commit 0 ms)
2026-11-08T12:51:07Z [load_day 2025-07-07] 2025-07-07 hour 17: 162408 events in 0 files, snapshot none (task 7365 ms: download 4609 ms overlapping gunzip 1118 ms, parse 4430 ms, sort 0 ms, write 0 ms, index 729 ms: 5 candidates, 79363 repo-hours, 666 releases; waiting 747 ms; commit 0 ms)
2026-11-08T12:51:15Z [load_day 2025-07-07] 2025-07-07 hour 18: 165914 events in 0 files, snapshot none (task 7788 ms: download 5382 ms overlapping gunzip 1253 ms, parse 5150 ms, sort 0 ms, write 0 ms, index 609 ms: 16 candidates, 82802 repo-hours, 882 releases; waiting 472 ms; commit 0 ms)
2026-11-08T12:51:15Z [load_day 2025-07-07] 2025-07-07 hour 19: 160177 events in 0 files, snapshot none (task 7392 ms: download 4744 ms overlapping gunzip 1230 ms, parse 5099 ms, sort 0 ms, write 0 ms, index 521 ms: 8 candidates, 72120 repo-hours, 736 releases; waiting 223 ms; commit 0 ms)
2026-11-08T12:51:23Z [load_day 2025-07-07] 2025-07-07 hour 20: 154937 events in 0 files, snapshot none (task 7481 ms: download 4996 ms overlapping gunzip 1149 ms, parse 4894 ms, sort 0 ms, write 0 ms, index 572 ms: 6 candidates, 70513 repo-hours, 717 releases; waiting 521 ms; commit 0 ms)
2026-11-08T12:51:23Z [load_day 2025-07-07] 2025-07-07 hour 21: 154510 events in 0 files, snapshot none (task 7112 ms: download 4522 ms overlapping gunzip 1168 ms, parse 4624 ms, sort 0 ms, write 0 ms, index 504 ms: 14 candidates, 68969 repo-hours, 846 releases; waiting 500 ms; commit 0 ms)
2026-11-08T12:51:31Z [load_day 2025-07-07] 2025-07-07 hour 22: 149794 events in 0 files, snapshot none (task 7062 ms: download 4720 ms overlapping gunzip 1106 ms, parse 4577 ms, sort 0 ms, write 0 ms, index 470 ms: 6 candidates, 62049 repo-hours, 775 releases; waiting 548 ms; commit 0 ms)
2026-11-08T12:51:31Z [load_day 2025-07-07] 2025-07-07 hour 23: 147864 events in 0 files, snapshot none (task 7074 ms: download 4526 ms overlapping gunzip 1095 ms, parse 4639 ms, sort 0 ms, write 0 ms, index 478 ms: 8 candidates, 61577 repo-hours, 924 releases; waiting 509 ms; commit 0 ms)
2026-11-08T12:51:40Z [load_day 2025-07-07] 2025-07-07: repo_hour merged from 24 files to 1 (1842753 rows, 9396 ms)
2026-11-08T12:51:43Z [load_day 2025-07-07] 2025-07-07: index committed in 12500 ms (24 + 1 + 24 files)
2026-11-08T12:51:43Z [load_day 2025-07-07] 2025-07-07: 3795929 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:51:43Z [load_day 2025-07-07] attempt 1 succeeded