orcaLog in

Runs · run 3645

load_day 2025-03-08, attempt 1 succeeded

Host
73ccef5e07c2:267118
Started
2026-11-08T10:43:30Z
Ended
2026-11-08T10:45:04Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
722 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
144.4 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3645/load_day/2025-03-08/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:43:30Z [load_day 2025-03-08] attempt 1 started
2026-11-08T10:43:31Z [load_day 2025-03-08] 2025-03-08: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:43:38Z [load_day 2025-03-08] 2025-03-08 hour 0: 216104 events in 0 files, snapshot none (task 6437 ms: download 3198 ms overlapping gunzip 907 ms, parse 3905 ms, sort 0 ms, write 0 ms, index 1173 ms: 17 candidates, 107728 repo-hours, 1471 releases; waiting 195 ms; commit 0 ms)
2026-11-08T10:43:38Z [load_day 2025-03-08] 2025-03-08 hour 1: 215341 events in 0 files, snapshot none (task 6509 ms: download 3657 ms overlapping gunzip 849 ms, parse 3631 ms, sort 0 ms, write 0 ms, index 923 ms: 6 candidates, 113431 repo-hours, 1168 releases; waiting 751 ms; commit 0 ms)
2026-11-08T10:43:45Z [load_day 2025-03-08] 2025-03-08 hour 2: 182601 events in 0 files, snapshot none (task 6654 ms: download 3717 ms overlapping gunzip 1053 ms, parse 4494 ms, sort 0 ms, write 0 ms, index 578 ms: 6 candidates, 64675 repo-hours, 975 releases; waiting 233 ms; commit 0 ms)
2026-11-08T10:43:46Z [load_day 2025-03-08] 2025-03-08 hour 3: 196906 events in 0 files, snapshot none (task 6884 ms: download 3806 ms overlapping gunzip 1033 ms, parse 4498 ms, sort 0 ms, write 0 ms, index 589 ms: 10 candidates, 73291 repo-hours, 3911 releases; waiting 467 ms; commit 0 ms)
2026-11-08T10:43:52Z [load_day 2025-03-08] 2025-03-08 hour 4: 184164 events in 0 files, snapshot none (task 5935 ms: download 3098 ms overlapping gunzip 855 ms, parse 3842 ms, sort 0 ms, write 0 ms, index 628 ms: 6 candidates, 64027 repo-hours, 944 releases; waiting 361 ms; commit 0 ms)
2026-11-08T10:43:53Z [load_day 2025-03-08] 2025-03-08 hour 5: 187507 events in 0 files, snapshot none (task 7014 ms: download 4066 ms overlapping gunzip 963 ms, parse 4094 ms, sort 0 ms, write 0 ms, index 703 ms: 8 candidates, 66756 repo-hours, 804 releases; waiting 1036 ms; commit 0 ms)
2026-11-08T10:43:59Z [load_day 2025-03-08] 2025-03-08 hour 6: 207535 events in 0 files, snapshot none (task 6357 ms: download 3978 ms overlapping gunzip 950 ms, parse 4040 ms, sort 0 ms, write 0 ms, index 643 ms: 12 candidates, 85454 repo-hours, 1107 releases; waiting 506 ms; commit 0 ms)
2026-11-08T10:43:59Z [load_day 2025-03-08] 2025-03-08 hour 7: 193134 events in 0 files, snapshot none (task 5701 ms: download 3194 ms overlapping gunzip 837 ms, parse 3526 ms, sort 0 ms, write 0 ms, index 559 ms: 10 candidates, 69892 repo-hours, 887 releases; waiting 525 ms; commit 0 ms)
2026-11-08T10:44:05Z [load_day 2025-03-08] 2025-03-08 hour 8: 197611 events in 0 files, snapshot none (task 6112 ms: download 3081 ms overlapping gunzip 824 ms, parse 3624 ms, sort 0 ms, write 0 ms, index 837 ms: 14 candidates, 76064 repo-hours, 1029 releases; waiting 488 ms; commit 0 ms)
2026-11-08T10:44:06Z [load_day 2025-03-08] 2025-03-08 hour 9: 207792 events in 0 files, snapshot none (task 6201 ms: download 3352 ms overlapping gunzip 892 ms, parse 3813 ms, sort 0 ms, write 0 ms, index 718 ms: 8 candidates, 84112 repo-hours, 1135 releases; waiting 538 ms; commit 0 ms)
2026-11-08T10:44:12Z [load_day 2025-03-08] 2025-03-08 hour 10: 204780 events in 0 files, snapshot none (task 6162 ms: download 3394 ms overlapping gunzip 915 ms, parse 3884 ms, sort 0 ms, write 0 ms, index 577 ms: 15 candidates, 80354 repo-hours, 890 releases; waiting 526 ms; commit 0 ms)
2026-11-08T10:44:12Z [load_day 2025-03-08] 2025-03-08 hour 11: 194875 events in 0 files, snapshot none (task 5428 ms: download 3121 ms overlapping gunzip 754 ms, parse 3176 ms, sort 0 ms, write 0 ms, index 569 ms: 14 candidates, 73482 repo-hours, 803 releases; waiting 526 ms; commit 0 ms)
2026-11-08T10:44:18Z [load_day 2025-03-08] 2025-03-08 hour 12: 266244 events in 0 files, snapshot none (task 5968 ms: download 2890 ms overlapping gunzip 756 ms, parse 3478 ms, sort 0 ms, write 0 ms, index 983 ms: 12 candidates, 119636 repo-hours, 917 releases; waiting 492 ms; commit 0 ms)
2026-11-08T10:44:20Z [load_day 2025-03-08] 2025-03-08 hour 13: 226314 events in 0 files, snapshot none (task 6815 ms: download 4064 ms overlapping gunzip 824 ms, parse 3660 ms, sort 0 ms, write 0 ms, index 745 ms: 11 candidates, 95168 repo-hours, 870 releases; waiting 1332 ms; commit 0 ms)
2026-11-08T10:44:25Z [load_day 2025-03-08] 2025-03-08 hour 14: 221797 events in 0 files, snapshot none (task 6368 ms: download 3431 ms overlapping gunzip 953 ms, parse 3948 ms, sort 0 ms, write 0 ms, index 687 ms: 10 candidates, 83964 repo-hours, 1011 releases; waiting 409 ms; commit 0 ms)
2026-11-08T10:44:27Z [load_day 2025-03-08] 2025-03-08 hour 15: 232168 events in 0 files, snapshot none (task 6830 ms: download 4031 ms overlapping gunzip 989 ms, parse 4345 ms, sort 0 ms, write 0 ms, index 680 ms: 11 candidates, 93057 repo-hours, 1174 releases; waiting 329 ms; commit 0 ms)
2026-11-08T10:44:33Z [load_day 2025-03-08] 2025-03-08 hour 16: 226314 events in 0 files, snapshot none (task 7594 ms: download 4634 ms overlapping gunzip 953 ms, parse 3914 ms, sort 0 ms, write 0 ms, index 797 ms: 10 candidates, 86213 repo-hours, 980 releases; waiting 1604 ms; commit 0 ms)
2026-11-08T10:44:33Z [load_day 2025-03-08] 2025-03-08 hour 17: 198177 events in 0 files, snapshot none (task 5933 ms: download 2828 ms overlapping gunzip 761 ms, parse 3276 ms, sort 0 ms, write 0 ms, index 960 ms: 9 candidates, 77537 repo-hours, 689 releases; waiting 557 ms; commit 0 ms)
2026-11-08T10:44:40Z [load_day 2025-03-08] 2025-03-08 hour 18: 231541 events in 0 files, snapshot none (task 6041 ms: download 3438 ms overlapping gunzip 868 ms, parse 3679 ms, sort 0 ms, write 0 ms, index 701 ms: 5 candidates, 95496 repo-hours, 1053 releases; waiting 490 ms; commit 0 ms)
2026-11-08T10:44:40Z [load_day 2025-03-08] 2025-03-08 hour 19: 196059 events in 0 files, snapshot none (task 5258 ms: download 2853 ms overlapping gunzip 729 ms, parse 3243 ms, sort 0 ms, write 0 ms, index 549 ms: 7 candidates, 68963 repo-hours, 887 releases; waiting 497 ms; commit 0 ms)
2026-11-08T10:44:46Z [load_day 2025-03-08] 2025-03-08 hour 20: 194913 events in 0 files, snapshot none (task 5101 ms: download 2738 ms overlapping gunzip 695 ms, parse 3085 ms, sort 0 ms, write 0 ms, index 532 ms: 2 candidates, 70653 repo-hours, 869 releases; waiting 506 ms; commit 0 ms)
2026-11-08T10:44:46Z [load_day 2025-03-08] 2025-03-08 hour 21: 198552 events in 0 files, snapshot none (task 5035 ms: download 2596 ms overlapping gunzip 727 ms, parse 3173 ms, sort 0 ms, write 0 ms, index 543 ms: 13 candidates, 71185 repo-hours, 964 releases; waiting 361 ms; commit 0 ms)
2026-11-08T10:44:53Z [load_day 2025-03-08] 2025-03-08 hour 22: 180529 events in 0 files, snapshot none (task 6460 ms: download 3357 ms overlapping gunzip 1039 ms, parse 4315 ms, sort 0 ms, write 0 ms, index 534 ms: 6 candidates, 62550 repo-hours, 1010 releases; waiting 228 ms; commit 0 ms)
2026-11-08T10:44:53Z [load_day 2025-03-08] 2025-03-08 hour 23: 172770 events in 0 files, snapshot none (task 6156 ms: download 3111 ms overlapping gunzip 798 ms, parse 3864 ms, sort 0 ms, write 0 ms, index 670 ms: 6 candidates, 59327 repo-hours, 903 releases; waiting 505 ms; commit 0 ms)
2026-11-08T10:45:01Z [load_day 2025-03-08] 2025-03-08: repo_hour merged from 24 files to 1 (1943015 rows, 8593 ms)
2026-11-08T10:45:04Z [load_day 2025-03-08] 2025-03-08: index committed in 11266 ms (24 + 1 + 24 files)
2026-11-08T10:45:04Z [load_day 2025-03-08] 2025-03-08: 4933728 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:45:04Z [load_day 2025-03-08] attempt 1 succeeded