orcaLog in

Runs · run 3329

load_day 2024-12-16, attempt 1 succeeded

Host
73ccef5e07c2:223847
Started
2026-11-08T09:23:46Z
Ended
2026-11-08T09:25:54Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
721 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
209.6 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3329/load_day/2024-12-16/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:23:46Z [load_day 2024-12-16] attempt 1 started
2026-11-08T09:23:46Z [load_day 2024-12-16] 2024-12-16: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:23:54Z [load_day 2024-12-16] 2024-12-16 hour 0: 180515 events in 0 files, snapshot none (task 7083 ms: download 3965 ms overlapping gunzip 1146 ms, parse 4260 ms, sort 0 ms, write 0 ms, index 915 ms: 5 candidates, 78923 repo-hours, 1097 releases; waiting 486 ms; commit 0 ms)
2026-11-08T09:23:54Z [load_day 2024-12-16] 2024-12-16 hour 1: 210609 events in 0 files, snapshot none (task 7728 ms: download 4721 ms overlapping gunzip 1240 ms, parse 4816 ms, sort 0 ms, write 0 ms, index 810 ms: 11 candidates, 110002 repo-hours, 966 releases; waiting 558 ms; commit 0 ms)
2026-11-08T09:24:02Z [load_day 2024-12-16] 2024-12-16 hour 2: 179616 events in 0 files, snapshot none (task 7144 ms: download 4171 ms overlapping gunzip 1232 ms, parse 4656 ms, sort 0 ms, write 0 ms, index 620 ms: 5 candidates, 74549 repo-hours, 920 releases; waiting 315 ms; commit 0 ms)
2026-11-08T09:24:03Z [load_day 2024-12-16] 2024-12-16 hour 3: 210108 events in 0 files, snapshot none (task 7664 ms: download 4995 ms overlapping gunzip 1270 ms, parse 4964 ms, sort 0 ms, write 0 ms, index 650 ms: 6 candidates, 91855 repo-hours, 3937 releases; waiting 491 ms; commit 0 ms)
2026-11-08T09:24:10Z [load_day 2024-12-16] 2024-12-16 hour 4: 180250 events in 0 files, snapshot none (task 8329 ms: download 5683 ms overlapping gunzip 1356 ms, parse 5323 ms, sort 0 ms, write 0 ms, index 566 ms: 3 candidates, 64018 repo-hours, 673 releases; waiting 697 ms; commit 0 ms)
2026-11-08T09:24:10Z [load_day 2024-12-16] 2024-12-16 hour 5: 179000 events in 0 files, snapshot none (task 7366 ms: download 4803 ms overlapping gunzip 1229 ms, parse 4757 ms, sort 0 ms, write 0 ms, index 569 ms: 8 candidates, 68142 repo-hours, 776 releases; waiting 501 ms; commit 0 ms)
2026-11-08T09:24:19Z [load_day 2024-12-16] 2024-12-16 hour 6: 207376 events in 0 files, snapshot none (task 8365 ms: download 5704 ms overlapping gunzip 1515 ms, parse 5614 ms, sort 0 ms, write 0 ms, index 713 ms: 8 candidates, 92173 repo-hours, 1053 releases; waiting 216 ms; commit 0 ms)
2026-11-08T09:24:20Z [load_day 2024-12-16] 2024-12-16 hour 7: 208170 events in 0 files, snapshot none (task 9448 ms: download 6653 ms overlapping gunzip 1560 ms, parse 6338 ms, sort 0 ms, write 0 ms, index 650 ms: 6 candidates, 81412 repo-hours, 869 releases; waiting 574 ms; commit 0 ms)
2026-11-08T09:24:28Z [load_day 2024-12-16] 2024-12-16 hour 8: 219095 events in 0 files, snapshot none (task 7894 ms: download 5204 ms overlapping gunzip 1371 ms, parse 5277 ms, sort 0 ms, write 0 ms, index 665 ms: 7 candidates, 89808 repo-hours, 1060 releases; waiting 180 ms; commit 0 ms)
2026-11-08T09:24:29Z [load_day 2024-12-16] 2024-12-16 hour 9: 234859 events in 0 files, snapshot none (task 8249 ms: download 5792 ms overlapping gunzip 1393 ms, parse 5613 ms, sort 0 ms, write 0 ms, index 721 ms: 11 candidates, 98761 repo-hours, 1271 releases; waiting 253 ms; commit 0 ms)
2026-11-08T09:24:38Z [load_day 2024-12-16] 2024-12-16 hour 10: 228861 events in 0 files, snapshot none (task 9724 ms: download 6393 ms overlapping gunzip 1394 ms, parse 5341 ms, sort 0 ms, write 0 ms, index 1212 ms: 4 candidates, 92648 repo-hours, 1199 releases; waiting 1214 ms; commit 0 ms)
2026-11-08T09:24:38Z [load_day 2024-12-16] 2024-12-16 hour 11: 221057 events in 0 files, snapshot none (task 8059 ms: download 5239 ms overlapping gunzip 1323 ms, parse 5055 ms, sort 0 ms, write 0 ms, index 851 ms: 7 candidates, 86448 repo-hours, 1099 releases; waiting 528 ms; commit 0 ms)
2026-11-08T09:24:49Z [load_day 2024-12-16] 2024-12-16 hour 12: 244396 events in 0 files, snapshot none (task 10479 ms: download 6935 ms overlapping gunzip 1759 ms, parse 6798 ms, sort 0 ms, write 0 ms, index 1015 ms: 4 candidates, 123957 repo-hours, 1263 releases; waiting 551 ms; commit 0 ms)
2026-11-08T09:24:49Z [load_day 2024-12-16] 2024-12-16 hour 13: 244551 events in 0 files, snapshot none (task 10384 ms: download 6801 ms overlapping gunzip 1753 ms, parse 6898 ms, sort 0 ms, write 0 ms, index 928 ms: 5 candidates, 115684 repo-hours, 1178 releases; waiting 502 ms; commit 0 ms)
2026-11-08T09:25:00Z [load_day 2024-12-16] 2024-12-16 hour 14: 237611 events in 0 files, snapshot none (task 10362 ms: download 7798 ms overlapping gunzip 1645 ms, parse 7229 ms, sort 0 ms, write 0 ms, index 758 ms: 5 candidates, 102582 repo-hours, 1339 releases; waiting 506 ms; commit 0 ms)
2026-11-08T09:25:00Z [load_day 2024-12-16] 2024-12-16 hour 15: 248486 events in 0 files, snapshot none (task 10832 ms: download 8102 ms overlapping gunzip 1865 ms, parse 7412 ms, sort 0 ms, write 0 ms, index 941 ms: 7 candidates, 109139 repo-hours, 1340 releases; waiting 306 ms; commit 0 ms)
2026-11-08T09:25:11Z [load_day 2024-12-16] 2024-12-16 hour 16: 235390 events in 0 files, snapshot none (task 11083 ms: download 7515 ms overlapping gunzip 1842 ms, parse 7189 ms, sort 0 ms, write 0 ms, index 1235 ms: 13 candidates, 98207 repo-hours, 1278 releases; waiting 480 ms; commit 0 ms)
2026-11-08T09:25:12Z [load_day 2024-12-16] 2024-12-16 hour 17: 238636 events in 0 files, snapshot none (task 10858 ms: download 7665 ms overlapping gunzip 1836 ms, parse 7147 ms, sort 0 ms, write 0 ms, index 862 ms: 10 candidates, 92233 repo-hours, 1220 releases; waiting 669 ms; commit 0 ms)
2026-11-08T09:25:22Z [load_day 2024-12-16] 2024-12-16 hour 18: 230989 events in 0 files, snapshot none (task 10056 ms: download 6930 ms overlapping gunzip 1518 ms, parse 6366 ms, sort 0 ms, write 0 ms, index 913 ms: 9 candidates, 99774 repo-hours, 1177 releases; waiting 910 ms; commit 0 ms)
2026-11-08T09:25:22Z [load_day 2024-12-16] 2024-12-16 hour 19: 218339 events in 0 files, snapshot none (task 9276 ms: download 6086 ms overlapping gunzip 1542 ms, parse 6060 ms, sort 0 ms, write 0 ms, index 845 ms: 7 candidates, 82728 repo-hours, 996 releases; waiting 481 ms; commit 0 ms)
2026-11-08T09:25:32Z [load_day 2024-12-16] 2024-12-16 hour 20: 220664 events in 0 files, snapshot none (task 9242 ms: download 6335 ms overlapping gunzip 1604 ms, parse 6067 ms, sort 0 ms, write 0 ms, index 693 ms: 7 candidates, 84226 repo-hours, 980 releases; waiting 502 ms; commit 0 ms)
2026-11-08T09:25:32Z [load_day 2024-12-16] 2024-12-16 hour 21: 224728 events in 0 files, snapshot none (task 9693 ms: download 6566 ms overlapping gunzip 1561 ms, parse 6496 ms, sort 0 ms, write 0 ms, index 641 ms: 9 candidates, 81212 repo-hours, 1182 releases; waiting 535 ms; commit 0 ms)
2026-11-08T09:25:41Z [load_day 2024-12-16] 2024-12-16 hour 22: 208302 events in 0 files, snapshot none (task 8950 ms: download 5909 ms overlapping gunzip 1326 ms, parse 5722 ms, sort 0 ms, write 0 ms, index 692 ms: 10 candidates, 69599 repo-hours, 1169 releases; waiting 527 ms; commit 0 ms)
2026-11-08T09:25:42Z [load_day 2024-12-16] 2024-12-16 hour 23: 189486 events in 0 files, snapshot none (task 9145 ms: download 6614 ms overlapping gunzip 1546 ms, parse 6123 ms, sort 0 ms, write 0 ms, index 617 ms: 5 candidates, 66798 repo-hours, 917 releases; waiting 538 ms; commit 0 ms)
2026-11-08T09:25:51Z [load_day 2024-12-16] 2024-12-16: repo_hour merged from 24 files to 1 (2154878 rows, 9446 ms)
2026-11-08T09:25:54Z [load_day 2024-12-16] 2024-12-16: index committed in 12028 ms (24 + 1 + 24 files)
2026-11-08T09:25:54Z [load_day 2024-12-16] 2024-12-16: 5201094 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:25:54Z [load_day 2024-12-16] attempt 1 succeeded