orcaLog in

Runs · run 3007

load_day 2024-09-25, attempt 1 succeeded

Host
73ccef5e07c2:183283
Started
2026-11-08T08:05:06Z
Ended
2026-11-08T08:06:52Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
871 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
153.2 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3007/load_day/2024-09-25/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:05:06Z [load_day 2024-09-25] attempt 1 started
2026-11-08T08:05:08Z [load_day 2024-09-25] 2024-09-25: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:05:14Z [load_day 2024-09-25] 2024-09-25 hour 0: 177060 events in 0 files, snapshot none (task 5404 ms: download 2558 ms overlapping gunzip 750 ms, parse 2980 ms, sort 0 ms, write 0 ms, index 853 ms: 7 candidates, 85418 repo-hours, 1035 releases; waiting 501 ms; commit 0 ms)
2026-11-08T08:05:14Z [load_day 2024-09-25] 2024-09-25 hour 1: 198034 events in 0 files, snapshot none (task 5827 ms: download 3821 ms overlapping gunzip 843 ms, parse 3223 ms, sort 0 ms, write 0 ms, index 788 ms: 4 candidates, 109292 repo-hours, 1077 releases; waiting 479 ms; commit 0 ms)
2026-11-08T08:05:20Z [load_day 2024-09-25] 2024-09-25 hour 2: 175772 events in 0 files, snapshot none (task 5513 ms: download 2981 ms overlapping gunzip 816 ms, parse 3191 ms, sort 0 ms, write 0 ms, index 637 ms: 9 candidates, 80653 repo-hours, 770 releases; waiting 583 ms; commit 0 ms)
2026-11-08T08:05:20Z [load_day 2024-09-25] 2024-09-25 hour 3: 188661 events in 0 files, snapshot none (task 5511 ms: download 4088 ms overlapping gunzip 810 ms, parse 3240 ms, sort 0 ms, write 0 ms, index 601 ms: 8 candidates, 79272 repo-hours, 4237 releases; waiting 506 ms; commit 0 ms)
2026-11-08T08:05:26Z [load_day 2024-09-25] 2024-09-25 hour 4: 172084 events in 0 files, snapshot none (task 5659 ms: download 3105 ms overlapping gunzip 888 ms, parse 3476 ms, sort 0 ms, write 0 ms, index 508 ms: 6 candidates, 67400 repo-hours, 751 releases; waiting 511 ms; commit 0 ms)
2026-11-08T08:05:27Z [load_day 2024-09-25] 2024-09-25 hour 5: 182999 events in 0 files, snapshot none (task 6076 ms: download 3482 ms overlapping gunzip 991 ms, parse 3706 ms, sort 0 ms, write 0 ms, index 605 ms: 3 candidates, 71820 repo-hours, 1008 releases; waiting 514 ms; commit 0 ms)
2026-11-08T08:05:33Z [load_day 2024-09-25] 2024-09-25 hour 6: 218984 events in 0 files, snapshot none (task 7118 ms: download 4330 ms overlapping gunzip 1164 ms, parse 4332 ms, sort 0 ms, write 0 ms, index 733 ms: 3 candidates, 97352 repo-hours, 1173 releases; waiting 579 ms; commit 0 ms)
2026-11-08T08:05:34Z [load_day 2024-09-25] 2024-09-25 hour 7: 225943 events in 0 files, snapshot none (task 6929 ms: download 4483 ms overlapping gunzip 1170 ms, parse 4481 ms, sort 0 ms, write 0 ms, index 679 ms: 7 candidates, 91094 repo-hours, 1075 releases; waiting 342 ms; commit 0 ms)
2026-11-08T08:05:40Z [load_day 2024-09-25] 2024-09-25 hour 8: 233962 events in 0 files, snapshot none (task 6112 ms: download 3391 ms overlapping gunzip 911 ms, parse 3542 ms, sort 0 ms, write 0 ms, index 964 ms: 5 candidates, 99667 repo-hours, 1349 releases; waiting 303 ms; commit 0 ms)
2026-11-08T08:05:41Z [load_day 2024-09-25] 2024-09-25 hour 9: 236924 events in 0 files, snapshot none (task 5941 ms: download 3624 ms overlapping gunzip 960 ms, parse 3528 ms, sort 0 ms, write 0 ms, index 663 ms: 7 candidates, 102106 repo-hours, 1541 releases; waiting 511 ms; commit 0 ms)
2026-11-08T08:05:48Z [load_day 2024-09-25] 2024-09-25 hour 10: 225784 events in 0 files, snapshot none (task 5546 ms: download 3183 ms overlapping gunzip 890 ms, parse 3285 ms, sort 0 ms, write 0 ms, index 659 ms: 7 candidates, 93843 repo-hours, 1316 releases; waiting 395 ms; commit 0 ms)
2026-11-08T08:05:48Z [load_day 2024-09-25] 2024-09-25 hour 11: 227773 events in 0 files, snapshot none (task 5390 ms: download 3002 ms overlapping gunzip 884 ms, parse 3326 ms, sort 0 ms, write 0 ms, index 710 ms: 14 candidates, 92056 repo-hours, 1158 releases; waiting 172 ms; commit 0 ms)
2026-11-08T08:05:58Z [load_day 2024-09-25] 2024-09-25 hour 12: 272434 events in 0 files, snapshot none (task 9336 ms: download 6123 ms overlapping gunzip 1444 ms, parse 5683 ms, sort 0 ms, write 0 ms, index 1260 ms: 8 candidates, 139815 repo-hours, 1455 releases; waiting 478 ms; commit 0 ms)
2026-11-08T08:05:58Z [load_day 2024-09-25] 2024-09-25 hour 13: 257688 events in 0 files, snapshot none (task 9185 ms: download 6387 ms overlapping gunzip 1526 ms, parse 5746 ms, sort 0 ms, write 0 ms, index 1033 ms: 7 candidates, 120736 repo-hours, 1466 releases; waiting 549 ms; commit 0 ms)
2026-11-08T08:06:07Z [load_day 2024-09-25] 2024-09-25 hour 14: 262802 events in 0 files, snapshot none (task 8945 ms: download 5732 ms overlapping gunzip 1552 ms, parse 5679 ms, sort 0 ms, write 0 ms, index 737 ms: 4 candidates, 110473 repo-hours, 1591 releases; waiting 546 ms; commit 0 ms)
2026-11-08T08:06:07Z [load_day 2024-09-25] 2024-09-25 hour 15: 258164 events in 0 files, snapshot none (task 8209 ms: download 4992 ms overlapping gunzip 1421 ms, parse 5060 ms, sort 0 ms, write 0 ms, index 957 ms: 11 candidates, 113844 repo-hours, 1410 releases; waiting 516 ms; commit 0 ms)
2026-11-08T08:06:15Z [load_day 2024-09-25] 2024-09-25 hour 16: 234202 events in 0 files, snapshot none (task 7937 ms: download 5412 ms overlapping gunzip 1297 ms, parse 5173 ms, sort 0 ms, write 0 ms, index 661 ms: 9 candidates, 100026 repo-hours, 1187 releases; waiting 516 ms; commit 0 ms)
2026-11-08T08:06:16Z [load_day 2024-09-25] 2024-09-25 hour 17: 228928 events in 0 files, snapshot none (task 8428 ms: download 5791 ms overlapping gunzip 1477 ms, parse 5437 ms, sort 0 ms, write 0 ms, index 682 ms: 8 candidates, 93008 repo-hours, 1131 releases; waiting 539 ms; commit 0 ms)
2026-11-08T08:06:24Z [load_day 2024-09-25] 2024-09-25 hour 18: 241849 events in 0 files, snapshot none (task 7809 ms: download 4924 ms overlapping gunzip 1140 ms, parse 4908 ms, sort 0 ms, write 0 ms, index 861 ms: 7 candidates, 108878 repo-hours, 1141 releases; waiting 536 ms; commit 0 ms)
2026-11-08T08:06:24Z [load_day 2024-09-25] 2024-09-25 hour 19: 216162 events in 0 files, snapshot none (task 7224 ms: download 4886 ms overlapping gunzip 1237 ms, parse 4513 ms, sort 0 ms, write 0 ms, index 683 ms: 6 candidates, 86105 repo-hours, 1101 releases; waiting 513 ms; commit 0 ms)
2026-11-08T08:06:32Z [load_day 2024-09-25] 2024-09-25 hour 20: 208154 events in 0 files, snapshot none (task 7643 ms: download 5097 ms overlapping gunzip 1323 ms, parse 4781 ms, sort 0 ms, write 0 ms, index 643 ms: 13 candidates, 83248 repo-hours, 1094 releases; waiting 560 ms; commit 0 ms)
2026-11-08T08:06:32Z [load_day 2024-09-25] 2024-09-25 hour 21: 195665 events in 0 files, snapshot none (task 7264 ms: download 4627 ms overlapping gunzip 1203 ms, parse 4657 ms, sort 0 ms, write 0 ms, index 584 ms: 8 candidates, 77375 repo-hours, 1135 releases; waiting 543 ms; commit 0 ms)
2026-11-08T08:06:39Z [load_day 2024-09-25] 2024-09-25 hour 22: 173828 events in 0 files, snapshot none (task 6405 ms: download 3721 ms overlapping gunzip 1018 ms, parse 4006 ms, sort 0 ms, write 0 ms, index 582 ms: 2 candidates, 64919 repo-hours, 1171 releases; waiting 517 ms; commit 0 ms)
2026-11-08T08:06:39Z [load_day 2024-09-25] 2024-09-25 hour 23: 164397 events in 0 files, snapshot none (task 6063 ms: download 3231 ms overlapping gunzip 913 ms, parse 3666 ms, sort 0 ms, write 0 ms, index 610 ms: 7 candidates, 61690 repo-hours, 808 releases; waiting 508 ms; commit 0 ms)
2026-11-08T08:06:49Z [load_day 2024-09-25] 2024-09-25: repo_hour merged from 24 files to 1 (2230090 rows, 10552 ms)
2026-11-08T08:06:52Z [load_day 2024-09-25] 2024-09-25: index committed in 13498 ms (24 + 1 + 24 files)
2026-11-08T08:06:52Z [load_day 2024-09-25] 2024-09-25: 5178253 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:06:52Z [load_day 2024-09-25] attempt 1 succeeded