orcaLog in

Runs · run 2893

load_day 2024-08-26, attempt 1 succeeded

Host
73ccef5e07c2:169769
Started
2026-11-08T07:36:55Z
Ended
2026-11-08T07:39:00Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
829 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
203.6 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2893/load_day/2024-08-26/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:36:55Z [load_day 2024-08-26] attempt 1 started
2026-11-08T07:36:56Z [load_day 2024-08-26] 2024-08-26: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:37:03Z [load_day 2024-08-26] 2024-08-26 hour 0: 175360 events in 0 files, snapshot none (task 7009 ms: download 4480 ms overlapping gunzip 1088 ms, parse 4334 ms, sort 0 ms, write 0 ms, index 592 ms: 7 candidates, 84783 repo-hours, 1061 releases; waiting 708 ms; commit 0 ms)
2026-11-08T07:37:03Z [load_day 2024-08-26] 2024-08-26 hour 1: 190803 events in 0 files, snapshot none (task 6885 ms: download 4385 ms overlapping gunzip 1121 ms, parse 4313 ms, sort 0 ms, write 0 ms, index 681 ms: 5 candidates, 103365 repo-hours, 831 releases; waiting 505 ms; commit 0 ms)
2026-11-08T07:37:11Z [load_day 2024-08-26] 2024-08-26 hour 2: 162098 events in 0 files, snapshot none (task 7564 ms: download 5257 ms overlapping gunzip 1255 ms, parse 5104 ms, sort 0 ms, write 0 ms, index 469 ms: 4 candidates, 66445 repo-hours, 928 releases; waiting 516 ms; commit 0 ms)
2026-11-08T07:37:12Z [load_day 2024-08-26] 2024-08-26 hour 3: 182256 events in 0 files, snapshot none (task 7917 ms: download 5419 ms overlapping gunzip 1387 ms, parse 5152 ms, sort 0 ms, write 0 ms, index 532 ms: 7 candidates, 73542 repo-hours, 4780 releases; waiting 572 ms; commit 0 ms)
2026-11-08T07:37:19Z [load_day 2024-08-26] 2024-08-26 hour 4: 167023 events in 0 files, snapshot none (task 7348 ms: download 4468 ms overlapping gunzip 1191 ms, parse 4513 ms, sort 0 ms, write 0 ms, index 1011 ms: 4 candidates, 60763 repo-hours, 751 releases; waiting 294 ms; commit 0 ms)
2026-11-08T07:37:20Z [load_day 2024-08-26] 2024-08-26 hour 5: 179227 events in 0 files, snapshot none (task 8056 ms: download 4812 ms overlapping gunzip 1313 ms, parse 4992 ms, sort 0 ms, write 0 ms, index 886 ms: 5 candidates, 66468 repo-hours, 838 releases; waiting 522 ms; commit 0 ms)
2026-11-08T07:37:28Z [load_day 2024-08-26] 2024-08-26 hour 6: 211675 events in 0 files, snapshot none (task 7811 ms: download 5046 ms overlapping gunzip 1230 ms, parse 5009 ms, sort 0 ms, write 0 ms, index 699 ms: 8 candidates, 91862 repo-hours, 1022 releases; waiting 583 ms; commit 0 ms)
2026-11-08T07:37:29Z [load_day 2024-08-26] 2024-08-26 hour 7: 215635 events in 0 files, snapshot none (task 8391 ms: download 5728 ms overlapping gunzip 1359 ms, parse 5533 ms, sort 0 ms, write 0 ms, index 668 ms: 6 candidates, 85234 repo-hours, 1055 releases; waiting 499 ms; commit 0 ms)
2026-11-08T07:37:36Z [load_day 2024-08-26] 2024-08-26 hour 8: 224714 events in 0 files, snapshot none (task 8051 ms: download 5326 ms overlapping gunzip 1278 ms, parse 5040 ms, sort 0 ms, write 0 ms, index 964 ms: 15 candidates, 91890 repo-hours, 1176 releases; waiting 510 ms; commit 0 ms)
2026-11-08T07:37:38Z [load_day 2024-08-26] 2024-08-26 hour 9: 231994 events in 0 files, snapshot none (task 8150 ms: download 5312 ms overlapping gunzip 1283 ms, parse 5099 ms, sort 0 ms, write 0 ms, index 882 ms: 11 candidates, 98491 repo-hours, 1290 releases; waiting 583 ms; commit 0 ms)
2026-11-08T07:37:46Z [load_day 2024-08-26] 2024-08-26 hour 10: 222057 events in 0 files, snapshot none (task 9400 ms: download 5829 ms overlapping gunzip 1533 ms, parse 5990 ms, sort 0 ms, write 0 ms, index 720 ms: 7 candidates, 90200 repo-hours, 1080 releases; waiting 809 ms; commit 0 ms)
2026-11-08T07:37:47Z [load_day 2024-08-26] 2024-08-26 hour 11: 222366 events in 0 files, snapshot none (task 9196 ms: download 6533 ms overlapping gunzip 1504 ms, parse 6269 ms, sort 0 ms, write 0 ms, index 667 ms: 6 candidates, 87851 repo-hours, 1130 releases; waiting 447 ms; commit 0 ms)
2026-11-08T07:37:57Z [load_day 2024-08-26] 2024-08-26 hour 12: 273933 events in 0 files, snapshot none (task 10200 ms: download 7085 ms overlapping gunzip 1567 ms, parse 6695 ms, sort 0 ms, write 0 ms, index 1197 ms: 6 candidates, 134336 repo-hours, 1379 releases; waiting 492 ms; commit 0 ms)
2026-11-08T07:37:59Z [load_day 2024-08-26] 2024-08-26 hour 13: 253851 events in 0 files, snapshot none (task 10992 ms: download 7435 ms overlapping gunzip 1757 ms, parse 7394 ms, sort 0 ms, write 0 ms, index 1102 ms: 12 candidates, 115831 repo-hours, 1298 releases; waiting 511 ms; commit 0 ms)
2026-11-08T07:38:09Z [load_day 2024-08-26] 2024-08-26 hour 14: 241683 events in 0 files, snapshot none (task 11021 ms: download 6758 ms overlapping gunzip 1842 ms, parse 7465 ms, sort 0 ms, write 0 ms, index 1071 ms: 5 candidates, 99915 repo-hours, 1223 releases; waiting 331 ms; commit 0 ms)
2026-11-08T07:38:10Z [load_day 2024-08-26] 2024-08-26 hour 15: 248476 events in 0 files, snapshot none (task 10853 ms: download 7858 ms overlapping gunzip 1758 ms, parse 7225 ms, sort 0 ms, write 0 ms, index 1108 ms: 11 candidates, 106706 repo-hours, 1365 releases; waiting 503 ms; commit 0 ms)
2026-11-08T07:38:21Z [load_day 2024-08-26] 2024-08-26 hour 16: 251426 events in 0 files, snapshot none (task 11623 ms: download 8784 ms overlapping gunzip 2280 ms, parse 8041 ms, sort 0 ms, write 0 ms, index 859 ms: 17 candidates, 108408 repo-hours, 1124 releases; waiting 204 ms; commit 0 ms)
2026-11-08T07:38:22Z [load_day 2024-08-26] 2024-08-26 hour 17: 241027 events in 0 files, snapshot none (task 11446 ms: download 8795 ms overlapping gunzip 1891 ms, parse 7206 ms, sort 0 ms, write 0 ms, index 843 ms: 11 candidates, 101262 repo-hours, 1076 releases; waiting 1203 ms; commit 0 ms)
2026-11-08T07:38:31Z [load_day 2024-08-26] 2024-08-26 hour 18: 244922 events in 0 files, snapshot none (task 9522 ms: download 6804 ms overlapping gunzip 1637 ms, parse 6563 ms, sort 0 ms, write 0 ms, index 868 ms: 16 candidates, 111147 repo-hours, 1189 releases; waiting 229 ms; commit 0 ms)
2026-11-08T07:38:32Z [load_day 2024-08-26] 2024-08-26 hour 19: 212775 events in 0 files, snapshot none (task 8689 ms: download 6328 ms overlapping gunzip 1511 ms, parse 5824 ms, sort 0 ms, write 0 ms, index 578 ms: 11 candidates, 81426 repo-hours, 1095 releases; waiting 458 ms; commit 0 ms)
2026-11-08T07:38:40Z [load_day 2024-08-26] 2024-08-26 hour 20: 207572 events in 0 files, snapshot none (task 9074 ms: download 6560 ms overlapping gunzip 1500 ms, parse 6088 ms, sort 0 ms, write 0 ms, index 656 ms: 9 candidates, 83148 repo-hours, 902 releases; waiting 525 ms; commit 0 ms)
2026-11-08T07:38:40Z [load_day 2024-08-26] 2024-08-26 hour 21: 194885 events in 0 files, snapshot none (task 8231 ms: download 5424 ms overlapping gunzip 1372 ms, parse 5635 ms, sort 0 ms, write 0 ms, index 627 ms: 2 candidates, 76326 repo-hours, 1194 releases; waiting 198 ms; commit 0 ms)
2026-11-08T07:38:49Z [load_day 2024-08-26] 2024-08-26 hour 22: 177005 events in 0 files, snapshot none (task 7967 ms: download 5455 ms overlapping gunzip 1253 ms, parse 5272 ms, sort 0 ms, write 0 ms, index 454 ms: 9 candidates, 63969 repo-hours, 1122 releases; waiting 723 ms; commit 0 ms)
2026-11-08T07:38:49Z [load_day 2024-08-26] 2024-08-26 hour 23: 175858 events in 0 files, snapshot none (task 7708 ms: download 4619 ms overlapping gunzip 1210 ms, parse 4892 ms, sort 0 ms, write 0 ms, index 779 ms: 6 candidates, 67829 repo-hours, 793 releases; waiting 526 ms; commit 0 ms)
2026-11-08T07:38:58Z [load_day 2024-08-26] 2024-08-26: repo_hour merged from 24 files to 1 (2151197 rows, 9126 ms)
2026-11-08T07:39:00Z [load_day 2024-08-26] 2024-08-26: index committed in 11589 ms (24 + 1 + 24 files)
2026-11-08T07:39:00Z [load_day 2024-08-26] 2024-08-26: 5108621 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:39:00Z [load_day 2024-08-26] attempt 1 succeeded