orcaLog in

Runs · run 3314

load_day 2024-12-13, attempt 1 succeeded

Host
73ccef5e07c2:221937
Started
2026-11-08T09:21:11Z
Ended
2026-11-08T09:23:10Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
745 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
180.6 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3314/load_day/2024-12-13/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:21:11Z [load_day 2024-12-13] attempt 1 started
2026-11-08T09:21:12Z [load_day 2024-12-13] 2024-12-13: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:21:22Z [load_day 2024-12-13] 2024-12-13 hour 0: 182300 events in 0 files, snapshot none (task 9565 ms: download 5381 ms overlapping gunzip 1543 ms, parse 6164 ms, sort 0 ms, write 0 ms, index 1026 ms: 7 candidates, 83872 repo-hours, 1439 releases; waiting 520 ms; commit 0 ms)
2026-11-08T09:21:22Z [load_day 2024-12-13] 2024-12-13 hour 1: 207335 events in 0 files, snapshot none (task 9752 ms: download 5669 ms overlapping gunzip 1515 ms, parse 6496 ms, sort 0 ms, write 0 ms, index 1237 ms: 8 candidates, 111320 repo-hours, 875 releases; waiting 185 ms; commit 0 ms)
2026-11-08T09:21:30Z [load_day 2024-12-13] 2024-12-13 hour 2: 191012 events in 0 files, snapshot none (task 7798 ms: download 4125 ms overlapping gunzip 1206 ms, parse 4895 ms, sort 0 ms, write 0 ms, index 872 ms: 4 candidates, 92897 repo-hours, 1089 releases; waiting 547 ms; commit 0 ms)
2026-11-08T09:21:30Z [load_day 2024-12-13] 2024-12-13 hour 3: 190363 events in 0 files, snapshot none (task 6939 ms: download 3584 ms overlapping gunzip 1071 ms, parse 4476 ms, sort 0 ms, write 0 ms, index 876 ms: 1 candidates, 79196 repo-hours, 4109 releases; waiting 226 ms; commit 0 ms)
2026-11-08T09:21:37Z [load_day 2024-12-13] 2024-12-13 hour 4: 171983 events in 0 files, snapshot none (task 6287 ms: download 3781 ms overlapping gunzip 962 ms, parse 4029 ms, sort 0 ms, write 0 ms, index 503 ms: 4 candidates, 64754 repo-hours, 786 releases; waiting 495 ms; commit 0 ms)
2026-11-08T09:21:37Z [load_day 2024-12-13] 2024-12-13 hour 5: 176964 events in 0 files, snapshot none (task 6065 ms: download 3684 ms overlapping gunzip 950 ms, parse 3813 ms, sort 0 ms, write 0 ms, index 532 ms: 2 candidates, 69254 repo-hours, 755 releases; waiting 480 ms; commit 0 ms)
2026-11-08T09:21:46Z [load_day 2024-12-13] 2024-12-13 hour 6: 202655 events in 0 files, snapshot none (task 8236 ms: download 5494 ms overlapping gunzip 1336 ms, parse 5352 ms, sort 0 ms, write 0 ms, index 789 ms: 9 candidates, 90629 repo-hours, 904 releases; waiting 440 ms; commit 0 ms)
2026-11-08T09:21:46Z [load_day 2024-12-13] 2024-12-13 hour 7: 202159 events in 0 files, snapshot none (task 8247 ms: download 5248 ms overlapping gunzip 1340 ms, parse 5486 ms, sort 0 ms, write 0 ms, index 739 ms: 6 candidates, 79148 repo-hours, 1130 releases; waiting 439 ms; commit 0 ms)
2026-11-08T09:21:55Z [load_day 2024-12-13] 2024-12-13 hour 8: 209745 events in 0 files, snapshot none (task 8737 ms: download 5937 ms overlapping gunzip 1407 ms, parse 5832 ms, sort 0 ms, write 0 ms, index 686 ms: 9 candidates, 88458 repo-hours, 1087 releases; waiting 507 ms; commit 0 ms)
2026-11-08T09:21:56Z [load_day 2024-12-13] 2024-12-13 hour 9: 219415 events in 0 files, snapshot none (task 9567 ms: download 6891 ms overlapping gunzip 1482 ms, parse 6307 ms, sort 0 ms, write 0 ms, index 730 ms: 9 candidates, 94778 repo-hours, 1297 releases; waiting 753 ms; commit 0 ms)
2026-11-08T09:22:05Z [load_day 2024-12-13] 2024-12-13 hour 10: 213259 events in 0 files, snapshot none (task 9005 ms: download 5746 ms overlapping gunzip 1445 ms, parse 6197 ms, sort 0 ms, write 0 ms, index 810 ms: 4 candidates, 88926 repo-hours, 1191 releases; waiting 258 ms; commit 0 ms)
2026-11-08T09:22:06Z [load_day 2024-12-13] 2024-12-13 hour 11: 212383 events in 0 files, snapshot none (task 9146 ms: download 6578 ms overlapping gunzip 1472 ms, parse 6082 ms, sort 0 ms, write 0 ms, index 649 ms: 5 candidates, 83616 repo-hours, 1085 releases; waiting 669 ms; commit 0 ms)
2026-11-08T09:22:13Z [load_day 2024-12-13] 2024-12-13 hour 12: 239259 events in 0 files, snapshot none (task 8089 ms: download 5258 ms overlapping gunzip 1151 ms, parse 4964 ms, sort 0 ms, write 0 ms, index 849 ms: 7 candidates, 122067 repo-hours, 1163 releases; waiting 846 ms; commit 0 ms)
2026-11-08T09:22:13Z [load_day 2024-12-13] 2024-12-13 hour 13: 228480 events in 0 files, snapshot none (task 7365 ms: download 4816 ms overlapping gunzip 1151 ms, parse 4726 ms, sort 0 ms, write 0 ms, index 724 ms: 7 candidates, 108130 repo-hours, 1095 releases; waiting 545 ms; commit 0 ms)
2026-11-08T09:22:22Z [load_day 2024-12-13] 2024-12-13 hour 14: 224025 events in 0 files, snapshot none (task 7997 ms: download 5090 ms overlapping gunzip 1178 ms, parse 4984 ms, sort 0 ms, write 0 ms, index 1052 ms: 4 candidates, 94140 repo-hours, 1401 releases; waiting 517 ms; commit 0 ms)
2026-11-08T09:22:23Z [load_day 2024-12-13] 2024-12-13 hour 15: 235053 events in 0 files, snapshot none (task 9162 ms: download 5748 ms overlapping gunzip 1302 ms, parse 5403 ms, sort 0 ms, write 0 ms, index 1019 ms: 7 candidates, 102504 repo-hours, 1371 releases; waiting 895 ms; commit 0 ms)
2026-11-08T09:22:32Z [load_day 2024-12-13] 2024-12-13 hour 16: 219344 events in 0 files, snapshot none (task 9378 ms: download 4857 ms overlapping gunzip 1516 ms, parse 6273 ms, sort 0 ms, write 0 ms, index 967 ms: 12 candidates, 92926 repo-hours, 1232 releases; waiting 0 ms; commit 0 ms)
2026-11-08T09:22:32Z [load_day 2024-12-13] 2024-12-13 hour 17: 216857 events in 0 files, snapshot none (task 8442 ms: download 5443 ms overlapping gunzip 1352 ms, parse 5608 ms, sort 0 ms, write 0 ms, index 706 ms: 7 candidates, 84738 repo-hours, 1165 releases; waiting 491 ms; commit 0 ms)
2026-11-08T09:22:41Z [load_day 2024-12-13] 2024-12-13 hour 18: 223697 events in 0 files, snapshot none (task 8545 ms: download 5890 ms overlapping gunzip 1340 ms, parse 5787 ms, sort 0 ms, write 0 ms, index 792 ms: 8 candidates, 96219 repo-hours, 1148 releases; waiting 326 ms; commit 0 ms)
2026-11-08T09:22:41Z [load_day 2024-12-13] 2024-12-13 hour 19: 197694 events in 0 files, snapshot none (task 7939 ms: download 5472 ms overlapping gunzip 1182 ms, parse 5327 ms, sort 0 ms, write 0 ms, index 611 ms: 2 candidates, 73991 repo-hours, 1159 releases; waiting 519 ms; commit 0 ms)
2026-11-08T09:22:49Z [load_day 2024-12-13] 2024-12-13 hour 20: 197176 events in 0 files, snapshot none (task 7884 ms: download 4695 ms overlapping gunzip 1245 ms, parse 5169 ms, sort 0 ms, write 0 ms, index 657 ms: 1 candidates, 74402 repo-hours, 977 releases; waiting 504 ms; commit 0 ms)
2026-11-08T09:22:50Z [load_day 2024-12-13] 2024-12-13 hour 21: 189563 events in 0 files, snapshot none (task 8034 ms: download 4959 ms overlapping gunzip 1273 ms, parse 5007 ms, sort 0 ms, write 0 ms, index 591 ms: 3 candidates, 73689 repo-hours, 1073 releases; waiting 799 ms; commit 0 ms)
2026-11-08T09:22:57Z [load_day 2024-12-13] 2024-12-13 hour 22: 195081 events in 0 files, snapshot none (task 7355 ms: download 4914 ms overlapping gunzip 1097 ms, parse 4960 ms, sort 0 ms, write 0 ms, index 620 ms: 5 candidates, 89109 repo-hours, 1141 releases; waiting 401 ms; commit 0 ms)
2026-11-08T09:22:57Z [load_day 2024-12-13] 2024-12-13 hour 23: 166584 events in 0 files, snapshot none (task 7093 ms: download 4895 ms overlapping gunzip 1100 ms, parse 4709 ms, sort 0 ms, write 0 ms, index 440 ms: 7 candidates, 61246 repo-hours, 865 releases; waiting 563 ms; commit 0 ms)
2026-11-08T09:23:07Z [load_day 2024-12-13] 2024-12-13: repo_hour merged from 24 files to 1 (2100009 rows, 9894 ms)
2026-11-08T09:23:10Z [load_day 2024-12-13] 2024-12-13: index committed in 12199 ms (24 + 1 + 24 files)
2026-11-08T09:23:10Z [load_day 2024-12-13] 2024-12-13: 4912386 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:23:10Z [load_day 2024-12-13] attempt 1 succeeded