orcaLog in

Runs · run 2548

load_day 2024-06-05, attempt 1 succeeded

Host
73ccef5e07c2:131756
Started
2026-11-08T06:24:09Z
Ended
2026-11-08T06:26:03Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
806 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
186.3 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2548/load_day/2024-06-05/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:24:09Z [load_day 2024-06-05] attempt 1 started
2026-11-08T06:24:10Z [load_day 2024-06-05] 2024-06-05: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:24:18Z [load_day 2024-06-05] 2024-06-05 hour 0: 198528 events in 0 files, snapshot none (task 6805 ms: download 4101 ms overlapping gunzip 1179 ms, parse 4745 ms, sort 0 ms, write 0 ms, index 679 ms: 13 candidates, 94473 repo-hours, 1107 releases; waiting 14 ms; commit 0 ms)
2026-11-08T06:24:18Z [load_day 2024-06-05] 2024-06-05 hour 1: 217920 events in 0 files, snapshot none (task 6180 ms: download 3468 ms overlapping gunzip 1029 ms, parse 4134 ms, sort 0 ms, write 0 ms, index 838 ms: 9 candidates, 105063 repo-hours, 940 releases; waiting 0 ms; commit 0 ms)
2026-11-08T06:24:26Z [load_day 2024-06-05] 2024-06-05 hour 2: 172247 events in 0 files, snapshot none (task 7973 ms: download 4947 ms overlapping gunzip 1300 ms, parse 5808 ms, sort 0 ms, write 0 ms, index 657 ms: 12 candidates, 70497 repo-hours, 938 releases; waiting 16 ms; commit 0 ms)
2026-11-08T06:24:26Z [load_day 2024-06-05] 2024-06-05 hour 3: 188456 events in 0 files, snapshot none (task 7954 ms: download 4564 ms overlapping gunzip 1355 ms, parse 5585 ms, sort 0 ms, write 0 ms, index 802 ms: 6 candidates, 77970 repo-hours, 3902 releases; waiting 23 ms; commit 0 ms)
2026-11-08T06:24:32Z [load_day 2024-06-05] 2024-06-05 hour 4: 168652 events in 0 files, snapshot none (task 5675 ms: download 2660 ms overlapping gunzip 899 ms, parse 3880 ms, sort 0 ms, write 0 ms, index 702 ms: 11 candidates, 64907 repo-hours, 738 releases; waiting 12 ms; commit 0 ms)
2026-11-08T06:24:34Z [load_day 2024-06-05] 2024-06-05 hour 5: 186807 events in 0 files, snapshot none (task 6855 ms: download 3962 ms overlapping gunzip 1175 ms, parse 4733 ms, sort 0 ms, write 0 ms, index 742 ms: 6 candidates, 72108 repo-hours, 970 releases; waiting 9 ms; commit 0 ms)
2026-11-08T06:24:41Z [load_day 2024-06-05] 2024-06-05 hour 6: 218539 events in 0 files, snapshot none (task 7582 ms: download 4552 ms overlapping gunzip 1219 ms, parse 5285 ms, sort 0 ms, write 0 ms, index 855 ms: 10 candidates, 96089 repo-hours, 1125 releases; waiting 20 ms; commit 0 ms)
2026-11-08T06:24:44Z [load_day 2024-06-05] 2024-06-05 hour 7: 226315 events in 0 files, snapshot none (task 9365 ms: download 5677 ms overlapping gunzip 1573 ms, parse 6439 ms, sort 0 ms, write 0 ms, index 1117 ms: 14 candidates, 90831 repo-hours, 1296 releases; waiting 17 ms; commit 0 ms)
2026-11-08T06:24:50Z [load_day 2024-06-05] 2024-06-05 hour 8: 253368 events in 0 files, snapshot none (task 9189 ms: download 6345 ms overlapping gunzip 1481 ms, parse 6354 ms, sort 0 ms, write 0 ms, index 1122 ms: 9 candidates, 97383 repo-hours, 1213 releases; waiting 29 ms; commit 0 ms)
2026-11-08T06:24:54Z [load_day 2024-06-05] 2024-06-05 hour 9: 252643 events in 0 files, snapshot none (task 9859 ms: download 6303 ms overlapping gunzip 1666 ms, parse 7021 ms, sort 0 ms, write 0 ms, index 946 ms: 10 candidates, 103425 repo-hours, 1369 releases; waiting 12 ms; commit 0 ms)
2026-11-08T06:24:59Z [load_day 2024-06-05] 2024-06-05 hour 10: 239326 events in 0 files, snapshot none (task 8259 ms: download 5268 ms overlapping gunzip 1369 ms, parse 5525 ms, sort 0 ms, write 0 ms, index 1119 ms: 11 candidates, 95378 repo-hours, 1192 releases; waiting 30 ms; commit 0 ms)
2026-11-08T06:25:03Z [load_day 2024-06-05] 2024-06-05 hour 11: 239138 events in 0 files, snapshot none (task 8391 ms: download 5482 ms overlapping gunzip 1471 ms, parse 6056 ms, sort 0 ms, write 0 ms, index 660 ms: 10 candidates, 91800 repo-hours, 1091 releases; waiting 7 ms; commit 0 ms)
2026-11-08T06:25:07Z [load_day 2024-06-05] 2024-06-05 hour 12: 279586 events in 0 files, snapshot none (task 7731 ms: download 4971 ms overlapping gunzip 1244 ms, parse 5355 ms, sort 0 ms, write 0 ms, index 909 ms: 14 candidates, 136004 repo-hours, 1301 releases; waiting 11 ms; commit 0 ms)
2026-11-08T06:25:11Z [load_day 2024-06-05] 2024-06-05 hour 13: 269074 events in 0 files, snapshot none (task 7383 ms: download 4856 ms overlapping gunzip 1241 ms, parse 5116 ms, sort 0 ms, write 0 ms, index 830 ms: 14 candidates, 120911 repo-hours, 1367 releases; waiting 10 ms; commit 0 ms)
2026-11-08T06:25:15Z [load_day 2024-06-05] 2024-06-05 hour 14: 258131 events in 0 files, snapshot none (task 7523 ms: download 4985 ms overlapping gunzip 1273 ms, parse 5263 ms, sort 0 ms, write 0 ms, index 778 ms: 6 candidates, 107615 repo-hours, 1460 releases; waiting 22 ms; commit 0 ms)
2026-11-08T06:25:19Z [load_day 2024-06-05] 2024-06-05 hour 15: 260932 events in 0 files, snapshot none (task 7469 ms: download 4982 ms overlapping gunzip 1258 ms, parse 5224 ms, sort 0 ms, write 0 ms, index 777 ms: 13 candidates, 109824 repo-hours, 1417 releases; waiting 18 ms; commit 0 ms)
2026-11-08T06:25:25Z [load_day 2024-06-05] 2024-06-05 hour 16: 238835 events in 0 files, snapshot none (task 8900 ms: download 5750 ms overlapping gunzip 1498 ms, parse 6183 ms, sort 0 ms, write 0 ms, index 988 ms: 10 candidates, 98937 repo-hours, 1209 releases; waiting 15 ms; commit 0 ms)
2026-11-08T06:25:29Z [load_day 2024-06-05] 2024-06-05 hour 17: 226999 events in 0 files, snapshot none (task 9456 ms: download 5501 ms overlapping gunzip 1623 ms, parse 6625 ms, sort 0 ms, write 0 ms, index 978 ms: 11 candidates, 90345 repo-hours, 1105 releases; waiting 4 ms; commit 0 ms)
2026-11-08T06:25:34Z [load_day 2024-06-05] 2024-06-05 hour 18: 238471 events in 0 files, snapshot none (task 8750 ms: download 5657 ms overlapping gunzip 1475 ms, parse 6128 ms, sort 0 ms, write 0 ms, index 943 ms: 4 candidates, 101735 repo-hours, 1252 releases; waiting 13 ms; commit 0 ms)
2026-11-08T06:25:37Z [load_day 2024-06-05] 2024-06-05 hour 19: 218129 events in 0 files, snapshot none (task 7926 ms: download 4775 ms overlapping gunzip 1307 ms, parse 5466 ms, sort 0 ms, write 0 ms, index 913 ms: 14 candidates, 81569 repo-hours, 1068 releases; waiting 22 ms; commit 0 ms)
2026-11-08T06:25:42Z [load_day 2024-06-05] 2024-06-05 hour 20: 214721 events in 0 files, snapshot none (task 7918 ms: download 4056 ms overlapping gunzip 1338 ms, parse 5429 ms, sort 0 ms, write 0 ms, index 936 ms: 7 candidates, 82840 repo-hours, 1065 releases; waiting 18 ms; commit 0 ms)
2026-11-08T06:25:45Z [load_day 2024-06-05] 2024-06-05 hour 21: 204969 events in 0 files, snapshot none (task 7403 ms: download 4827 ms overlapping gunzip 1228 ms, parse 5369 ms, sort 0 ms, write 0 ms, index 563 ms: 12 candidates, 79249 repo-hours, 1117 releases; waiting 16 ms; commit 0 ms)
2026-11-08T06:25:49Z [load_day 2024-06-05] 2024-06-05 hour 22: 188344 events in 0 files, snapshot none (task 6177 ms: download 2901 ms overlapping gunzip 1071 ms, parse 4195 ms, sort 0 ms, write 0 ms, index 679 ms: 10 candidates, 68306 repo-hours, 862 releases; waiting 22 ms; commit 0 ms)
2026-11-08T06:25:51Z [load_day 2024-06-05] 2024-06-05 hour 23: 167939 events in 0 files, snapshot none (task 5058 ms: download 2802 ms overlapping gunzip 859 ms, parse 3541 ms, sort 0 ms, write 0 ms, index 444 ms: 10 candidates, 58531 repo-hours, 792 releases; waiting 15 ms; commit 0 ms)
2026-11-08T06:26:00Z [load_day 2024-06-05] 2024-06-05: repo_hour merged from 24 files to 1 (2195790 rows, 9013 ms)
2026-11-08T06:26:03Z [load_day 2024-06-05] 2024-06-05: index committed in 12104 ms (24 + 1 + 24 files)
2026-11-08T06:26:03Z [load_day 2024-06-05] 2024-06-05: 5328069 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:26:03Z [load_day 2024-06-05] attempt 1 succeeded