orcaLog in

Runs · run 2489

load_day 2024-05-22, attempt 1 succeeded

Host
73ccef5e07c2:125838
Started
2026-11-08T06:12:11Z
Ended
2026-11-08T06:14:08Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
714 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
187.5 s, up to 3.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2489/load_day/2024-05-22/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:12:11Z [load_day 2024-05-22] attempt 1 started
2026-11-08T06:12:12Z [load_day 2024-05-22] 2024-05-22: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:12:19Z [load_day 2024-05-22] 2024-05-22 hour 0: 192332 events in 0 files, snapshot none (task 6660 ms: download 3782 ms overlapping gunzip 1012 ms, parse 4242 ms, sort 0 ms, write 0 ms, index 780 ms: 22 candidates, 96403 repo-hours, 1146 releases; waiting 278 ms; commit 0 ms)
2026-11-08T06:12:19Z [load_day 2024-05-22] 2024-05-22 hour 1: 200382 events in 0 files, snapshot none (task 6609 ms: download 3654 ms overlapping gunzip 940 ms, parse 4032 ms, sort 0 ms, write 0 ms, index 918 ms: 22 candidates, 105785 repo-hours, 899 releases; waiting 501 ms; commit 0 ms)
2026-11-08T06:12:27Z [load_day 2024-05-22] 2024-05-22 hour 2: 173552 events in 0 files, snapshot none (task 7071 ms: download 4405 ms overlapping gunzip 1050 ms, parse 4367 ms, sort 0 ms, write 0 ms, index 534 ms: 22 candidates, 68927 repo-hours, 848 releases; waiting 805 ms; commit 0 ms)
2026-11-08T06:12:27Z [load_day 2024-05-22] 2024-05-22 hour 3: 207520 events in 0 files, snapshot none (task 6421 ms: download 3456 ms overlapping gunzip 985 ms, parse 4336 ms, sort 0 ms, write 0 ms, index 582 ms: 16 candidates, 71427 repo-hours, 2860 releases; waiting 223 ms; commit 0 ms)
2026-11-08T06:12:35Z [load_day 2024-05-22] 2024-05-22 hour 4: 176352 events in 0 files, snapshot none (task 7513 ms: download 4294 ms overlapping gunzip 1167 ms, parse 4887 ms, sort 0 ms, write 0 ms, index 707 ms: 34 candidates, 63337 repo-hours, 738 releases; waiting 501 ms; commit 0 ms)
2026-11-08T06:12:35Z [load_day 2024-05-22] 2024-05-22 hour 5: 179391 events in 0 files, snapshot none (task 7720 ms: download 4918 ms overlapping gunzip 1207 ms, parse 5164 ms, sort 0 ms, write 0 ms, index 555 ms: 34 candidates, 70201 repo-hours, 914 releases; waiting 498 ms; commit 0 ms)
2026-11-08T06:12:43Z [load_day 2024-05-22] 2024-05-22 hour 6: 211724 events in 0 files, snapshot none (task 7455 ms: download 4700 ms overlapping gunzip 1171 ms, parse 4743 ms, sort 0 ms, write 0 ms, index 779 ms: 27 candidates, 93499 repo-hours, 1035 releases; waiting 534 ms; commit 0 ms)
2026-11-08T06:12:44Z [load_day 2024-05-22] 2024-05-22 hour 7: 218181 events in 0 files, snapshot none (task 8272 ms: download 5280 ms overlapping gunzip 1267 ms, parse 5517 ms, sort 0 ms, write 0 ms, index 665 ms: 26 candidates, 88363 repo-hours, 1058 releases; waiting 558 ms; commit 0 ms)
2026-11-08T06:12:52Z [load_day 2024-05-22] 2024-05-22 hour 8: 229501 events in 0 files, snapshot none (task 8914 ms: download 5734 ms overlapping gunzip 1445 ms, parse 6011 ms, sort 0 ms, write 0 ms, index 757 ms: 41 candidates, 96460 repo-hours, 1217 releases; waiting 486 ms; commit 0 ms)
2026-11-08T06:12:53Z [load_day 2024-05-22] 2024-05-22 hour 9: 229959 events in 0 files, snapshot none (task 9239 ms: download 6449 ms overlapping gunzip 1487 ms, parse 6188 ms, sort 0 ms, write 0 ms, index 702 ms: 20 candidates, 101897 repo-hours, 1387 releases; waiting 503 ms; commit 0 ms)
2026-11-08T06:13:01Z [load_day 2024-05-22] 2024-05-22 hour 10: 220018 events in 0 files, snapshot none (task 8660 ms: download 5719 ms overlapping gunzip 1343 ms, parse 5684 ms, sort 0 ms, write 0 ms, index 782 ms: 27 candidates, 92256 repo-hours, 1235 releases; waiting 492 ms; commit 0 ms)
2026-11-08T06:13:03Z [load_day 2024-05-22] 2024-05-22 hour 11: 236265 events in 0 files, snapshot none (task 9263 ms: download 6614 ms overlapping gunzip 1435 ms, parse 5766 ms, sort 0 ms, write 0 ms, index 685 ms: 22 candidates, 91895 repo-hours, 1105 releases; waiting 1047 ms; commit 0 ms)
2026-11-08T06:13:10Z [load_day 2024-05-22] 2024-05-22 hour 12: 292842 events in 0 files, snapshot none (task 7844 ms: download 4925 ms overlapping gunzip 1155 ms, parse 5040 ms, sort 0 ms, write 0 ms, index 898 ms: 21 candidates, 129174 repo-hours, 1255 releases; waiting 491 ms; commit 0 ms)
2026-11-08T06:13:12Z [load_day 2024-05-22] 2024-05-22 hour 13: 269598 events in 0 files, snapshot none (task 8053 ms: download 5449 ms overlapping gunzip 1260 ms, parse 5208 ms, sort 0 ms, write 0 ms, index 797 ms: 31 candidates, 121897 repo-hours, 1278 releases; waiting 490 ms; commit 0 ms)
2026-11-08T06:13:19Z [load_day 2024-05-22] 2024-05-22 hour 14: 259738 events in 0 files, snapshot none (task 8666 ms: download 5430 ms overlapping gunzip 1331 ms, parse 5495 ms, sort 0 ms, write 0 ms, index 1079 ms: 17 candidates, 106076 repo-hours, 1334 releases; waiting 500 ms; commit 0 ms)
2026-11-08T06:13:22Z [load_day 2024-05-22] 2024-05-22 hour 15: 259390 events in 0 files, snapshot none (task 9658 ms: download 6202 ms overlapping gunzip 1567 ms, parse 6194 ms, sort 0 ms, write 0 ms, index 1093 ms: 28 candidates, 107157 repo-hours, 1376 releases; waiting 521 ms; commit 0 ms)
2026-11-08T06:13:29Z [load_day 2024-05-22] 2024-05-22 hour 16: 238872 events in 0 files, snapshot none (task 9827 ms: download 6156 ms overlapping gunzip 1535 ms, parse 6634 ms, sort 0 ms, write 0 ms, index 960 ms: 27 candidates, 99082 repo-hours, 1302 releases; waiting 481 ms; commit 0 ms)
2026-11-08T06:13:31Z [load_day 2024-05-22] 2024-05-22 hour 17: 232474 events in 0 files, snapshot none (task 8424 ms: download 5591 ms overlapping gunzip 1314 ms, parse 5867 ms, sort 0 ms, write 0 ms, index 702 ms: 22 candidates, 91813 repo-hours, 1298 releases; waiting 256 ms; commit 0 ms)
2026-11-08T06:13:39Z [load_day 2024-05-22] 2024-05-22 hour 18: 248822 events in 0 files, snapshot none (task 9374 ms: download 6599 ms overlapping gunzip 1452 ms, parse 6281 ms, sort 0 ms, write 0 ms, index 792 ms: 18 candidates, 102497 repo-hours, 1247 releases; waiting 536 ms; commit 0 ms)
2026-11-08T06:13:40Z [load_day 2024-05-22] 2024-05-22 hour 19: 218395 events in 0 files, snapshot none (task 8933 ms: download 6500 ms overlapping gunzip 1411 ms, parse 5986 ms, sort 0 ms, write 0 ms, index 697 ms: 23 candidates, 83819 repo-hours, 1144 releases; waiting 587 ms; commit 0 ms)
2026-11-08T06:13:48Z [load_day 2024-05-22] 2024-05-22 hour 20: 213490 events in 0 files, snapshot none (task 8591 ms: download 5848 ms overlapping gunzip 1279 ms, parse 5641 ms, sort 0 ms, write 0 ms, index 929 ms: 24 candidates, 82791 repo-hours, 1169 releases; waiting 530 ms; commit 0 ms)
2026-11-08T06:13:48Z [load_day 2024-05-22] 2024-05-22 hour 21: 200493 events in 0 files, snapshot none (task 7729 ms: download 5365 ms overlapping gunzip 1231 ms, parse 5190 ms, sort 0 ms, write 0 ms, index 615 ms: 19 candidates, 77677 repo-hours, 1160 releases; waiting 445 ms; commit 0 ms)
2026-11-08T06:13:56Z [load_day 2024-05-22] 2024-05-22 hour 22: 173912 events in 0 files, snapshot none (task 6928 ms: download 4565 ms overlapping gunzip 1061 ms, parse 4544 ms, sort 0 ms, write 0 ms, index 484 ms: 20 candidates, 63810 repo-hours, 950 releases; waiting 530 ms; commit 0 ms)
2026-11-08T06:13:56Z [load_day 2024-05-22] 2024-05-22 hour 23: 165067 events in 0 files, snapshot none (task 6388 ms: download 3953 ms overlapping gunzip 1016 ms, parse 4133 ms, sort 0 ms, write 0 ms, index 404 ms: 14 candidates, 60694 repo-hours, 813 releases; waiting 529 ms; commit 0 ms)
2026-11-08T06:14:05Z [load_day 2024-05-22] 2024-05-22: repo_hour merged from 24 files to 1 (2166937 rows, 9311 ms)
2026-11-08T06:14:08Z [load_day 2024-05-22] 2024-05-22: index committed in 11833 ms (24 + 1 + 24 files)
2026-11-08T06:14:08Z [load_day 2024-05-22] 2024-05-22: 5248270 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:14:08Z [load_day 2024-05-22] attempt 1 succeeded