orcaLog in

Runs · run 3231

load_day 2024-11-22, attempt 1 succeeded

Host
73ccef5e07c2:211022
Started
2026-11-08T08:58:41Z
Ended
2026-11-08T09:01:02Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
749 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
219.0 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3231/load_day/2024-11-22/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:58:41Z [load_day 2024-11-22] attempt 1 started
2026-11-08T08:58:41Z [load_day 2024-11-22] 2024-11-22: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:58:51Z [load_day 2024-11-22] 2024-11-22 hour 0: 191963 events in 0 files, snapshot none (task 8515 ms: download 4902 ms overlapping gunzip 1324 ms, parse 5569 ms, sort 0 ms, write 0 ms, index 799 ms: 6 candidates, 90767 repo-hours, 1253 releases; waiting 515 ms; commit 0 ms)
2026-11-08T08:58:51Z [load_day 2024-11-22] 2024-11-22 hour 1: 214016 events in 0 files, snapshot none (task 8360 ms: download 4728 ms overlapping gunzip 1238 ms, parse 5181 ms, sort 0 ms, write 0 ms, index 1122 ms: 5 candidates, 113859 repo-hours, 870 releases; waiting 501 ms; commit 0 ms)
2026-11-08T08:58:58Z [load_day 2024-11-22] 2024-11-22 hour 2: 182165 events in 0 files, snapshot none (task 7236 ms: download 4029 ms overlapping gunzip 1050 ms, parse 4401 ms, sort 0 ms, write 0 ms, index 1073 ms: 6 candidates, 81683 repo-hours, 873 releases; waiting 487 ms; commit 0 ms)
2026-11-08T08:59:00Z [load_day 2024-11-22] 2024-11-22 hour 3: 209685 events in 0 files, snapshot none (task 8469 ms: download 5397 ms overlapping gunzip 1391 ms, parse 5598 ms, sort 0 ms, write 0 ms, index 801 ms: 7 candidates, 79313 repo-hours, 3938 releases; waiting 220 ms; commit 0 ms)
2026-11-08T08:59:07Z [load_day 2024-11-22] 2024-11-22 hour 4: 193162 events in 0 files, snapshot none (task 8229 ms: download 5596 ms overlapping gunzip 1360 ms, parse 5774 ms, sort 0 ms, write 0 ms, index 516 ms: 6 candidates, 65597 repo-hours, 833 releases; waiting 254 ms; commit 0 ms)
2026-11-08T08:59:09Z [load_day 2024-11-22] 2024-11-22 hour 5: 202276 events in 0 files, snapshot none (task 8932 ms: download 6374 ms overlapping gunzip 1423 ms, parse 5890 ms, sort 0 ms, write 0 ms, index 852 ms: 2 candidates, 69944 repo-hours, 789 releases; waiting 454 ms; commit 0 ms)
2026-11-08T08:59:17Z [load_day 2024-11-22] 2024-11-22 hour 6: 219814 events in 0 files, snapshot none (task 9691 ms: download 6932 ms overlapping gunzip 1596 ms, parse 6622 ms, sort 0 ms, write 0 ms, index 643 ms: 3 candidates, 87775 repo-hours, 971 releases; waiting 476 ms; commit 0 ms)
2026-11-08T08:59:19Z [load_day 2024-11-22] 2024-11-22 hour 7: 215533 events in 0 files, snapshot none (task 9007 ms: download 6650 ms overlapping gunzip 1552 ms, parse 6068 ms, sort 0 ms, write 0 ms, index 600 ms: 7 candidates, 78648 repo-hours, 872 releases; waiting 447 ms; commit 0 ms)
2026-11-08T08:59:26Z [load_day 2024-11-22] 2024-11-22 hour 8: 228322 events in 0 files, snapshot none (task 8112 ms: download 5784 ms overlapping gunzip 1343 ms, parse 5351 ms, sort 0 ms, write 0 ms, index 616 ms: 5 candidates, 88431 repo-hours, 1137 releases; waiting 534 ms; commit 0 ms)
2026-11-08T08:59:28Z [load_day 2024-11-22] 2024-11-22 hour 9: 241500 events in 0 files, snapshot none (task 8617 ms: download 6213 ms overlapping gunzip 1394 ms, parse 5683 ms, sort 0 ms, write 0 ms, index 725 ms: 17 candidates, 96162 repo-hours, 1242 releases; waiting 538 ms; commit 0 ms)
2026-11-08T08:59:34Z [load_day 2024-11-22] 2024-11-22 hour 10: 231091 events in 0 files, snapshot none (task 7834 ms: download 5455 ms overlapping gunzip 1258 ms, parse 5108 ms, sort 0 ms, write 0 ms, index 687 ms: 8 candidates, 91803 repo-hours, 1227 releases; waiting 528 ms; commit 0 ms)
2026-11-08T08:59:36Z [load_day 2024-11-22] 2024-11-22 hour 11: 237630 events in 0 files, snapshot none (task 8126 ms: download 5632 ms overlapping gunzip 1357 ms, parse 5150 ms, sort 0 ms, write 0 ms, index 860 ms: 5 candidates, 85827 repo-hours, 1101 releases; waiting 487 ms; commit 0 ms)
2026-11-08T08:59:49Z [load_day 2024-11-22] 2024-11-22 hour 12: 264101 events in 0 files, snapshot none (task 10706 ms: download 7183 ms overlapping gunzip 1576 ms, parse 6991 ms, sort 0 ms, write 0 ms, index 1249 ms: 5 candidates, 133193 repo-hours, 1391 releases; waiting 281 ms; commit 0 ms)
2026-11-08T08:59:49Z [load_day 2024-11-22] 2024-11-22 hour 13: 260703 events in 0 files, snapshot none (task 11020 ms: download 7906 ms overlapping gunzip 1741 ms, parse 7161 ms, sort 0 ms, write 0 ms, index 1172 ms: 3 candidates, 111408 repo-hours, 1255 releases; waiting 526 ms; commit 0 ms)
2026-11-08T09:00:03Z [load_day 2024-11-22] 2024-11-22 hour 14: 254981 events in 0 files, snapshot none (task 13523 ms: download 10549 ms overlapping gunzip 2370 ms, parse 9194 ms, sort 0 ms, write 0 ms, index 950 ms: 9 candidates, 100543 repo-hours, 1294 releases; waiting 521 ms; commit 0 ms)
2026-11-08T09:00:03Z [load_day 2024-11-22] 2024-11-22 hour 15: 257105 events in 0 files, snapshot none (task 11732 ms: download 8495 ms overlapping gunzip 2021 ms, parse 7981 ms, sort 0 ms, write 0 ms, index 970 ms: 5 candidates, 106366 repo-hours, 1269 releases; waiting 512 ms; commit 0 ms)
2026-11-08T09:00:15Z [load_day 2024-11-22] 2024-11-22 hour 16: 244529 events in 0 files, snapshot none (task 11229 ms: download 8458 ms overlapping gunzip 1885 ms, parse 7757 ms, sort 0 ms, write 0 ms, index 783 ms: 4 candidates, 97565 repo-hours, 1224 releases; waiting 497 ms; commit 0 ms)
2026-11-08T09:00:15Z [load_day 2024-11-22] 2024-11-22 hour 17: 236283 events in 0 files, snapshot none (task 10445 ms: download 7976 ms overlapping gunzip 1829 ms, parse 7364 ms, sort 0 ms, write 0 ms, index 765 ms: 8 candidates, 89140 repo-hours, 975 releases; waiting 232 ms; commit 0 ms)
2026-11-08T09:00:27Z [load_day 2024-11-22] 2024-11-22 hour 18: 239976 events in 0 files, snapshot none (task 11382 ms: download 8180 ms overlapping gunzip 2037 ms, parse 8034 ms, sort 0 ms, write 0 ms, index 782 ms: 7 candidates, 100047 repo-hours, 1164 releases; waiting 247 ms; commit 0 ms)
2026-11-08T09:00:27Z [load_day 2024-11-22] 2024-11-22 hour 19: 224609 events in 0 files, snapshot none (task 10245 ms: download 7105 ms overlapping gunzip 1735 ms, parse 6839 ms, sort 0 ms, write 0 ms, index 873 ms: 12 candidates, 80073 repo-hours, 997 releases; waiting 458 ms; commit 0 ms)
2026-11-08T09:00:39Z [load_day 2024-11-22] 2024-11-22 hour 20: 220656 events in 0 files, snapshot none (task 11397 ms: download 8902 ms overlapping gunzip 1894 ms, parse 7519 ms, sort 0 ms, write 0 ms, index 669 ms: 6 candidates, 80003 repo-hours, 1043 releases; waiting 921 ms; commit 0 ms)
2026-11-08T09:00:39Z [load_day 2024-11-22] 2024-11-22 hour 21: 214103 events in 0 files, snapshot none (task 10155 ms: download 7100 ms overlapping gunzip 1769 ms, parse 6645 ms, sort 0 ms, write 0 ms, index 688 ms: 8 candidates, 76675 repo-hours, 1076 releases; waiting 737 ms; commit 0 ms)
2026-11-08T09:00:49Z [load_day 2024-11-22] 2024-11-22 hour 22: 202739 events in 0 files, snapshot none (task 10080 ms: download 7982 ms overlapping gunzip 1797 ms, parse 7051 ms, sort 0 ms, write 0 ms, index 506 ms: 10 candidates, 69390 repo-hours, 1160 releases; waiting 509 ms; commit 0 ms)
2026-11-08T09:00:49Z [load_day 2024-11-22] 2024-11-22 hour 23: 190733 events in 0 files, snapshot none (task 9356 ms: download 6977 ms overlapping gunzip 1573 ms, parse 6524 ms, sort 0 ms, write 0 ms, index 432 ms: 5 candidates, 64082 repo-hours, 808 releases; waiting 485 ms; commit 0 ms)
2026-11-08T09:00:59Z [load_day 2024-11-22] 2024-11-22: repo_hour merged from 24 files to 1 (2138294 rows, 9858 ms)
2026-11-08T09:01:02Z [load_day 2024-11-22] 2024-11-22: index committed in 12769 ms (24 + 1 + 24 files)
2026-11-08T09:01:02Z [load_day 2024-11-22] 2024-11-22: 5377675 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:01:02Z [load_day 2024-11-22] attempt 1 succeeded