orcaLog in

Runs · run 3905

load_day 2025-05-15, attempt 1 succeeded

Host
73ccef5e07c2:305533
Started
2026-11-08T11:57:28Z
Ended
2026-11-08T11:59:43Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
873 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
208.1 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3905/load_day/2025-05-15/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:57:28Z [load_day 2025-05-15] attempt 1 started
2026-11-08T11:57:28Z [load_day 2025-05-15] 2025-05-15: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:57:37Z [load_day 2025-05-15] 2025-05-15 hour 0: 202628 events in 0 files, snapshot none (task 7677 ms: download 4755 ms overlapping gunzip 1204 ms, parse 5058 ms, sort 0 ms, write 0 ms, index 719 ms: 7 candidates, 96789 repo-hours, 1680 releases; waiting 426 ms; commit 0 ms)
2026-11-08T11:57:37Z [load_day 2025-05-15] 2025-05-15 hour 1: 227191 events in 0 files, snapshot none (task 8140 ms: download 5129 ms overlapping gunzip 1153 ms, parse 5291 ms, sort 0 ms, write 0 ms, index 888 ms: 7 candidates, 124625 repo-hours, 1028 releases; waiting 475 ms; commit 0 ms)
2026-11-08T11:57:47Z [load_day 2025-05-15] 2025-05-15 hour 2: 200689 events in 0 files, snapshot none (task 9520 ms: download 6032 ms overlapping gunzip 1456 ms, parse 6301 ms, sort 0 ms, write 0 ms, index 943 ms: 12 candidates, 92595 repo-hours, 1042 releases; waiting 511 ms; commit 0 ms)
2026-11-08T11:57:47Z [load_day 2025-05-15] 2025-05-15 hour 3: 212318 events in 0 files, snapshot none (task 8907 ms: download 5620 ms overlapping gunzip 1370 ms, parse 5889 ms, sort 0 ms, write 0 ms, index 890 ms: 3 candidates, 90737 repo-hours, 2974 releases; waiting 512 ms; commit 0 ms)
2026-11-08T11:57:56Z [load_day 2025-05-15] 2025-05-15 hour 4: 197962 events in 0 files, snapshot none (task 9061 ms: download 3848 ms overlapping gunzip 1363 ms, parse 5756 ms, sort 0 ms, write 0 ms, index 1142 ms: 11 candidates, 78703 repo-hours, 952 releases; waiting 495 ms; commit 0 ms)
2026-11-08T11:57:58Z [load_day 2025-05-15] 2025-05-15 hour 5: 207073 events in 0 files, snapshot none (task 10841 ms: download 7020 ms overlapping gunzip 1580 ms, parse 6176 ms, sort 0 ms, write 0 ms, index 836 ms: 9 candidates, 85317 repo-hours, 1077 releases; waiting 1952 ms; commit 0 ms)
2026-11-08T11:58:07Z [load_day 2025-05-15] 2025-05-15 hour 6: 236112 events in 0 files, snapshot none (task 10365 ms: download 5801 ms overlapping gunzip 1635 ms, parse 6343 ms, sort 0 ms, write 0 ms, index 1410 ms: 12 candidates, 108205 repo-hours, 1296 releases; waiting 559 ms; commit 0 ms)
2026-11-08T11:58:13Z [load_day 2025-05-15] 2025-05-15 hour 7: 242091 events in 0 files, snapshot none (task 14661 ms: download 12014 ms overlapping gunzip 1635 ms, parse 7151 ms, sort 0 ms, write 0 ms, index 776 ms: 10 candidates, 103599 repo-hours, 1170 releases; waiting 4795 ms; commit 0 ms)
2026-11-08T11:58:16Z [load_day 2025-05-15] 2025-05-15 hour 8: 248887 events in 0 files, snapshot none (task 8403 ms: download 5485 ms overlapping gunzip 1267 ms, parse 5392 ms, sort 0 ms, write 0 ms, index 863 ms: 10 candidates, 109783 repo-hours, 1268 releases; waiting 511 ms; commit 0 ms)
2026-11-08T11:58:22Z [load_day 2025-05-15] 2025-05-15 hour 9: 248874 events in 0 files, snapshot none (task 8180 ms: download 5323 ms overlapping gunzip 1210 ms, parse 5199 ms, sort 0 ms, write 0 ms, index 871 ms: 8 candidates, 110466 repo-hours, 1410 releases; waiting 577 ms; commit 0 ms)
2026-11-08T11:58:25Z [load_day 2025-05-15] 2025-05-15 hour 10: 248066 events in 0 files, snapshot none (task 7992 ms: download 5150 ms overlapping gunzip 1208 ms, parse 5165 ms, sort 0 ms, write 0 ms, index 839 ms: 10 candidates, 109284 repo-hours, 1206 releases; waiting 520 ms; commit 0 ms)
2026-11-08T11:58:30Z [load_day 2025-05-15] 2025-05-15 hour 11: 247361 events in 0 files, snapshot none (task 7959 ms: download 4837 ms overlapping gunzip 1218 ms, parse 5015 ms, sort 0 ms, write 0 ms, index 1050 ms: 11 candidates, 102440 repo-hours, 1189 releases; waiting 308 ms; commit 0 ms)
2026-11-08T11:58:39Z [load_day 2025-05-15] 2025-05-15 hour 12: 260758 events in 0 files, snapshot none (task 13820 ms: download 9787 ms overlapping gunzip 1507 ms, parse 6623 ms, sort 0 ms, write 0 ms, index 1587 ms: 19 candidates, 139441 repo-hours, 1292 releases; waiting 3839 ms; commit 0 ms)
2026-11-08T11:58:40Z [load_day 2025-05-15] 2025-05-15 hour 13: 241920 events in 0 files, snapshot none (task 8916 ms: download 5526 ms overlapping gunzip 1433 ms, parse 6179 ms, sort 0 ms, write 0 ms, index 1097 ms: 9 candidates, 122035 repo-hours, 1324 releases; waiting 3 ms; commit 0 ms)
2026-11-08T11:58:49Z [load_day 2025-05-15] 2025-05-15 hour 14: 240668 events in 0 files, snapshot none (task 9251 ms: download 5678 ms overlapping gunzip 1574 ms, parse 6298 ms, sort 0 ms, write 0 ms, index 1014 ms: 11 candidates, 113291 repo-hours, 1245 releases; waiting 18 ms; commit 0 ms)
2026-11-08T11:58:51Z [load_day 2025-05-15] 2025-05-15 hour 15: 267034 events in 0 files, snapshot none (task 11215 ms: download 7853 ms overlapping gunzip 1902 ms, parse 7688 ms, sort 0 ms, write 0 ms, index 1390 ms: 6 candidates, 122337 repo-hours, 1415 releases; waiting 13 ms; commit 0 ms)
2026-11-08T11:59:00Z [load_day 2025-05-15] 2025-05-15 hour 16: 250168 events in 0 files, snapshot none (task 10305 ms: download 7138 ms overlapping gunzip 1768 ms, parse 7275 ms, sort 0 ms, write 0 ms, index 1051 ms: 5 candidates, 111784 repo-hours, 1191 releases; waiting 17 ms; commit 0 ms)
2026-11-08T11:59:03Z [load_day 2025-05-15] 2025-05-15 hour 17: 255492 events in 0 files, snapshot none (task 11383 ms: download 8533 ms overlapping gunzip 1916 ms, parse 7905 ms, sort 0 ms, write 0 ms, index 759 ms: 14 candidates, 105939 repo-hours, 1164 releases; waiting 510 ms; commit 0 ms)
2026-11-08T11:59:11Z [load_day 2025-05-15] 2025-05-15 hour 18: 249899 events in 0 files, snapshot none (task 10369 ms: download 6266 ms overlapping gunzip 1646 ms, parse 6994 ms, sort 0 ms, write 0 ms, index 1515 ms: 9 candidates, 112643 repo-hours, 1616 releases; waiting 11 ms; commit 0 ms)
2026-11-08T11:59:14Z [load_day 2025-05-15] 2025-05-15 hour 19: 234260 events in 0 files, snapshot none (task 10492 ms: download 7219 ms overlapping gunzip 1859 ms, parse 7477 ms, sort 0 ms, write 0 ms, index 920 ms: 2 candidates, 92263 repo-hours, 1296 releases; waiting 14 ms; commit 0 ms)
2026-11-08T11:59:20Z [load_day 2025-05-15] 2025-05-15 hour 20: 228789 events in 0 files, snapshot none (task 9030 ms: download 5884 ms overlapping gunzip 1467 ms, parse 6542 ms, sort 0 ms, write 0 ms, index 771 ms: 9 candidates, 93531 repo-hours, 1308 releases; waiting 33 ms; commit 0 ms)
2026-11-08T11:59:23Z [load_day 2025-05-15] 2025-05-15 hour 21: 215681 events in 0 files, snapshot none (task 8526 ms: download 5239 ms overlapping gunzip 1462 ms, parse 5826 ms, sort 0 ms, write 0 ms, index 1016 ms: 13 candidates, 85561 repo-hours, 1215 releases; waiting 15 ms; commit 0 ms)
2026-11-08T11:59:29Z [load_day 2025-05-15] 2025-05-15 hour 22: 198897 events in 0 files, snapshot none (task 7724 ms: download 4867 ms overlapping gunzip 1286 ms, parse 5401 ms, sort 0 ms, write 0 ms, index 807 ms: 6 candidates, 76652 repo-hours, 1241 releases; waiting 16 ms; commit 0 ms)
2026-11-08T11:59:30Z [load_day 2025-05-15] 2025-05-15 hour 23: 184478 events in 0 files, snapshot none (task 6587 ms: download 3945 ms overlapping gunzip 1077 ms, parse 4650 ms, sort 0 ms, write 0 ms, index 640 ms: 9 candidates, 70403 repo-hours, 1237 releases; waiting 0 ms; commit 0 ms)
2026-11-08T11:59:41Z [load_day 2025-05-15] 2025-05-15: repo_hour merged from 24 files to 1 (2458423 rows, 10400 ms)
2026-11-08T11:59:43Z [load_day 2025-05-15] 2025-05-15: index committed in 13356 ms (24 + 1 + 24 files)
2026-11-08T11:59:43Z [load_day 2025-05-15] 2025-05-15: 5547296 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:59:43Z [load_day 2025-05-15] attempt 1 succeeded