orcaLog in

Runs · run 3890

load_day 2025-05-12, attempt 1 succeeded

Host
73ccef5e07c2:302847
Started
2026-11-08T11:53:34Z
Ended
2026-11-08T11:56:02Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
843 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
234.1 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3890/load_day/2025-05-12/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:53:34Z [load_day 2025-05-12] attempt 1 started
2026-11-08T11:53:35Z [load_day 2025-05-12] 2025-05-12: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:53:43Z [load_day 2025-05-12] 2025-05-12 hour 0: 186491 events in 0 files, snapshot none (task 6976 ms: download 4358 ms overlapping gunzip 1149 ms, parse 4513 ms, sort 0 ms, write 0 ms, index 628 ms: 13 candidates, 81156 repo-hours, 1258 releases; waiting 388 ms; commit 0 ms)
2026-11-08T11:53:45Z [load_day 2025-05-12] 2025-05-12 hour 1: 221970 events in 0 files, snapshot none (task 9343 ms: download 6049 ms overlapping gunzip 1343 ms, parse 5891 ms, sort 0 ms, write 0 ms, index 1262 ms: 11 candidates, 118318 repo-hours, 971 releases; waiting 481 ms; commit 0 ms)
2026-11-08T11:53:51Z [load_day 2025-05-12] 2025-05-12 hour 2: 206244 events in 0 files, snapshot none (task 7915 ms: download 5026 ms overlapping gunzip 1289 ms, parse 5159 ms, sort 0 ms, write 0 ms, index 792 ms: 7 candidates, 91034 repo-hours, 1005 releases; waiting 406 ms; commit 0 ms)
2026-11-08T11:53:54Z [load_day 2025-05-12] 2025-05-12 hour 3: 210410 events in 0 files, snapshot none (task 8152 ms: download 5233 ms overlapping gunzip 1359 ms, parse 5293 ms, sort 0 ms, write 0 ms, index 973 ms: 5 candidates, 86382 repo-hours, 2812 releases; waiting 226 ms; commit 0 ms)
2026-11-08T11:54:00Z [load_day 2025-05-12] 2025-05-12 hour 4: 204520 events in 0 files, snapshot none (task 8059 ms: download 4945 ms overlapping gunzip 1274 ms, parse 5081 ms, sort 0 ms, write 0 ms, index 724 ms: 7 candidates, 77544 repo-hours, 783 releases; waiting 638 ms; commit 0 ms)
2026-11-08T11:54:03Z [load_day 2025-05-12] 2025-05-12 hour 5: 215084 events in 0 files, snapshot none (task 8430 ms: download 5667 ms overlapping gunzip 1379 ms, parse 5574 ms, sort 0 ms, write 0 ms, index 649 ms: 6 candidates, 83629 repo-hours, 878 releases; waiting 554 ms; commit 0 ms)
2026-11-08T11:54:10Z [load_day 2025-05-12] 2025-05-12 hour 6: 240001 events in 0 files, snapshot none (task 10202 ms: download 6614 ms overlapping gunzip 1777 ms, parse 6869 ms, sort 0 ms, write 0 ms, index 957 ms: 11 candidates, 105784 repo-hours, 1092 releases; waiting 256 ms; commit 0 ms)
2026-11-08T11:54:14Z [load_day 2025-05-12] 2025-05-12 hour 7: 248481 events in 0 files, snapshot none (task 10619 ms: download 7557 ms overlapping gunzip 1777 ms, parse 6949 ms, sort 0 ms, write 0 ms, index 1167 ms: 13 candidates, 101514 repo-hours, 1077 releases; waiting 457 ms; commit 0 ms)
2026-11-08T11:54:22Z [load_day 2025-05-12] 2025-05-12 hour 8: 260505 events in 0 files, snapshot none (task 11303 ms: download 8078 ms overlapping gunzip 1887 ms, parse 7453 ms, sort 0 ms, write 0 ms, index 955 ms: 10 candidates, 111051 repo-hours, 1265 releases; waiting 672 ms; commit 0 ms)
2026-11-08T11:54:24Z [load_day 2025-05-12] 2025-05-12 hour 9: 262117 events in 0 files, snapshot none (task 9648 ms: download 6796 ms overlapping gunzip 1535 ms, parse 6370 ms, sort 0 ms, write 0 ms, index 945 ms: 7 candidates, 111144 repo-hours, 1430 releases; waiting 475 ms; commit 0 ms)
2026-11-08T11:54:34Z [load_day 2025-05-12] 2025-05-12 hour 10: 256730 events in 0 files, snapshot none (task 10868 ms: download 7353 ms overlapping gunzip 1779 ms, parse 7274 ms, sort 0 ms, write 0 ms, index 1063 ms: 8 candidates, 107213 repo-hours, 1216 releases; waiting 517 ms; commit 0 ms)
2026-11-08T11:54:36Z [load_day 2025-05-12] 2025-05-12 hour 11: 260824 events in 0 files, snapshot none (task 10755 ms: download 8109 ms overlapping gunzip 1797 ms, parse 7392 ms, sort 0 ms, write 0 ms, index 805 ms: 9 candidates, 106290 repo-hours, 1257 releases; waiting 494 ms; commit 0 ms)
2026-11-08T11:54:48Z [load_day 2025-05-12] 2025-05-12 hour 12: 287916 events in 0 files, snapshot none (task 14099 ms: download 9287 ms overlapping gunzip 2189 ms, parse 9199 ms, sort 0 ms, write 0 ms, index 1605 ms: 8 candidates, 147194 repo-hours, 1259 releases; waiting 785 ms; commit 0 ms)
2026-11-08T11:54:50Z [load_day 2025-05-12] 2025-05-12 hour 13: 285251 events in 0 files, snapshot none (task 13427 ms: download 9540 ms overlapping gunzip 2214 ms, parse 9116 ms, sort 0 ms, write 0 ms, index 1341 ms: 7 candidates, 139318 repo-hours, 1209 releases; waiting 496 ms; commit 0 ms)
2026-11-08T11:54:59Z [load_day 2025-05-12] 2025-05-12 hour 14: 275623 events in 0 files, snapshot none (task 9990 ms: download 7062 ms overlapping gunzip 1608 ms, parse 6583 ms, sort 0 ms, write 0 ms, index 992 ms: 6 candidates, 117591 repo-hours, 1343 releases; waiting 511 ms; commit 0 ms)
2026-11-08T11:55:00Z [load_day 2025-05-12] 2025-05-12 hour 15: 277732 events in 0 files, snapshot none (task 9839 ms: download 7158 ms overlapping gunzip 1582 ms, parse 6543 ms, sort 0 ms, write 0 ms, index 868 ms: 9 candidates, 119542 repo-hours, 1553 releases; waiting 535 ms; commit 0 ms)
2026-11-08T11:55:11Z [load_day 2025-05-12] 2025-05-12 hour 16: 268825 events in 0 files, snapshot none (task 11824 ms: download 8099 ms overlapping gunzip 1924 ms, parse 7766 ms, sort 0 ms, write 0 ms, index 1139 ms: 11 candidates, 114861 repo-hours, 1146 releases; waiting 633 ms; commit 0 ms)
2026-11-08T11:55:12Z [load_day 2025-05-12] 2025-05-12 hour 17: 261248 events in 0 files, snapshot none (task 11175 ms: download 7900 ms overlapping gunzip 1874 ms, parse 7756 ms, sort 0 ms, write 0 ms, index 841 ms: 5 candidates, 106285 repo-hours, 1292 releases; waiting 403 ms; commit 0 ms)
2026-11-08T11:55:23Z [load_day 2025-05-12] 2025-05-12 hour 18: 264569 events in 0 files, snapshot none (task 10849 ms: download 8081 ms overlapping gunzip 1710 ms, parse 7277 ms, sort 0 ms, write 0 ms, index 985 ms: 7 candidates, 117815 repo-hours, 1413 releases; waiting 593 ms; commit 0 ms)
2026-11-08T11:55:23Z [load_day 2025-05-12] 2025-05-12 hour 19: 251489 events in 0 files, snapshot none (task 10753 ms: download 7731 ms overlapping gunzip 1757 ms, parse 7112 ms, sort 0 ms, write 0 ms, index 794 ms: 8 candidates, 101317 repo-hours, 1106 releases; waiting 604 ms; commit 0 ms)
2026-11-08T11:55:34Z [load_day 2025-05-12] 2025-05-12 hour 20: 233226 events in 0 files, snapshot none (task 10929 ms: download 8187 ms overlapping gunzip 1850 ms, parse 7489 ms, sort 0 ms, write 0 ms, index 728 ms: 9 candidates, 95407 repo-hours, 1216 releases; waiting 527 ms; commit 0 ms)
2026-11-08T11:55:34Z [load_day 2025-05-12] 2025-05-12 hour 21: 228934 events in 0 files, snapshot none (task 10548 ms: download 7871 ms overlapping gunzip 1695 ms, parse 7112 ms, sort 0 ms, write 0 ms, index 845 ms: 11 candidates, 89720 repo-hours, 1232 releases; waiting 518 ms; commit 0 ms)
2026-11-08T11:55:46Z [load_day 2025-05-12] 2025-05-12 hour 22: 209990 events in 0 files, snapshot none (task 11337 ms: download 7688 ms overlapping gunzip 1909 ms, parse 7660 ms, sort 0 ms, write 0 ms, index 944 ms: 9 candidates, 78925 repo-hours, 1048 releases; waiting 494 ms; commit 0 ms)
2026-11-08T11:55:46Z [load_day 2025-05-12] 2025-05-12 hour 23: 200117 events in 0 files, snapshot none (task 10906 ms: download 7665 ms overlapping gunzip 1705 ms, parse 7340 ms, sort 0 ms, write 0 ms, index 900 ms: 12 candidates, 75232 repo-hours, 998 releases; waiting 471 ms; commit 0 ms)
2026-11-08T11:55:59Z [load_day 2025-05-12] 2025-05-12: repo_hour merged from 24 files to 1 (2484266 rows, 12617 ms)
2026-11-08T11:56:02Z [load_day 2025-05-12] 2025-05-12: index committed in 15884 ms (24 + 1 + 24 files)
2026-11-08T11:56:02Z [load_day 2025-05-12] 2025-05-12: 5818297 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:56:02Z [load_day 2025-05-12] attempt 1 succeeded