orcaLog in

Runs · run 3797

load_day 2025-04-17, attempt 1 succeeded

Host
73ccef5e07c2:289312
Started
2026-11-08T11:27:49Z
Ended
2026-11-08T11:29:55Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
832 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
192.4 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3797/load_day/2025-04-17/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:27:49Z [load_day 2025-04-17] attempt 1 started
2026-11-08T11:27:50Z [load_day 2025-04-17] 2025-04-17: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:27:59Z [load_day 2025-04-17] 2025-04-17 hour 0: 198393 events in 0 files, snapshot none (task 8359 ms: download 5292 ms overlapping gunzip 1336 ms, parse 5413 ms, sort 0 ms, write 0 ms, index 828 ms: 10 candidates, 97698 repo-hours, 1169 releases; waiting 535 ms; commit 0 ms)
2026-11-08T11:28:00Z [load_day 2025-04-17] 2025-04-17 hour 1: 218827 events in 0 files, snapshot none (task 8685 ms: download 5267 ms overlapping gunzip 1258 ms, parse 5570 ms, sort 0 ms, write 0 ms, index 939 ms: 6 candidates, 125292 repo-hours, 961 releases; waiting 518 ms; commit 0 ms)
2026-11-08T11:28:07Z [load_day 2025-04-17] 2025-04-17 hour 2: 191105 events in 0 files, snapshot none (task 6725 ms: download 3382 ms overlapping gunzip 1014 ms, parse 4147 ms, sort 0 ms, write 0 ms, index 893 ms: 8 candidates, 87292 repo-hours, 1051 releases; waiting 391 ms; commit 0 ms)
2026-11-08T11:28:08Z [load_day 2025-04-17] 2025-04-17 hour 3: 202559 events in 0 files, snapshot none (task 7547 ms: download 5434 ms overlapping gunzip 1032 ms, parse 4658 ms, sort 0 ms, write 0 ms, index 770 ms: 3 candidates, 87139 repo-hours, 2978 releases; waiting 743 ms; commit 0 ms)
2026-11-08T11:28:13Z [load_day 2025-04-17] 2025-04-17 hour 4: 185956 events in 0 files, snapshot none (task 6146 ms: download 3904 ms overlapping gunzip 892 ms, parse 3871 ms, sort 0 ms, write 0 ms, index 552 ms: 6 candidates, 75626 repo-hours, 798 releases; waiting 597 ms; commit 0 ms)
2026-11-08T11:28:15Z [load_day 2025-04-17] 2025-04-17 hour 5: 197104 events in 0 files, snapshot none (task 6905 ms: download 4066 ms overlapping gunzip 1004 ms, parse 4264 ms, sort 0 ms, write 0 ms, index 842 ms: 1 candidates, 79423 repo-hours, 862 releases; waiting 506 ms; commit 0 ms)
2026-11-08T11:28:23Z [load_day 2025-04-17] 2025-04-17 hour 6: 226353 events in 0 files, snapshot none (task 9209 ms: download 6317 ms overlapping gunzip 1488 ms, parse 6115 ms, sort 0 ms, write 0 ms, index 739 ms: 2 candidates, 102340 repo-hours, 1189 releases; waiting 493 ms; commit 0 ms)
2026-11-08T11:28:25Z [load_day 2025-04-17] 2025-04-17 hour 7: 224690 events in 0 files, snapshot none (task 9300 ms: download 6191 ms overlapping gunzip 1356 ms, parse 5925 ms, sort 0 ms, write 0 ms, index 1075 ms: 6 candidates, 95263 repo-hours, 1093 releases; waiting 555 ms; commit 0 ms)
2026-11-08T11:28:32Z [load_day 2025-04-17] 2025-04-17 hour 8: 215439 events in 0 files, snapshot none (task 8446 ms: download 5775 ms overlapping gunzip 1397 ms, parse 5627 ms, sort 0 ms, write 0 ms, index 643 ms: 9 candidates, 96677 repo-hours, 1159 releases; waiting 487 ms; commit 0 ms)
2026-11-08T11:28:33Z [load_day 2025-04-17] 2025-04-17 hour 9: 219152 events in 0 files, snapshot none (task 7855 ms: download 5300 ms overlapping gunzip 1194 ms, parse 5011 ms, sort 0 ms, write 0 ms, index 793 ms: 5 candidates, 99045 repo-hours, 1324 releases; waiting 612 ms; commit 0 ms)
2026-11-08T11:28:39Z [load_day 2025-04-17] 2025-04-17 hour 10: 223925 events in 0 files, snapshot none (task 7044 ms: download 4364 ms overlapping gunzip 1100 ms, parse 4603 ms, sort 0 ms, write 0 ms, index 788 ms: 4 candidates, 95642 repo-hours, 1197 releases; waiting 328 ms; commit 0 ms)
2026-11-08T11:28:42Z [load_day 2025-04-17] 2025-04-17 hour 11: 236585 events in 0 files, snapshot none (task 7820 ms: download 5224 ms overlapping gunzip 1230 ms, parse 5083 ms, sort 0 ms, write 0 ms, index 715 ms: 7 candidates, 95733 repo-hours, 1136 releases; waiting 484 ms; commit 0 ms)
2026-11-08T11:28:50Z [load_day 2025-04-17] 2025-04-17 hour 12: 273174 events in 0 files, snapshot none (task 10483 ms: download 5621 ms overlapping gunzip 1431 ms, parse 6270 ms, sort 0 ms, write 0 ms, index 1811 ms: 5 candidates, 139100 repo-hours, 1493 releases; waiting 620 ms; commit 0 ms)
2026-11-08T11:28:54Z [load_day 2025-04-17] 2025-04-17 hour 13: 269090 events in 0 files, snapshot none (task 12082 ms: download 7409 ms overlapping gunzip 1845 ms, parse 7702 ms, sort 0 ms, write 0 ms, index 1687 ms: 3 candidates, 126484 repo-hours, 1323 releases; waiting 612 ms; commit 0 ms)
2026-11-08T11:29:03Z [load_day 2025-04-17] 2025-04-17 hour 14: 260085 events in 0 files, snapshot none (task 11716 ms: download 8111 ms overlapping gunzip 1756 ms, parse 7976 ms, sort 0 ms, write 0 ms, index 1170 ms: 6 candidates, 111553 repo-hours, 1415 releases; waiting 471 ms; commit 0 ms)
2026-11-08T11:29:06Z [load_day 2025-04-17] 2025-04-17 hour 15: 264411 events in 0 files, snapshot none (task 10716 ms: download 7686 ms overlapping gunzip 1653 ms, parse 7136 ms, sort 0 ms, write 0 ms, index 1112 ms: 5 candidates, 115187 repo-hours, 1466 releases; waiting 514 ms; commit 0 ms)
2026-11-08T11:29:14Z [load_day 2025-04-17] 2025-04-17 hour 16: 247940 events in 0 files, snapshot none (task 10812 ms: download 7456 ms overlapping gunzip 1550 ms, parse 6902 ms, sort 0 ms, write 0 ms, index 1259 ms: 5 candidates, 106285 repo-hours, 1490 releases; waiting 751 ms; commit 0 ms)
2026-11-08T11:29:17Z [load_day 2025-04-17] 2025-04-17 hour 17: 245700 events in 0 files, snapshot none (task 10370 ms: download 6866 ms overlapping gunzip 1610 ms, parse 6971 ms, sort 0 ms, write 0 ms, index 982 ms: 5 candidates, 98646 repo-hours, 1361 releases; waiting 497 ms; commit 0 ms)
2026-11-08T11:29:24Z [load_day 2025-04-17] 2025-04-17 hour 18: 248513 events in 0 files, snapshot none (task 9423 ms: download 5927 ms overlapping gunzip 1410 ms, parse 6174 ms, sort 0 ms, write 0 ms, index 1104 ms: 9 candidates, 110441 repo-hours, 1417 releases; waiting 509 ms; commit 0 ms)
2026-11-08T11:29:26Z [load_day 2025-04-17] 2025-04-17 hour 19: 229959 events in 0 files, snapshot none (task 9238 ms: download 6231 ms overlapping gunzip 1390 ms, parse 6256 ms, sort 0 ms, write 0 ms, index 775 ms: 4 candidates, 89848 repo-hours, 1283 releases; waiting 523 ms; commit 0 ms)
2026-11-08T11:29:33Z [load_day 2025-04-17] 2025-04-17 hour 20: 223082 events in 0 files, snapshot none (task 8342 ms: download 5013 ms overlapping gunzip 1213 ms, parse 5162 ms, sort 0 ms, write 0 ms, index 944 ms: 8 candidates, 87343 repo-hours, 1401 releases; waiting 755 ms; commit 0 ms)
2026-11-08T11:29:35Z [load_day 2025-04-17] 2025-04-17 hour 21: 207857 events in 0 files, snapshot none (task 7710 ms: download 4712 ms overlapping gunzip 1253 ms, parse 5103 ms, sort 0 ms, write 0 ms, index 681 ms: 5 candidates, 82166 repo-hours, 1484 releases; waiting 448 ms; commit 0 ms)
2026-11-08T11:29:41Z [load_day 2025-04-17] 2025-04-17 hour 22: 191438 events in 0 files, snapshot none (task 6918 ms: download 4142 ms overlapping gunzip 1016 ms, parse 4342 ms, sort 0 ms, write 0 ms, index 789 ms: 6 candidates, 70743 repo-hours, 1289 releases; waiting 503 ms; commit 0 ms)
2026-11-08T11:29:41Z [load_day 2025-04-17] 2025-04-17 hour 23: 181379 events in 0 files, snapshot none (task 6326 ms: download 3714 ms overlapping gunzip 979 ms, parse 4178 ms, sort 0 ms, write 0 ms, index 555 ms: 4 candidates, 67239 repo-hours, 1209 releases; waiting 309 ms; commit 0 ms)
2026-11-08T11:29:52Z [load_day 2025-04-17] 2025-04-17: repo_hour merged from 24 files to 1 (2342205 rows, 10486 ms)
2026-11-08T11:29:55Z [load_day 2025-04-17] 2025-04-17: index committed in 13338 ms (24 + 1 + 24 files)
2026-11-08T11:29:55Z [load_day 2025-04-17] 2025-04-17: 5382716 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:29:55Z [load_day 2025-04-17] attempt 1 succeeded