orcaLog in

Runs · run 3751

load_day 2025-04-04, attempt 1 succeeded

Host
73ccef5e07c2:282414
Started
2026-11-08T11:13:34Z
Ended
2026-11-08T11:17:17Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
799 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
206.7 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3751/load_day/2025-04-04/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:13:34Z [load_day 2025-04-04] attempt 1 started
2026-11-08T11:13:35Z [load_day 2025-04-04] 2025-04-04: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:13:44Z [load_day 2025-04-04] 2025-04-04 hour 0: 200564 events in 0 files, snapshot none (task 9093 ms: download 5157 ms overlapping gunzip 1400 ms, parse 6208 ms, sort 0 ms, write 0 ms, index 969 ms: 7 candidates, 93062 repo-hours, 1311 releases; waiting 221 ms; commit 0 ms)
2026-11-08T11:13:45Z [load_day 2025-04-04] 2025-04-04 hour 1: 218037 events in 0 files, snapshot none (task 9859 ms: download 5920 ms overlapping gunzip 1403 ms, parse 6795 ms, sort 0 ms, write 0 ms, index 998 ms: 4 candidates, 118431 repo-hours, 1025 releases; waiting 374 ms; commit 0 ms)
2026-11-08T11:13:53Z [load_day 2025-04-04] 2025-04-04 hour 2: 192243 events in 0 files, snapshot none (task 8127 ms: download 3875 ms overlapping gunzip 1138 ms, parse 5079 ms, sort 0 ms, write 0 ms, index 952 ms: 3 candidates, 81033 repo-hours, 947 releases; waiting 518 ms; commit 0 ms)
2026-11-08T11:13:54Z [load_day 2025-04-04] 2025-04-04 hour 3: 202103 events in 0 files, snapshot none (task 7922 ms: download 4798 ms overlapping gunzip 1264 ms, parse 5187 ms, sort 0 ms, write 0 ms, index 654 ms: 5 candidates, 79781 repo-hours, 2939 releases; waiting 580 ms; commit 0 ms)
2026-11-08T11:15:31Z [load_day 2025-04-04] 2025-04-04 hour 4: 185773 events in 0 files, snapshot none (task 97725 ms: download 96864 ms overlapping gunzip 1288 ms, parse 5638 ms, sort 0 ms, write 0 ms, index 567 ms: 3 candidates, 70836 repo-hours, 834 releases; waiting 89956 ms; commit 0 ms)
2026-11-08T11:15:31Z [load_day 2025-04-04] 2025-04-04 hour 5: 201203 events in 0 files, snapshot none (task 5680 ms: download 3209 ms overlapping gunzip 805 ms, parse 3420 ms, sort 0 ms, write 0 ms, index 606 ms: 4 candidates, 75342 repo-hours, 1050 releases; waiting 525 ms; commit 0 ms)
2026-11-08T11:15:41Z [load_day 2025-04-04] 2025-04-04 hour 6: 221052 events in 0 files, snapshot none (task 8876 ms: download 5764 ms overlapping gunzip 1378 ms, parse 5785 ms, sort 0 ms, write 0 ms, index 820 ms: 2 candidates, 96017 repo-hours, 1089 releases; waiting 547 ms; commit 0 ms)
2026-11-08T11:15:41Z [load_day 2025-04-04] 2025-04-04 hour 7: 221774 events in 0 files, snapshot none (task 8730 ms: download 5792 ms overlapping gunzip 1378 ms, parse 5904 ms, sort 0 ms, write 0 ms, index 716 ms: 9 candidates, 88385 repo-hours, 1047 releases; waiting 500 ms; commit 0 ms)
2026-11-08T11:15:52Z [load_day 2025-04-04] 2025-04-04 hour 8: 238159 events in 0 files, snapshot none (task 10729 ms: download 7097 ms overlapping gunzip 1748 ms, parse 7165 ms, sort 0 ms, write 0 ms, index 891 ms: 8 candidates, 97064 repo-hours, 1188 releases; waiting 501 ms; commit 0 ms)
2026-11-08T11:15:52Z [load_day 2025-04-04] 2025-04-04 hour 9: 249482 events in 0 files, snapshot none (task 10474 ms: download 7053 ms overlapping gunzip 1571 ms, parse 6994 ms, sort 0 ms, write 0 ms, index 1034 ms: 10 candidates, 101530 repo-hours, 1348 releases; waiting 547 ms; commit 0 ms)
2026-11-08T11:16:02Z [load_day 2025-04-04] 2025-04-04 hour 10: 236117 events in 0 files, snapshot none (task 9754 ms: download 6638 ms overlapping gunzip 1492 ms, parse 6369 ms, sort 0 ms, write 0 ms, index 777 ms: 8 candidates, 96095 repo-hours, 1181 releases; waiting 568 ms; commit 0 ms)
2026-11-08T11:16:02Z [load_day 2025-04-04] 2025-04-04 hour 11: 233018 events in 0 files, snapshot none (task 8868 ms: download 5987 ms overlapping gunzip 1375 ms, parse 5844 ms, sort 0 ms, write 0 ms, index 836 ms: 17 candidates, 93711 repo-hours, 1270 releases; waiting 590 ms; commit 0 ms)
2026-11-08T11:16:13Z [load_day 2025-04-04] 2025-04-04 hour 12: 271979 events in 0 files, snapshot none (task 9952 ms: download 6041 ms overlapping gunzip 1475 ms, parse 6281 ms, sort 0 ms, write 0 ms, index 1339 ms: 8 candidates, 138760 repo-hours, 1363 releases; waiting 520 ms; commit 0 ms)
2026-11-08T11:16:13Z [load_day 2025-04-04] 2025-04-04 hour 13: 263537 events in 0 files, snapshot none (task 10621 ms: download 7295 ms overlapping gunzip 1677 ms, parse 7142 ms, sort 0 ms, write 0 ms, index 949 ms: 6 candidates, 124489 repo-hours, 1390 releases; waiting 533 ms; commit 0 ms)
2026-11-08T11:16:24Z [load_day 2025-04-04] 2025-04-04 hour 14: 263895 events in 0 files, snapshot none (task 11243 ms: download 8581 ms overlapping gunzip 1847 ms, parse 7203 ms, sort 0 ms, write 0 ms, index 796 ms: 8 candidates, 111900 repo-hours, 1475 releases; waiting 1087 ms; commit 0 ms)
2026-11-08T11:16:25Z [load_day 2025-04-04] 2025-04-04 hour 15: 260008 events in 0 files, snapshot none (task 11003 ms: download 8247 ms overlapping gunzip 1772 ms, parse 7199 ms, sort 0 ms, write 0 ms, index 841 ms: 15 candidates, 114372 repo-hours, 1328 releases; waiting 870 ms; commit 0 ms)
2026-11-08T11:16:36Z [load_day 2025-04-04] 2025-04-04 hour 16: 250939 events in 0 files, snapshot none (task 11223 ms: download 7797 ms overlapping gunzip 1782 ms, parse 7617 ms, sort 0 ms, write 0 ms, index 1009 ms: 7 candidates, 107386 repo-hours, 1065 releases; waiting 525 ms; commit 0 ms)
2026-11-08T11:16:36Z [load_day 2025-04-04] 2025-04-04 hour 17: 242345 events in 0 files, snapshot none (task 9869 ms: download 6876 ms overlapping gunzip 1562 ms, parse 6535 ms, sort 0 ms, write 0 ms, index 969 ms: 5 candidates, 97222 repo-hours, 1135 releases; waiting 530 ms; commit 0 ms)
2026-11-08T11:16:48Z [load_day 2025-04-04] 2025-04-04 hour 18: 247957 events in 0 files, snapshot none (task 11353 ms: download 7835 ms overlapping gunzip 1742 ms, parse 7851 ms, sort 0 ms, write 0 ms, index 860 ms: 3 candidates, 108510 repo-hours, 1186 releases; waiting 514 ms; commit 0 ms)
2026-11-08T11:16:48Z [load_day 2025-04-04] 2025-04-04 hour 19: 232160 events in 0 files, snapshot none (task 10408 ms: download 6637 ms overlapping gunzip 1672 ms, parse 7021 ms, sort 0 ms, write 0 ms, index 934 ms: 8 candidates, 89805 repo-hours, 1086 releases; waiting 460 ms; commit 0 ms)
2026-11-08T11:16:57Z [load_day 2025-04-04] 2025-04-04 hour 20: 228708 events in 0 files, snapshot none (task 8676 ms: download 6118 ms overlapping gunzip 1407 ms, parse 5733 ms, sort 0 ms, write 0 ms, index 718 ms: 8 candidates, 92345 repo-hours, 1086 releases; waiting 518 ms; commit 0 ms)
2026-11-08T11:16:57Z [load_day 2025-04-04] 2025-04-04 hour 21: 215211 events in 0 files, snapshot none (task 8423 ms: download 5995 ms overlapping gunzip 1325 ms, parse 5647 ms, sort 0 ms, write 0 ms, index 633 ms: 8 candidates, 84740 repo-hours, 1048 releases; waiting 505 ms; commit 0 ms)
2026-11-08T11:17:05Z [load_day 2025-04-04] 2025-04-04 hour 22: 197928 events in 0 files, snapshot none (task 7174 ms: download 4738 ms overlapping gunzip 1238 ms, parse 4887 ms, sort 0 ms, write 0 ms, index 624 ms: 5 candidates, 73322 repo-hours, 1095 releases; waiting 219 ms; commit 0 ms)
2026-11-08T11:17:05Z [load_day 2025-04-04] 2025-04-04 hour 23: 186199 events in 0 files, snapshot none (task 7280 ms: download 4879 ms overlapping gunzip 1069 ms, parse 4567 ms, sort 0 ms, write 0 ms, index 530 ms: 4 candidates, 68232 repo-hours, 1009 releases; waiting 827 ms; commit 0 ms)
2026-11-08T11:17:14Z [load_day 2025-04-04] 2025-04-04: repo_hour merged from 24 files to 1 (2302370 rows, 9686 ms)
2026-11-08T11:17:17Z [load_day 2025-04-04] 2025-04-04: index committed in 12571 ms (24 + 1 + 24 files)
2026-11-08T11:17:17Z [load_day 2025-04-04] 2025-04-04: 5460391 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:17:17Z [load_day 2025-04-04] attempt 1 succeeded