orcaLog in

Runs · run 3772

load_day 2025-04-10, attempt 1 succeeded

Host
73ccef5e07c2:285342
Started
2026-11-08T11:19:47Z
Ended
2026-11-08T11:22:09Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
925 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
213.1 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3772/load_day/2025-04-10/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:19:47Z [load_day 2025-04-10] attempt 1 started
2026-11-08T11:19:49Z [load_day 2025-04-10] 2025-04-10: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:19:58Z [load_day 2025-04-10] 2025-04-10 hour 0: 247415 events in 0 files, snapshot none (task 8608 ms: download 5507 ms overlapping gunzip 1328 ms, parse 5738 ms, sort 0 ms, write 0 ms, index 816 ms: 8 candidates, 93845 repo-hours, 1200 releases; waiting 503 ms; commit 0 ms)
2026-11-08T11:19:59Z [load_day 2025-04-10] 2025-04-10 hour 1: 272621 events in 0 files, snapshot none (task 9244 ms: download 5944 ms overlapping gunzip 1359 ms, parse 6141 ms, sort 0 ms, write 0 ms, index 907 ms: 6 candidates, 122821 repo-hours, 1036 releases; waiting 533 ms; commit 0 ms)
2026-11-08T11:20:07Z [load_day 2025-04-10] 2025-04-10 hour 2: 248071 events in 0 files, snapshot none (task 8591 ms: download 5696 ms overlapping gunzip 1451 ms, parse 5766 ms, sort 0 ms, write 0 ms, index 738 ms: 5 candidates, 87840 repo-hours, 1226 releases; waiting 388 ms; commit 0 ms)
2026-11-08T11:20:08Z [load_day 2025-04-10] 2025-04-10 hour 3: 259205 events in 0 files, snapshot none (task 8573 ms: download 5966 ms overlapping gunzip 1336 ms, parse 5824 ms, sort 0 ms, write 0 ms, index 674 ms: 6 candidates, 87268 repo-hours, 2916 releases; waiting 519 ms; commit 0 ms)
2026-11-08T11:20:17Z [load_day 2025-04-10] 2025-04-10 hour 4: 245214 events in 0 files, snapshot none (task 9071 ms: download 5811 ms overlapping gunzip 1377 ms, parse 6138 ms, sort 0 ms, write 0 ms, index 693 ms: 4 candidates, 74557 repo-hours, 727 releases; waiting 493 ms; commit 0 ms)
2026-11-08T11:20:17Z [load_day 2025-04-10] 2025-04-10 hour 5: 256729 events in 0 files, snapshot none (task 9108 ms: download 6313 ms overlapping gunzip 1373 ms, parse 6095 ms, sort 0 ms, write 0 ms, index 680 ms: 5 candidates, 81001 repo-hours, 891 releases; waiting 700 ms; commit 0 ms)
2026-11-08T11:20:28Z [load_day 2025-04-10] 2025-04-10 hour 6: 277065 events in 0 files, snapshot none (task 10736 ms: download 7498 ms overlapping gunzip 1484 ms, parse 6335 ms, sort 0 ms, write 0 ms, index 830 ms: 3 candidates, 104280 repo-hours, 1091 releases; waiting 1792 ms; commit 0 ms)
2026-11-08T11:20:28Z [load_day 2025-04-10] 2025-04-10 hour 7: 281933 events in 0 files, snapshot none (task 10799 ms: download 7756 ms overlapping gunzip 1685 ms, parse 7300 ms, sort 0 ms, write 0 ms, index 781 ms: 2 candidates, 98266 repo-hours, 1182 releases; waiting 552 ms; commit 0 ms)
2026-11-08T11:20:39Z [load_day 2025-04-10] 2025-04-10 hour 8: 283701 events in 0 files, snapshot none (task 10646 ms: download 7551 ms overlapping gunzip 1686 ms, parse 7260 ms, sort 0 ms, write 0 ms, index 867 ms: 11 candidates, 105068 repo-hours, 1130 releases; waiting 519 ms; commit 0 ms)
2026-11-08T11:20:40Z [load_day 2025-04-10] 2025-04-10 hour 9: 288050 events in 0 files, snapshot none (task 10922 ms: download 8090 ms overlapping gunzip 1765 ms, parse 7581 ms, sort 0 ms, write 0 ms, index 818 ms: 6 candidates, 107735 repo-hours, 1455 releases; waiting 514 ms; commit 0 ms)
2026-11-08T11:20:51Z [load_day 2025-04-10] 2025-04-10 hour 10: 280434 events in 0 files, snapshot none (task 11152 ms: download 7876 ms overlapping gunzip 1870 ms, parse 7756 ms, sort 0 ms, write 0 ms, index 814 ms: 11 candidates, 102046 repo-hours, 1223 releases; waiting 494 ms; commit 0 ms)
2026-11-08T11:20:52Z [load_day 2025-04-10] 2025-04-10 hour 11: 282251 events in 0 files, snapshot none (task 11459 ms: download 8425 ms overlapping gunzip 1938 ms, parse 8048 ms, sort 0 ms, write 0 ms, index 719 ms: 5 candidates, 99349 repo-hours, 1140 releases; waiting 532 ms; commit 0 ms)
2026-11-08T11:21:02Z [load_day 2025-04-10] 2025-04-10 hour 12: 293911 events in 0 files, snapshot none (task 10783 ms: download 6714 ms overlapping gunzip 1733 ms, parse 7077 ms, sort 0 ms, write 0 ms, index 1272 ms: 10 candidates, 133003 repo-hours, 1354 releases; waiting 472 ms; commit 0 ms)
2026-11-08T11:21:04Z [load_day 2025-04-10] 2025-04-10 hour 13: 289472 events in 0 files, snapshot none (task 11232 ms: download 7944 ms overlapping gunzip 1724 ms, parse 7666 ms, sort 0 ms, write 0 ms, index 1005 ms: 4 candidates, 121119 repo-hours, 1281 releases; waiting 510 ms; commit 0 ms)
2026-11-08T11:21:15Z [load_day 2025-04-10] 2025-04-10 hour 14: 283473 events in 0 files, snapshot none (task 11898 ms: download 8362 ms overlapping gunzip 1843 ms, parse 8315 ms, sort 0 ms, write 0 ms, index 981 ms: 7 candidates, 112664 repo-hours, 1783 releases; waiting 528 ms; commit 0 ms)
2026-11-08T11:21:15Z [load_day 2025-04-10] 2025-04-10 hour 15: 290486 events in 0 files, snapshot none (task 11137 ms: download 7816 ms overlapping gunzip 1766 ms, parse 7679 ms, sort 0 ms, write 0 ms, index 930 ms: 11 candidates, 113872 repo-hours, 1345 releases; waiting 461 ms; commit 0 ms)
2026-11-08T11:21:27Z [load_day 2025-04-10] 2025-04-10 hour 16: 289445 events in 0 files, snapshot none (task 11384 ms: download 8480 ms overlapping gunzip 1756 ms, parse 7692 ms, sort 0 ms, write 0 ms, index 914 ms: 9 candidates, 107245 repo-hours, 1188 releases; waiting 736 ms; commit 0 ms)
2026-11-08T11:21:27Z [load_day 2025-04-10] 2025-04-10 hour 17: 285809 events in 0 files, snapshot none (task 10960 ms: download 7823 ms overlapping gunzip 1772 ms, parse 7746 ms, sort 0 ms, write 0 ms, index 761 ms: 12 candidates, 99544 repo-hours, 1266 releases; waiting 362 ms; commit 0 ms)
2026-11-08T11:21:39Z [load_day 2025-04-10] 2025-04-10 hour 18: 285048 events in 0 files, snapshot none (task 11430 ms: download 8782 ms overlapping gunzip 1462 ms, parse 6870 ms, sort 0 ms, write 0 ms, index 800 ms: 10 candidates, 107970 repo-hours, 1259 releases; waiting 2021 ms; commit 0 ms)
2026-11-08T11:21:39Z [load_day 2025-04-10] 2025-04-10 hour 19: 276434 events in 0 files, snapshot none (task 9849 ms: download 6959 ms overlapping gunzip 1459 ms, parse 6677 ms, sort 0 ms, write 0 ms, index 781 ms: 11 candidates, 90587 repo-hours, 1179 releases; waiting 687 ms; commit 0 ms)
2026-11-08T11:21:49Z [load_day 2025-04-10] 2025-04-10 hour 20: 239272 events in 0 files, snapshot none (task 9678 ms: download 6959 ms overlapping gunzip 1434 ms, parse 6708 ms, sort 0 ms, write 0 ms, index 743 ms: 10 candidates, 90808 repo-hours, 1255 releases; waiting 488 ms; commit 0 ms)
2026-11-08T11:21:49Z [load_day 2025-04-10] 2025-04-10 hour 21: 219354 events in 0 files, snapshot none (task 10147 ms: download 7666 ms overlapping gunzip 1656 ms, parse 7008 ms, sort 0 ms, write 0 ms, index 707 ms: 9 candidates, 85931 repo-hours, 1298 releases; waiting 486 ms; commit 0 ms)
2026-11-08T11:21:56Z [load_day 2025-04-10] 2025-04-10 hour 22: 201540 events in 0 files, snapshot none (task 6795 ms: download 4220 ms overlapping gunzip 1024 ms, parse 4171 ms, sort 0 ms, write 0 ms, index 608 ms: 6 candidates, 75435 repo-hours, 1241 releases; waiting 532 ms; commit 0 ms)
2026-11-08T11:21:56Z [load_day 2025-04-10] 2025-04-10 hour 23: 188992 events in 0 files, snapshot none (task 6339 ms: download 4103 ms overlapping gunzip 943 ms, parse 3949 ms, sort 0 ms, write 0 ms, index 609 ms: 4 candidates, 69857 repo-hours, 1353 releases; waiting 538 ms; commit 0 ms)
2026-11-08T11:22:06Z [load_day 2025-04-10] 2025-04-10: repo_hour merged from 24 files to 1 (2372111 rows, 10017 ms)
2026-11-08T11:22:09Z [load_day 2025-04-10] 2025-04-10: index committed in 12907 ms (24 + 1 + 24 files)
2026-11-08T11:22:09Z [load_day 2025-04-10] 2025-04-10: 6365925 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:22:09Z [load_day 2025-04-10] attempt 1 succeeded