orcaLog in

Runs · run 1977

load_day 2024-01-17, attempt 1 succeeded

Host
73ccef5e07c2:33017
Started
2026-11-08T04:11:15Z
Ended
2026-11-08T04:13:21Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
765 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
178.0 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1977/load_day/2024-01-17/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:11:15Z [load_day 2024-01-17] attempt 1 started
2026-11-08T04:11:16Z [load_day 2024-01-17] 2024-01-17: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:11:26Z [load_day 2024-01-17] 2024-01-17 hour 0: 208003 events in 0 files, snapshot none (task 9865 ms: download 6067 ms overlapping gunzip 1633 ms, parse 6741 ms, sort 0 ms, write 0 ms, index 732 ms: 6 candidates, 85672 repo-hours, 1069 releases; waiting 510 ms; commit 0 ms)
2026-11-08T04:11:26Z [load_day 2024-01-17] 2024-01-17 hour 1: 209197 events in 0 files, snapshot none (task 9725 ms: download 5822 ms overlapping gunzip 1497 ms, parse 6575 ms, sort 0 ms, write 0 ms, index 849 ms: 6 candidates, 94009 repo-hours, 1025 releases; waiting 492 ms; commit 0 ms)
2026-11-08T04:11:34Z [load_day 2024-01-17] 2024-01-17 hour 2: 185872 events in 0 files, snapshot none (task 7497 ms: download 3998 ms overlapping gunzip 1165 ms, parse 4917 ms, sort 0 ms, write 0 ms, index 651 ms: 4 candidates, 64236 repo-hours, 795 releases; waiting 506 ms; commit 0 ms)
2026-11-08T04:11:35Z [load_day 2024-01-17] 2024-01-17 hour 3: 181858 events in 0 files, snapshot none (task 8052 ms: download 4151 ms overlapping gunzip 1301 ms, parse 5531 ms, sort 0 ms, write 0 ms, index 676 ms: 2 candidates, 62058 repo-hours, 902 releases; waiting 275 ms; commit 0 ms)
2026-11-08T04:11:41Z [load_day 2024-01-17] 2024-01-17 hour 4: 180450 events in 0 files, snapshot none (task 5918 ms: download 3194 ms overlapping gunzip 957 ms, parse 3713 ms, sort 0 ms, write 0 ms, index 452 ms: 1 candidates, 59050 repo-hours, 560 releases; waiting 233 ms; commit 0 ms)
2026-11-08T04:11:42Z [load_day 2024-01-17] 2024-01-17 hour 5: 188304 events in 0 files, snapshot none (task 6766 ms: download 4057 ms overlapping gunzip 1078 ms, parse 4423 ms, sort 0 ms, write 0 ms, index 566 ms: 1 candidates, 62673 repo-hours, 626 releases; waiting 491 ms; commit 0 ms)
2026-11-08T04:11:49Z [load_day 2024-01-17] 2024-01-17 hour 6: 205505 events in 0 files, snapshot none (task 7918 ms: download 4331 ms overlapping gunzip 1174 ms, parse 5105 ms, sort 0 ms, write 0 ms, index 774 ms: 3 candidates, 76485 repo-hours, 752 releases; waiting 551 ms; commit 0 ms)
2026-11-08T04:11:52Z [load_day 2024-01-17] 2024-01-17 hour 7: 211707 events in 0 files, snapshot none (task 9094 ms: download 5849 ms overlapping gunzip 1326 ms, parse 5814 ms, sort 0 ms, write 0 ms, index 975 ms: 3 candidates, 75656 repo-hours, 997 releases; waiting 504 ms; commit 0 ms)
2026-11-08T04:11:59Z [load_day 2024-01-17] 2024-01-17 hour 8: 221584 events in 0 files, snapshot none (task 9601 ms: download 6196 ms overlapping gunzip 1517 ms, parse 6603 ms, sort 0 ms, write 0 ms, index 727 ms: 13 candidates, 83009 repo-hours, 871 releases; waiting 485 ms; commit 0 ms)
2026-11-08T04:12:03Z [load_day 2024-01-17] 2024-01-17 hour 9: 235104 events in 0 files, snapshot none (task 10466 ms: download 7267 ms overlapping gunzip 1735 ms, parse 7013 ms, sort 0 ms, write 0 ms, index 904 ms: 6 candidates, 87808 repo-hours, 1204 releases; waiting 449 ms; commit 0 ms)
2026-11-08T04:12:10Z [load_day 2024-01-17] 2024-01-17 hour 10: 238969 events in 0 files, snapshot none (task 9993 ms: download 6390 ms overlapping gunzip 1594 ms, parse 6833 ms, sort 0 ms, write 0 ms, index 808 ms: 16 candidates, 88092 repo-hours, 1089 releases; waiting 529 ms; commit 0 ms)
2026-11-08T04:12:13Z [load_day 2024-01-17] 2024-01-17 hour 11: 232868 events in 0 files, snapshot none (task 9266 ms: download 6052 ms overlapping gunzip 1500 ms, parse 6115 ms, sort 0 ms, write 0 ms, index 876 ms: 4 candidates, 84714 repo-hours, 995 releases; waiting 475 ms; commit 0 ms)
2026-11-08T04:12:20Z [load_day 2024-01-17] 2024-01-17 hour 12: 272260 events in 0 files, snapshot none (task 9672 ms: download 6280 ms overlapping gunzip 1451 ms, parse 6597 ms, sort 0 ms, write 0 ms, index 872 ms: 9 candidates, 114434 repo-hours, 1101 releases; waiting 519 ms; commit 0 ms)
2026-11-08T04:12:24Z [load_day 2024-01-17] 2024-01-17 hour 13: 254517 events in 0 files, snapshot none (task 10762 ms: download 6897 ms overlapping gunzip 1584 ms, parse 6801 ms, sort 0 ms, write 0 ms, index 1533 ms: 9 candidates, 106899 repo-hours, 1209 releases; waiting 479 ms; commit 0 ms)
2026-11-08T04:12:31Z [load_day 2024-01-17] 2024-01-17 hour 14: 255723 events in 0 files, snapshot none (task 10406 ms: download 7328 ms overlapping gunzip 1627 ms, parse 7116 ms, sort 0 ms, write 0 ms, index 887 ms: 10 candidates, 98940 repo-hours, 1274 releases; waiting 515 ms; commit 0 ms)
2026-11-08T04:12:34Z [load_day 2024-01-17] 2024-01-17 hour 15: 250160 events in 0 files, snapshot none (task 9230 ms: download 6217 ms overlapping gunzip 1371 ms, parse 5966 ms, sort 0 ms, write 0 ms, index 943 ms: 3 candidates, 98517 repo-hours, 1211 releases; waiting 591 ms; commit 0 ms)
2026-11-08T04:12:39Z [load_day 2024-01-17] 2024-01-17 hour 16: 245545 events in 0 files, snapshot none (task 7844 ms: download 5218 ms overlapping gunzip 1226 ms, parse 5083 ms, sort 0 ms, write 0 ms, index 721 ms: 7 candidates, 96550 repo-hours, 1210 releases; waiting 556 ms; commit 0 ms)
2026-11-08T04:12:42Z [load_day 2024-01-17] 2024-01-17 hour 17: 237504 events in 0 files, snapshot none (task 7608 ms: download 5054 ms overlapping gunzip 1175 ms, parse 4888 ms, sort 0 ms, write 0 ms, index 728 ms: 7 candidates, 88928 repo-hours, 1050 releases; waiting 532 ms; commit 0 ms)
2026-11-08T04:12:50Z [load_day 2024-01-17] 2024-01-17 hour 18: 239895 events in 0 files, snapshot none (task 9896 ms: download 5391 ms overlapping gunzip 1496 ms, parse 6237 ms, sort 0 ms, write 0 ms, index 1172 ms: 3 candidates, 91781 repo-hours, 983 releases; waiting 502 ms; commit 0 ms)
2026-11-08T04:12:53Z [load_day 2024-01-17] 2024-01-17 hour 19: 221633 events in 0 files, snapshot none (task 10288 ms: download 6802 ms overlapping gunzip 1531 ms, parse 6608 ms, sort 0 ms, write 0 ms, index 898 ms: 5 candidates, 81681 repo-hours, 984 releases; waiting 876 ms; commit 0 ms)
2026-11-08T04:13:01Z [load_day 2024-01-17] 2024-01-17 hour 20: 213073 events in 0 files, snapshot none (task 9649 ms: download 5385 ms overlapping gunzip 1451 ms, parse 6195 ms, sort 0 ms, write 0 ms, index 1114 ms: 6 candidates, 77492 repo-hours, 1029 releases; waiting 538 ms; commit 0 ms)
2026-11-08T04:13:03Z [load_day 2024-01-17] 2024-01-17 hour 21: 200362 events in 0 files, snapshot none (task 8962 ms: download 6180 ms overlapping gunzip 1450 ms, parse 6058 ms, sort 0 ms, write 0 ms, index 624 ms: 7 candidates, 71726 repo-hours, 972 releases; waiting 517 ms; commit 0 ms)
2026-11-08T04:13:09Z [load_day 2024-01-17] 2024-01-17 hour 22: 190973 events in 0 files, snapshot none (task 7874 ms: download 4614 ms overlapping gunzip 1228 ms, parse 5219 ms, sort 0 ms, write 0 ms, index 660 ms: 6 candidates, 65302 repo-hours, 1066 releases; waiting 510 ms; commit 0 ms)
2026-11-08T04:13:10Z [load_day 2024-01-17] 2024-01-17 hour 23: 176077 events in 0 files, snapshot none (task 7002 ms: download 4581 ms overlapping gunzip 1135 ms, parse 4668 ms, sort 0 ms, write 0 ms, index 438 ms: 6 candidates, 60084 repo-hours, 745 releases; waiting 464 ms; commit 0 ms)
2026-11-08T04:13:19Z [load_day 2024-01-17] 2024-01-17: repo_hour merged from 24 files to 1 (1975796 rows, 8699 ms)
2026-11-08T04:13:21Z [load_day 2024-01-17] 2024-01-17: index committed in 11106 ms (24 + 1 + 24 files)
2026-11-08T04:13:21Z [load_day 2024-01-17] 2024-01-17: 5257143 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:13:21Z [load_day 2024-01-17] attempt 1 succeeded