orcaLog in

Runs · run 4324

load_day 2025-08-28, attempt 1 succeeded

Host
73ccef5e07c2:369072
Started
2026-11-08T13:35:23Z
Ended
2026-11-08T13:37:09Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
695 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
153.3 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4324/load_day/2025-08-28/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:35:23Z [load_day 2025-08-28] attempt 1 started
2026-11-08T13:35:24Z [load_day 2025-08-28] 2025-08-28: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:35:33Z [load_day 2025-08-28] 2025-08-28 hour 0: 147489 events in 0 files, snapshot none (task 7801 ms: download 4113 ms overlapping gunzip 1328 ms, parse 4911 ms, sort 0 ms, write 0 ms, index 785 ms: 9 candidates, 75385 repo-hours, 1031 releases; waiting 507 ms; commit 0 ms)
2026-11-08T13:35:33Z [load_day 2025-08-28] 2025-08-28 hour 1: 155116 events in 0 files, snapshot none (task 7247 ms: download 3758 ms overlapping gunzip 1159 ms, parse 4395 ms, sort 0 ms, write 0 ms, index 1152 ms: 7 candidates, 91215 repo-hours, 807 releases; waiting 267 ms; commit 0 ms)
2026-11-08T13:35:39Z [load_day 2025-08-28] 2025-08-28 hour 2: 146395 events in 0 files, snapshot none (task 5541 ms: download 3051 ms overlapping gunzip 935 ms, parse 3434 ms, sort 0 ms, write 0 ms, index 569 ms: 9 candidates, 68164 repo-hours, 885 releases; waiting 325 ms; commit 0 ms)
2026-11-08T13:35:40Z [load_day 2025-08-28] 2025-08-28 hour 3: 150761 events in 0 files, snapshot none (task 6082 ms: download 3534 ms overlapping gunzip 1030 ms, parse 3673 ms, sort 0 ms, write 0 ms, index 542 ms: 3 candidates, 68029 repo-hours, 2002 releases; waiting 498 ms; commit 0 ms)
2026-11-08T13:35:45Z [load_day 2025-08-28] 2025-08-28 hour 4: 144724 events in 0 files, snapshot none (task 5208 ms: download 2844 ms overlapping gunzip 811 ms, parse 3007 ms, sort 0 ms, write 0 ms, index 551 ms: 5 candidates, 61810 repo-hours, 655 releases; waiting 529 ms; commit 0 ms)
2026-11-08T13:35:47Z [load_day 2025-08-28] 2025-08-28 hour 5: 147460 events in 0 files, snapshot none (task 6696 ms: download 4121 ms overlapping gunzip 937 ms, parse 3296 ms, sort 0 ms, write 0 ms, index 636 ms: 1 candidates, 64436 repo-hours, 620 releases; waiting 1323 ms; commit 0 ms)
2026-11-08T13:35:51Z [load_day 2025-08-28] 2025-08-28 hour 6: 156094 events in 0 files, snapshot none (task 5422 ms: download 3433 ms overlapping gunzip 842 ms, parse 3170 ms, sort 0 ms, write 0 ms, index 625 ms: 3 candidates, 78468 repo-hours, 784 releases; waiting 497 ms; commit 0 ms)
2026-11-08T13:35:53Z [load_day 2025-08-28] 2025-08-28 hour 7: 155732 events in 0 files, snapshot none (task 5760 ms: download 3496 ms overlapping gunzip 892 ms, parse 3514 ms, sort 0 ms, write 0 ms, index 594 ms: 7 candidates, 73234 repo-hours, 682 releases; waiting 538 ms; commit 0 ms)
2026-11-08T13:35:58Z [load_day 2025-08-28] 2025-08-28 hour 8: 159708 events in 0 files, snapshot none (task 6705 ms: download 3528 ms overlapping gunzip 940 ms, parse 3718 ms, sort 0 ms, write 0 ms, index 1236 ms: 5 candidates, 79627 repo-hours, 811 releases; waiting 562 ms; commit 0 ms)
2026-11-08T13:36:01Z [load_day 2025-08-28] 2025-08-28 hour 9: 151412 events in 0 files, snapshot none (task 6884 ms: download 3835 ms overlapping gunzip 1103 ms, parse 4137 ms, sort 0 ms, write 0 ms, index 896 ms: 5 candidates, 76487 repo-hours, 878 releases; waiting 516 ms; commit 0 ms)
2026-11-08T13:36:10Z [load_day 2025-08-28] 2025-08-28 hour 10: 162051 events in 0 files, snapshot none (task 10911 ms: download 7635 ms overlapping gunzip 1525 ms, parse 6086 ms, sort 0 ms, write 0 ms, index 666 ms: 6 candidates, 77229 repo-hours, 839 releases; waiting 1982 ms; commit 0 ms)
2026-11-08T13:36:10Z [load_day 2025-08-28] 2025-08-28 hour 11: 160189 events in 0 files, snapshot none (task 8375 ms: download 5390 ms overlapping gunzip 1309 ms, parse 5321 ms, sort 0 ms, write 0 ms, index 821 ms: 9 candidates, 74219 repo-hours, 757 releases; waiting 672 ms; commit 0 ms)
2026-11-08T13:36:18Z [load_day 2025-08-28] 2025-08-28 hour 12: 168070 events in 0 files, snapshot none (task 7650 ms: download 5061 ms overlapping gunzip 1221 ms, parse 4681 ms, sort 0 ms, write 0 ms, index 705 ms: 4 candidates, 97906 repo-hours, 915 releases; waiting 747 ms; commit 0 ms)
2026-11-08T13:36:18Z [load_day 2025-08-28] 2025-08-28 hour 13: 170404 events in 0 files, snapshot none (task 7519 ms: download 4994 ms overlapping gunzip 1189 ms, parse 4800 ms, sort 0 ms, write 0 ms, index 725 ms: 8 candidates, 92834 repo-hours, 988 releases; waiting 510 ms; commit 0 ms)
2026-11-08T13:36:27Z [load_day 2025-08-28] 2025-08-28 hour 14: 161753 events in 0 files, snapshot none (task 8587 ms: download 5835 ms overlapping gunzip 1339 ms, parse 5183 ms, sort 0 ms, write 0 ms, index 699 ms: 6 candidates, 81253 repo-hours, 1003 releases; waiting 1083 ms; commit 0 ms)
2026-11-08T13:36:27Z [load_day 2025-08-28] 2025-08-28 hour 15: 162581 events in 0 files, snapshot none (task 7352 ms: download 4605 ms overlapping gunzip 1139 ms, parse 4730 ms, sort 0 ms, write 0 ms, index 665 ms: 7 candidates, 81495 repo-hours, 951 releases; waiting 501 ms; commit 0 ms)
2026-11-08T13:36:35Z [load_day 2025-08-28] 2025-08-28 hour 16: 161847 events in 0 files, snapshot none (task 7034 ms: download 4211 ms overlapping gunzip 1055 ms, parse 4480 ms, sort 0 ms, write 0 ms, index 721 ms: 6 candidates, 79636 repo-hours, 841 releases; waiting 503 ms; commit 0 ms)
2026-11-08T13:36:35Z [load_day 2025-08-28] 2025-08-28 hour 17: 164258 events in 0 files, snapshot none (task 7067 ms: download 4371 ms overlapping gunzip 1113 ms, parse 4492 ms, sort 0 ms, write 0 ms, index 661 ms: 7 candidates, 77680 repo-hours, 816 releases; waiting 512 ms; commit 0 ms)
2026-11-08T13:36:43Z [load_day 2025-08-28] 2025-08-28 hour 18: 160890 events in 0 files, snapshot none (task 7669 ms: download 5181 ms overlapping gunzip 1043 ms, parse 4611 ms, sort 0 ms, write 0 ms, index 596 ms: 6 candidates, 81506 repo-hours, 859 releases; waiting 1110 ms; commit 0 ms)
2026-11-08T13:36:43Z [load_day 2025-08-28] 2025-08-28 hour 19: 157518 events in 0 files, snapshot none (task 7154 ms: download 4191 ms overlapping gunzip 1171 ms, parse 4669 ms, sort 0 ms, write 0 ms, index 669 ms: 7 candidates, 70344 repo-hours, 700 releases; waiting 353 ms; commit 0 ms)
2026-11-08T13:36:51Z [load_day 2025-08-28] 2025-08-28 hour 20: 152985 events in 0 files, snapshot none (task 7146 ms: download 4335 ms overlapping gunzip 1097 ms, parse 4710 ms, sort 0 ms, write 0 ms, index 536 ms: 9 candidates, 68657 repo-hours, 823 releases; waiting 498 ms; commit 0 ms)
2026-11-08T13:36:51Z [load_day 2025-08-28] 2025-08-28 hour 21: 147366 events in 0 files, snapshot none (task 6783 ms: download 3999 ms overlapping gunzip 1097 ms, parse 4630 ms, sort 0 ms, write 0 ms, index 468 ms: 11 candidates, 63676 repo-hours, 873 releases; waiting 314 ms; commit 0 ms)
2026-11-08T13:36:58Z [load_day 2025-08-28] 2025-08-28 hour 22: 145379 events in 0 files, snapshot none (task 6734 ms: download 3930 ms overlapping gunzip 1115 ms, parse 4376 ms, sort 0 ms, write 0 ms, index 514 ms: 6 candidates, 59089 repo-hours, 932 releases; waiting 519 ms; commit 0 ms)
2026-11-08T13:36:58Z [load_day 2025-08-28] 2025-08-28 hour 23: 143645 events in 0 files, snapshot none (task 6461 ms: download 3505 ms overlapping gunzip 1049 ms, parse 4039 ms, sort 0 ms, write 0 ms, index 515 ms: 2 candidates, 56413 repo-hours, 829 releases; waiting 533 ms; commit 0 ms)
2026-11-08T13:37:06Z [load_day 2025-08-28] 2025-08-28: repo_hour merged from 24 files to 1 (1798792 rows, 8268 ms)
2026-11-08T13:37:09Z [load_day 2025-08-28] 2025-08-28: index committed in 11196 ms (24 + 1 + 24 files)
2026-11-08T13:37:09Z [load_day 2025-08-28] 2025-08-28: 3733827 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:37:09Z [load_day 2025-08-28] attempt 1 succeeded