orcaLog in

Runs · run 3402

load_day 2025-01-06, attempt 1 succeeded

Host
73ccef5e07c2:233347
Started
2026-11-08T09:40:58Z
Ended
2026-11-08T09:43:02Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
842 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
194.4 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3402/load_day/2025-01-06/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:40:58Z [load_day 2025-01-06] attempt 1 started
2026-11-08T09:40:59Z [load_day 2025-01-06] 2025-01-06: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:41:07Z [load_day 2025-01-06] 2025-01-06 hour 0: 174081 events in 0 files, snapshot none (task 6931 ms: download 4526 ms overlapping gunzip 1064 ms, parse 4490 ms, sort 0 ms, write 0 ms, index 594 ms: 9 candidates, 81621 repo-hours, 1221 releases; waiting 517 ms; commit 0 ms)
2026-11-08T09:41:07Z [load_day 2025-01-06] 2025-01-06 hour 1: 208744 events in 0 files, snapshot none (task 7190 ms: download 4477 ms overlapping gunzip 1146 ms, parse 4603 ms, sort 0 ms, write 0 ms, index 843 ms: 6 candidates, 119601 repo-hours, 838 releases; waiting 356 ms; commit 0 ms)
2026-11-08T09:41:14Z [load_day 2025-01-06] 2025-01-06 hour 2: 172518 events in 0 files, snapshot none (task 7055 ms: download 4574 ms overlapping gunzip 1065 ms, parse 4171 ms, sort 0 ms, write 0 ms, index 565 ms: 6 candidates, 77446 repo-hours, 844 releases; waiting 998 ms; commit 0 ms)
2026-11-08T09:41:15Z [load_day 2025-01-06] 2025-01-06 hour 3: 190967 events in 0 files, snapshot none (task 7276 ms: download 4760 ms overlapping gunzip 1177 ms, parse 4572 ms, sort 0 ms, write 0 ms, index 578 ms: 2 candidates, 76129 repo-hours, 3937 releases; waiting 495 ms; commit 0 ms)
2026-11-08T09:41:22Z [load_day 2025-01-06] 2025-01-06 hour 4: 178189 events in 0 files, snapshot none (task 7040 ms: download 4616 ms overlapping gunzip 1163 ms, parse 4475 ms, sort 0 ms, write 0 ms, index 468 ms: 3 candidates, 63792 repo-hours, 673 releases; waiting 643 ms; commit 0 ms)
2026-11-08T09:41:22Z [load_day 2025-01-06] 2025-01-06 hour 5: 183592 events in 0 files, snapshot none (task 7203 ms: download 4710 ms overlapping gunzip 1187 ms, parse 4545 ms, sort 0 ms, write 0 ms, index 639 ms: 5 candidates, 68347 repo-hours, 728 releases; waiting 474 ms; commit 0 ms)
2026-11-08T09:41:31Z [load_day 2025-01-06] 2025-01-06 hour 6: 207569 events in 0 files, snapshot none (task 8576 ms: download 5061 ms overlapping gunzip 1143 ms, parse 4895 ms, sort 0 ms, write 0 ms, index 1798 ms: 3 candidates, 91563 repo-hours, 851 releases; waiting 498 ms; commit 0 ms)
2026-11-08T09:41:31Z [load_day 2025-01-06] 2025-01-06 hour 7: 203560 events in 0 files, snapshot none (task 8320 ms: download 4854 ms overlapping gunzip 1208 ms, parse 4628 ms, sort 0 ms, write 0 ms, index 1678 ms: 2 candidates, 77898 repo-hours, 809 releases; waiting 489 ms; commit 0 ms)
2026-11-08T09:41:42Z [load_day 2025-01-06] 2025-01-06 hour 8: 214440 events in 0 files, snapshot none (task 9439 ms: download 6512 ms overlapping gunzip 1514 ms, parse 6223 ms, sort 0 ms, write 0 ms, index 901 ms: 6 candidates, 86775 repo-hours, 929 releases; waiting 483 ms; commit 0 ms)
2026-11-08T09:41:43Z [load_day 2025-01-06] 2025-01-06 hour 9: 229011 events in 0 files, snapshot none (task 10055 ms: download 6673 ms overlapping gunzip 1709 ms, parse 6640 ms, sort 0 ms, write 0 ms, index 948 ms: 4 candidates, 94758 repo-hours, 1204 releases; waiting 523 ms; commit 0 ms)
2026-11-08T09:41:50Z [load_day 2025-01-06] 2025-01-06 hour 10: 226973 events in 0 files, snapshot none (task 7456 ms: download 4896 ms overlapping gunzip 1194 ms, parse 4769 ms, sort 0 ms, write 0 ms, index 675 ms: 8 candidates, 90866 repo-hours, 1146 releases; waiting 415 ms; commit 0 ms)
2026-11-08T09:41:50Z [load_day 2025-01-06] 2025-01-06 hour 11: 221762 events in 0 files, snapshot none (task 7400 ms: download 5031 ms overlapping gunzip 1209 ms, parse 4796 ms, sort 0 ms, write 0 ms, index 657 ms: 5 candidates, 85830 repo-hours, 1088 releases; waiting 503 ms; commit 0 ms)
2026-11-08T09:41:58Z [load_day 2025-01-06] 2025-01-06 hour 12: 265086 events in 0 files, snapshot none (task 7857 ms: download 4834 ms overlapping gunzip 1164 ms, parse 4718 ms, sort 0 ms, write 0 ms, index 1094 ms: 9 candidates, 131724 repo-hours, 1320 releases; waiting 582 ms; commit 0 ms)
2026-11-08T09:41:59Z [load_day 2025-01-06] 2025-01-06 hour 13: 250397 events in 0 files, snapshot none (task 8257 ms: download 5270 ms overlapping gunzip 1257 ms, parse 5199 ms, sort 0 ms, write 0 ms, index 1025 ms: 9 candidates, 114119 repo-hours, 1211 releases; waiting 496 ms; commit 0 ms)
2026-11-08T09:42:09Z [load_day 2025-01-06] 2025-01-06 hour 14: 245453 events in 0 files, snapshot none (task 9987 ms: download 6185 ms overlapping gunzip 1565 ms, parse 6464 ms, sort 0 ms, write 0 ms, index 1500 ms: 12 candidates, 99918 repo-hours, 1260 releases; waiting 192 ms; commit 0 ms)
2026-11-08T09:42:10Z [load_day 2025-01-06] 2025-01-06 hour 15: 252349 events in 0 files, snapshot none (task 10128 ms: download 7060 ms overlapping gunzip 1638 ms, parse 6941 ms, sort 0 ms, write 0 ms, index 783 ms: 12 candidates, 107052 repo-hours, 1393 releases; waiting 466 ms; commit 0 ms)
2026-11-08T09:42:21Z [load_day 2025-01-06] 2025-01-06 hour 16: 245416 events in 0 files, snapshot none (task 11916 ms: download 9229 ms overlapping gunzip 1963 ms, parse 8212 ms, sort 0 ms, write 0 ms, index 829 ms: 8 candidates, 100307 repo-hours, 1178 releases; waiting 695 ms; commit 0 ms)
2026-11-08T09:42:22Z [load_day 2025-01-06] 2025-01-06 hour 17: 241421 events in 0 files, snapshot none (task 11267 ms: download 8628 ms overlapping gunzip 1936 ms, parse 7763 ms, sort 0 ms, write 0 ms, index 756 ms: 7 candidates, 95442 repo-hours, 1145 releases; waiting 498 ms; commit 0 ms)
2026-11-08T09:42:32Z [load_day 2025-01-06] 2025-01-06 hour 18: 245816 events in 0 files, snapshot none (task 9610 ms: download 6864 ms overlapping gunzip 1600 ms, parse 6277 ms, sort 0 ms, write 0 ms, index 957 ms: 3 candidates, 104819 repo-hours, 1243 releases; waiting 522 ms; commit 0 ms)
2026-11-08T09:42:32Z [load_day 2025-01-06] 2025-01-06 hour 19: 224117 events in 0 files, snapshot none (task 8912 ms: download 6377 ms overlapping gunzip 1497 ms, parse 5972 ms, sort 0 ms, write 0 ms, index 630 ms: 11 candidates, 81068 repo-hours, 1039 releases; waiting 532 ms; commit 0 ms)
2026-11-08T09:42:41Z [load_day 2025-01-06] 2025-01-06 hour 20: 221123 events in 0 files, snapshot none (task 9431 ms: download 6481 ms overlapping gunzip 1537 ms, parse 6296 ms, sort 0 ms, write 0 ms, index 745 ms: 12 candidates, 82759 repo-hours, 1084 releases; waiting 526 ms; commit 0 ms)
2026-11-08T09:42:42Z [load_day 2025-01-06] 2025-01-06 hour 21: 218817 events in 0 files, snapshot none (task 9432 ms: download 6246 ms overlapping gunzip 1548 ms, parse 6322 ms, sort 0 ms, write 0 ms, index 642 ms: 11 candidates, 82691 repo-hours, 1129 releases; waiting 515 ms; commit 0 ms)
2026-11-08T09:42:51Z [load_day 2025-01-06] 2025-01-06 hour 22: 202998 events in 0 files, snapshot none (task 8385 ms: download 5936 ms overlapping gunzip 1438 ms, parse 5546 ms, sort 0 ms, write 0 ms, index 552 ms: 20 candidates, 69633 repo-hours, 1243 releases; waiting 490 ms; commit 0 ms)
2026-11-08T09:42:51Z [load_day 2025-01-06] 2025-01-06 hour 23: 189242 events in 0 files, snapshot none (task 7284 ms: download 4915 ms overlapping gunzip 1229 ms, parse 4849 ms, sort 0 ms, write 0 ms, index 493 ms: 5 candidates, 65436 repo-hours, 828 releases; waiting 461 ms; commit 0 ms)
2026-11-08T09:43:00Z [load_day 2025-01-06] 2025-01-06: repo_hour merged from 24 files to 1 (2149594 rows, 8899 ms)
2026-11-08T09:43:02Z [load_day 2025-01-06] 2025-01-06: index committed in 11829 ms (24 + 1 + 24 files)
2026-11-08T09:43:02Z [load_day 2025-01-06] 2025-01-06: 5213641 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:43:02Z [load_day 2025-01-06] attempt 1 succeeded