orcaLog in

Runs · run 4264

load_day 2025-08-12, attempt 1 succeeded

Host
73ccef5e07c2:359718
Started
2026-11-08T13:20:53Z
Ended
2026-11-08T13:22:49Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
688 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
170.2 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4264/load_day/2025-08-12/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:20:53Z [load_day 2025-08-12] attempt 1 started
2026-11-08T13:20:54Z [load_day 2025-08-12] 2025-08-12: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:21:03Z [load_day 2025-08-12] 2025-08-12 hour 0: 152287 events in 0 files, snapshot none (task 8165 ms: download 5352 ms overlapping gunzip 1385 ms, parse 5269 ms, sort 0 ms, write 0 ms, index 705 ms: 9 candidates, 74780 repo-hours, 1010 releases; waiting 524 ms; commit 0 ms)
2026-11-08T13:21:03Z [load_day 2025-08-12] 2025-08-12 hour 1: 156433 events in 0 files, snapshot none (task 7880 ms: download 4659 ms overlapping gunzip 1345 ms, parse 4945 ms, sort 0 ms, write 0 ms, index 756 ms: 7 candidates, 88992 repo-hours, 646 releases; waiting 517 ms; commit 0 ms)
2026-11-08T13:21:11Z [load_day 2025-08-12] 2025-08-12 hour 2: 152027 events in 0 files, snapshot none (task 7812 ms: download 4472 ms overlapping gunzip 1310 ms, parse 4870 ms, sort 0 ms, write 0 ms, index 812 ms: 9 candidates, 73843 repo-hours, 787 releases; waiting 503 ms; commit 0 ms)
2026-11-08T13:21:11Z [load_day 2025-08-12] 2025-08-12 hour 3: 153364 events in 0 files, snapshot none (task 7985 ms: download 4651 ms overlapping gunzip 1277 ms, parse 5064 ms, sort 0 ms, write 0 ms, index 803 ms: 1 candidates, 71182 repo-hours, 1964 releases; waiting 518 ms; commit 0 ms)
2026-11-08T13:21:19Z [load_day 2025-08-12] 2025-08-12 hour 4: 152076 events in 0 files, snapshot none (task 7560 ms: download 4800 ms overlapping gunzip 1164 ms, parse 4653 ms, sort 0 ms, write 0 ms, index 769 ms: 6 candidates, 67849 repo-hours, 701 releases; waiting 608 ms; commit 0 ms)
2026-11-08T13:21:20Z [load_day 2025-08-12] 2025-08-12 hour 5: 156480 events in 0 files, snapshot none (task 7931 ms: download 4182 ms overlapping gunzip 1264 ms, parse 4898 ms, sort 0 ms, write 0 ms, index 596 ms: 7 candidates, 69503 repo-hours, 594 releases; waiting 536 ms; commit 0 ms)
2026-11-08T13:21:28Z [load_day 2025-08-12] 2025-08-12 hour 6: 156644 events in 0 files, snapshot none (task 7945 ms: download 4540 ms overlapping gunzip 1295 ms, parse 5150 ms, sort 0 ms, write 0 ms, index 749 ms: 7 candidates, 80283 repo-hours, 719 releases; waiting 518 ms; commit 0 ms)
2026-11-08T13:21:29Z [load_day 2025-08-12] 2025-08-12 hour 7: 162181 events in 0 files, snapshot none (task 8678 ms: download 4949 ms overlapping gunzip 1458 ms, parse 5605 ms, sort 0 ms, write 0 ms, index 732 ms: 4 candidates, 76858 repo-hours, 703 releases; waiting 493 ms; commit 0 ms)
2026-11-08T13:21:35Z [load_day 2025-08-12] 2025-08-12 hour 8: 165937 events in 0 files, snapshot none (task 7116 ms: download 4592 ms overlapping gunzip 1179 ms, parse 4547 ms, sort 0 ms, write 0 ms, index 570 ms: 5 candidates, 81309 repo-hours, 799 releases; waiting 527 ms; commit 0 ms)
2026-11-08T13:21:36Z [load_day 2025-08-12] 2025-08-12 hour 9: 165757 events in 0 files, snapshot none (task 6816 ms: download 4361 ms overlapping gunzip 1126 ms, parse 4283 ms, sort 0 ms, write 0 ms, index 623 ms: 8 candidates, 82347 repo-hours, 976 releases; waiting 453 ms; commit 0 ms)
2026-11-08T13:21:42Z [load_day 2025-08-12] 2025-08-12 hour 10: 163089 events in 0 files, snapshot none (task 6443 ms: download 4307 ms overlapping gunzip 952 ms, parse 3751 ms, sort 0 ms, write 0 ms, index 584 ms: 4 candidates, 80776 repo-hours, 877 releases; waiting 856 ms; commit 0 ms)
2026-11-08T13:21:43Z [load_day 2025-08-12] 2025-08-12 hour 11: 163822 events in 0 files, snapshot none (task 6079 ms: download 3560 ms overlapping gunzip 984 ms, parse 3830 ms, sort 0 ms, write 0 ms, index 612 ms: 5 candidates, 78266 repo-hours, 791 releases; waiting 180 ms; commit 0 ms)
2026-11-08T13:21:51Z [load_day 2025-08-12] 2025-08-12 hour 12: 168943 events in 0 files, snapshot none (task 8488 ms: download 5570 ms overlapping gunzip 1243 ms, parse 5058 ms, sort 0 ms, write 0 ms, index 791 ms: 7 candidates, 97947 repo-hours, 853 releases; waiting 1024 ms; commit 0 ms)
2026-11-08T13:21:52Z [load_day 2025-08-12] 2025-08-12 hour 13: 168972 events in 0 files, snapshot none (task 8260 ms: download 5455 ms overlapping gunzip 1340 ms, parse 5236 ms, sort 0 ms, write 0 ms, index 727 ms: 5 candidates, 94473 repo-hours, 792 releases; waiting 579 ms; commit 0 ms)
2026-11-08T13:22:01Z [load_day 2025-08-12] 2025-08-12 hour 14: 164003 events in 0 files, snapshot none (task 9015 ms: download 6156 ms overlapping gunzip 1442 ms, parse 6116 ms, sort 0 ms, write 0 ms, index 620 ms: 10 candidates, 84329 repo-hours, 888 releases; waiting 534 ms; commit 0 ms)
2026-11-08T13:22:01Z [load_day 2025-08-12] 2025-08-12 hour 15: 168789 events in 0 files, snapshot none (task 9296 ms: download 6826 ms overlapping gunzip 1632 ms, parse 6251 ms, sort 0 ms, write 0 ms, index 618 ms: 5 candidates, 85719 repo-hours, 907 releases; waiting 497 ms; commit 0 ms)
2026-11-08T13:22:12Z [load_day 2025-08-12] 2025-08-12 hour 16: 162611 events in 0 files, snapshot none (task 7411 ms: download 4302 ms overlapping gunzip 1092 ms, parse 4380 ms, sort 0 ms, write 0 ms, index 1056 ms: 7 candidates, 82987 repo-hours, 829 releases; waiting 540 ms; commit 0 ms)
2026-11-08T13:22:13Z [load_day 2025-08-12] 2025-08-12 hour 17: 161868 events in 0 files, snapshot none (task 7994 ms: download 4861 ms overlapping gunzip 1362 ms, parse 5185 ms, sort 0 ms, write 0 ms, index 885 ms: 6 candidates, 78371 repo-hours, 799 releases; waiting 211 ms; commit 0 ms)
2026-11-08T13:22:21Z [load_day 2025-08-12] 2025-08-12 hour 18: 161547 events in 0 files, snapshot none (task 8858 ms: download 5767 ms overlapping gunzip 1495 ms, parse 5649 ms, sort 0 ms, write 0 ms, index 942 ms: 6 candidates, 83788 repo-hours, 822 releases; waiting 370 ms; commit 0 ms)
2026-11-08T13:22:22Z [load_day 2025-08-12] 2025-08-12 hour 19: 161703 events in 0 files, snapshot none (task 8183 ms: download 5763 ms overlapping gunzip 1396 ms, parse 5668 ms, sort 0 ms, write 0 ms, index 575 ms: 15 candidates, 72891 repo-hours, 784 releases; waiting 240 ms; commit 0 ms)
2026-11-08T13:22:29Z [load_day 2025-08-12] 2025-08-12 hour 20: 157887 events in 0 files, snapshot none (task 7719 ms: download 5216 ms overlapping gunzip 1308 ms, parse 4946 ms, sort 0 ms, write 0 ms, index 587 ms: 11 candidates, 70782 repo-hours, 792 releases; waiting 550 ms; commit 0 ms)
2026-11-08T13:22:29Z [load_day 2025-08-12] 2025-08-12 hour 21: 151076 events in 0 files, snapshot none (task 7161 ms: download 4898 ms overlapping gunzip 1123 ms, parse 4665 ms, sort 0 ms, write 0 ms, index 524 ms: 8 candidates, 66756 repo-hours, 906 releases; waiting 511 ms; commit 0 ms)
2026-11-08T13:22:38Z [load_day 2025-08-12] 2025-08-12 hour 22: 148687 events in 0 files, snapshot none (task 8185 ms: download 5643 ms overlapping gunzip 1354 ms, parse 5438 ms, sort 0 ms, write 0 ms, index 466 ms: 5 candidates, 62655 repo-hours, 1021 releases; waiting 556 ms; commit 0 ms)
2026-11-08T13:22:38Z [load_day 2025-08-12] 2025-08-12 hour 23: 147196 events in 0 files, snapshot none (task 7631 ms: download 5067 ms overlapping gunzip 1283 ms, parse 4998 ms, sort 0 ms, write 0 ms, index 497 ms: 11 candidates, 60933 repo-hours, 895 releases; waiting 506 ms; commit 0 ms)
2026-11-08T13:22:47Z [load_day 2025-08-12] 2025-08-12: repo_hour merged from 24 files to 1 (1867619 rows, 8575 ms)
2026-11-08T13:22:49Z [load_day 2025-08-12] 2025-08-12: index committed in 11034 ms (24 + 1 + 24 files)
2026-11-08T13:22:49Z [load_day 2025-08-12] 2025-08-12: 3823379 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:22:49Z [load_day 2025-08-12] attempt 1 succeeded