orcaLog in

Runs · run 5007

load_day 2026-03-06, attempt 1 succeeded

Host
73ccef5e07c2:451690
Started
2026-11-08T15:30:03Z
Ended
2026-11-08T15:31:12Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
734 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
73.5 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/5007/load_day/2026-03-06/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:30:03Z [load_day 2026-03-06] attempt 1 started
2026-11-08T15:30:04Z [load_day 2026-03-06] 2026-03-06: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:30:08Z [load_day 2026-03-06] 2026-03-06 hour 0: 151885 events in 0 files, snapshot none (task 3217 ms: download 1903 ms overlapping gunzip 442 ms, parse 1377 ms, sort 0 ms, write 0 ms, index 641 ms: 10 candidates, 73439 repo-hours, 1058 releases; waiting 385 ms; commit 0 ms)
2026-11-08T15:30:08Z [load_day 2026-03-06] 2026-03-06 hour 1: 151135 events in 0 files, snapshot none (task 3748 ms: download 2292 ms overlapping gunzip 363 ms, parse 1068 ms, sort 0 ms, write 0 ms, index 813 ms: 5 candidates, 94086 repo-hours, 505 releases; waiting 1085 ms; commit 0 ms)
2026-11-08T15:30:11Z [load_day 2026-03-06] 2026-03-06 hour 2: 155764 events in 0 files, snapshot none (task 3040 ms: download 1869 ms overlapping gunzip 381 ms, parse 1163 ms, sort 0 ms, write 0 ms, index 667 ms: 11 candidates, 90072 repo-hours, 612 releases; waiting 527 ms; commit 0 ms)
2026-11-08T15:30:14Z [load_day 2026-03-06] 2026-03-06 hour 3: 149604 events in 0 files, snapshot none (task 4843 ms: download 3238 ms overlapping gunzip 493 ms, parse 1487 ms, sort 0 ms, write 0 ms, index 703 ms: 15 candidates, 75098 repo-hours, 869 releases; waiting 1815 ms; commit 0 ms)
2026-11-08T15:30:16Z [load_day 2026-03-06] 2026-03-06 hour 4: 149570 events in 0 files, snapshot none (task 4156 ms: download 2246 ms overlapping gunzip 500 ms, parse 1498 ms, sort 0 ms, write 0 ms, index 1032 ms: 9 candidates, 75315 repo-hours, 965 releases; waiting 740 ms; commit 0 ms)
2026-11-08T15:30:18Z [load_day 2026-03-06] 2026-03-06 hour 5: 151453 events in 0 files, snapshot none (task 3632 ms: download 2356 ms overlapping gunzip 502 ms, parse 1601 ms, sort 0 ms, write 0 ms, index 735 ms: 8 candidates, 80281 repo-hours, 735 releases; waiting 445 ms; commit 0 ms)
2026-11-08T15:30:21Z [load_day 2026-03-06] 2026-03-06 hour 6: 153568 events in 0 files, snapshot none (task 3792 ms: download 2461 ms overlapping gunzip 510 ms, parse 1451 ms, sort 0 ms, write 0 ms, index 794 ms: 8 candidates, 85661 repo-hours, 646 releases; waiting 741 ms; commit 0 ms)
2026-11-08T15:30:23Z [load_day 2026-03-06] 2026-03-06 hour 7: 153357 events in 0 files, snapshot none (task 4337 ms: download 2675 ms overlapping gunzip 549 ms, parse 1723 ms, sort 0 ms, write 0 ms, index 788 ms: 6 candidates, 83943 repo-hours, 614 releases; waiting 868 ms; commit 0 ms)
2026-11-08T15:30:27Z [load_day 2026-03-06] 2026-03-06 hour 8: 152808 events in 0 files, snapshot none (task 5626 ms: download 3121 ms overlapping gunzip 725 ms, parse 1962 ms, sort 0 ms, write 0 ms, index 839 ms: 4 candidates, 86486 repo-hours, 673 releases; waiting 1762 ms; commit 0 ms)
2026-11-08T15:30:27Z [load_day 2026-03-06] 2026-03-06 hour 9: 151782 events in 0 files, snapshot none (task 4000 ms: download 2202 ms overlapping gunzip 559 ms, parse 1836 ms, sort 0 ms, write 0 ms, index 714 ms: 4 candidates, 85399 repo-hours, 611 releases; waiting 548 ms; commit 0 ms)
2026-11-08T15:30:32Z [load_day 2026-03-06] 2026-03-06 hour 10: 156805 events in 0 files, snapshot none (task 4282 ms: download 2318 ms overlapping gunzip 644 ms, parse 1909 ms, sort 0 ms, write 0 ms, index 977 ms: 5 candidates, 89493 repo-hours, 521 releases; waiting 444 ms; commit 0 ms)
2026-11-08T15:30:32Z [load_day 2026-03-06] 2026-03-06 hour 11: 153110 events in 0 files, snapshot none (task 4261 ms: download 2403 ms overlapping gunzip 602 ms, parse 1852 ms, sort 0 ms, write 0 ms, index 870 ms: 9 candidates, 84597 repo-hours, 569 releases; waiting 548 ms; commit 0 ms)
2026-11-08T15:30:37Z [load_day 2026-03-06] 2026-03-06 hour 12: 162375 events in 0 files, snapshot none (task 4512 ms: download 2112 ms overlapping gunzip 482 ms, parse 1530 ms, sort 0 ms, write 0 ms, index 1591 ms: 6 candidates, 99952 repo-hours, 317 releases; waiting 585 ms; commit 0 ms)
2026-11-08T15:30:37Z [load_day 2026-03-06] 2026-03-06 hour 13: 163082 events in 0 files, snapshot none (task 4509 ms: download 2179 ms overlapping gunzip 449 ms, parse 1352 ms, sort 0 ms, write 0 ms, index 1727 ms: 7 candidates, 100869 repo-hours, 229 releases; waiting 642 ms; commit 0 ms)
2026-11-08T15:30:43Z [load_day 2026-03-06] 2026-03-06 hour 14: 155611 events in 0 files, snapshot none (task 3013 ms: download 1769 ms overlapping gunzip 319 ms, parse 974 ms, sort 0 ms, write 0 ms, index 684 ms: 8 candidates, 88972 repo-hours, 365 releases; waiting 655 ms; commit 0 ms)
2026-11-08T15:30:43Z [load_day 2026-03-06] 2026-03-06 hour 15: 160729 events in 0 files, snapshot none (task 2824 ms: download 1699 ms overlapping gunzip 304 ms, parse 922 ms, sort 0 ms, write 0 ms, index 742 ms: 9 candidates, 92229 repo-hours, 279 releases; waiting 593 ms; commit 0 ms)
2026-11-08T15:30:47Z [load_day 2026-03-06] 2026-03-06 hour 16: 160796 events in 0 files, snapshot none (task 3247 ms: download 2003 ms overlapping gunzip 326 ms, parse 1074 ms, sort 0 ms, write 0 ms, index 698 ms: 8 candidates, 90434 repo-hours, 321 releases; waiting 800 ms; commit 0 ms)
2026-11-08T15:30:47Z [load_day 2026-03-06] 2026-03-06 hour 17: 156406 events in 0 files, snapshot none (task 3212 ms: download 1562 ms overlapping gunzip 370 ms, parse 1140 ms, sort 0 ms, write 0 ms, index 847 ms: 8 candidates, 87851 repo-hours, 374 releases; waiting 475 ms; commit 0 ms)
2026-11-08T15:30:51Z [load_day 2026-03-06] 2026-03-06 hour 18: 153203 events in 0 files, snapshot none (task 3017 ms: download 1923 ms overlapping gunzip 353 ms, parse 1094 ms, sort 0 ms, write 0 ms, index 656 ms: 9 candidates, 87202 repo-hours, 464 releases; waiting 616 ms; commit 0 ms)
2026-11-08T15:30:51Z [load_day 2026-03-06] 2026-03-06 hour 19: 153310 events in 0 files, snapshot none (task 2891 ms: download 1782 ms overlapping gunzip 357 ms, parse 1104 ms, sort 0 ms, write 0 ms, index 679 ms: 14 candidates, 81174 repo-hours, 566 releases; waiting 531 ms; commit 0 ms)
2026-11-08T15:30:54Z [load_day 2026-03-06] 2026-03-06 hour 20: 154331 events in 0 files, snapshot none (task 3212 ms: download 1897 ms overlapping gunzip 416 ms, parse 1263 ms, sort 0 ms, write 0 ms, index 606 ms: 15 candidates, 80309 repo-hours, 636 releases; waiting 605 ms; commit 0 ms)
2026-11-08T15:30:54Z [load_day 2026-03-06] 2026-03-06 hour 21: 156055 events in 0 files, snapshot none (task 2731 ms: download 1511 ms overlapping gunzip 392 ms, parse 1097 ms, sort 0 ms, write 0 ms, index 648 ms: 13 candidates, 78416 repo-hours, 643 releases; waiting 220 ms; commit 0 ms)
2026-11-08T15:31:00Z [load_day 2026-03-06] 2026-03-06 hour 22: 152813 events in 0 files, snapshot none (task 4868 ms: download 3312 ms overlapping gunzip 574 ms, parse 1813 ms, sort 0 ms, write 0 ms, index 566 ms: 4 candidates, 75990 repo-hours, 886 releases; waiting 1331 ms; commit 0 ms)
2026-11-08T15:31:00Z [load_day 2026-03-06] 2026-03-06 hour 23: 153179 events in 0 files, snapshot none (task 3699 ms: download 1860 ms overlapping gunzip 615 ms, parse 1884 ms, sort 0 ms, write 0 ms, index 628 ms: 10 candidates, 74354 repo-hours, 1131 releases; waiting 301 ms; commit 0 ms)
2026-11-08T15:31:09Z [load_day 2026-03-06] 2026-03-06: repo_hour merged from 24 files to 1 (2041622 rows, 8978 ms)
2026-11-08T15:31:12Z [load_day 2026-03-06] 2026-03-06: index committed in 12205 ms (24 + 1 + 24 files)
2026-11-08T15:31:12Z [load_day 2026-03-06] 2026-03-06: 3712731 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:31:12Z [load_day 2026-03-06] attempt 1 succeeded