orcaLog in

Runs · run 4967

load_day 2026-02-23, attempt 1 succeeded

Host
73ccef5e07c2:447083
Started
2026-11-08T15:24:08Z
Ended
2026-11-08T15:25:13Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
721 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
76.3 s, up to 2.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4967/load_day/2026-02-23/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:24:08Z [load_day 2026-02-23] attempt 1 started
2026-11-08T15:24:09Z [load_day 2026-02-23] 2026-02-23: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:24:13Z [load_day 2026-02-23] 2026-02-23 hour 0: 146558 events in 0 files, snapshot none (task 3879 ms: download 2891 ms overlapping gunzip 549 ms, parse 1771 ms, sort 0 ms, write 0 ms, index 524 ms: 7 candidates, 67419 repo-hours, 1366 releases; waiting 792 ms; commit 0 ms)
2026-11-08T15:24:13Z [load_day 2026-02-23] 2026-02-23 hour 1: 152884 events in 0 files, snapshot none (task 3495 ms: download 2179 ms overlapping gunzip 548 ms, parse 1564 ms, sort 0 ms, write 0 ms, index 614 ms: 7 candidates, 86230 repo-hours, 879 releases; waiting 553 ms; commit 0 ms)
2026-11-08T15:24:17Z [load_day 2026-02-23] 2026-02-23 hour 2: 150929 events in 0 files, snapshot none (task 3559 ms: download 2255 ms overlapping gunzip 432 ms, parse 1417 ms, sort 0 ms, write 0 ms, index 667 ms: 8 candidates, 81971 repo-hours, 924 releases; waiting 751 ms; commit 0 ms)
2026-11-08T15:24:18Z [load_day 2026-02-23] 2026-02-23 hour 3: 147530 events in 0 files, snapshot none (task 4054 ms: download 2920 ms overlapping gunzip 527 ms, parse 1509 ms, sort 0 ms, write 0 ms, index 561 ms: 6 candidates, 68161 repo-hours, 982 releases; waiting 1131 ms; commit 0 ms)
2026-11-08T15:24:21Z [load_day 2026-02-23] 2026-02-23 hour 4: 145691 events in 0 files, snapshot none (task 3368 ms: download 2297 ms overlapping gunzip 431 ms, parse 1264 ms, sort 0 ms, write 0 ms, index 577 ms: 9 candidates, 72822 repo-hours, 974 releases; waiting 798 ms; commit 0 ms)
2026-11-08T15:24:22Z [load_day 2026-02-23] 2026-02-23 hour 5: 151596 events in 0 files, snapshot none (task 4029 ms: download 2753 ms overlapping gunzip 450 ms, parse 1348 ms, sort 0 ms, write 0 ms, index 664 ms: 7 candidates, 75974 repo-hours, 1795 releases; waiting 1090 ms; commit 0 ms)
2026-11-08T15:24:25Z [load_day 2026-02-23] 2026-02-23 hour 6: 152039 events in 0 files, snapshot none (task 3904 ms: download 2267 ms overlapping gunzip 458 ms, parse 1331 ms, sort 0 ms, write 0 ms, index 722 ms: 6 candidates, 78128 repo-hours, 973 releases; waiting 826 ms; commit 0 ms)
2026-11-08T15:24:26Z [load_day 2026-02-23] 2026-02-23 hour 7: 149906 events in 0 files, snapshot none (task 3752 ms: download 2426 ms overlapping gunzip 435 ms, parse 1335 ms, sort 0 ms, write 0 ms, index 590 ms: 4 candidates, 77656 repo-hours, 882 releases; waiting 1095 ms; commit 0 ms)
2026-11-08T15:24:31Z [load_day 2026-02-23] 2026-02-23 hour 8: 149643 events in 0 files, snapshot none (task 4505 ms: download 2544 ms overlapping gunzip 619 ms, parse 1827 ms, sort 0 ms, write 0 ms, index 859 ms: 6 candidates, 80842 repo-hours, 842 releases; waiting 887 ms; commit 0 ms)
2026-11-08T15:24:31Z [load_day 2026-02-23] 2026-02-23 hour 9: 147732 events in 0 files, snapshot none (task 3814 ms: download 2227 ms overlapping gunzip 539 ms, parse 1725 ms, sort 0 ms, write 0 ms, index 785 ms: 5 candidates, 82885 repo-hours, 687 releases; waiting 286 ms; commit 0 ms)
2026-11-08T15:24:35Z [load_day 2026-02-23] 2026-02-23 hour 10: 149171 events in 0 files, snapshot none (task 4196 ms: download 2271 ms overlapping gunzip 602 ms, parse 1872 ms, sort 0 ms, write 0 ms, index 629 ms: 5 candidates, 83216 repo-hours, 689 releases; waiting 588 ms; commit 0 ms)
2026-11-08T15:24:35Z [load_day 2026-02-23] 2026-02-23 hour 11: 148232 events in 0 files, snapshot none (task 3777 ms: download 1944 ms overlapping gunzip 584 ms, parse 1670 ms, sort 0 ms, write 0 ms, index 803 ms: 3 candidates, 82359 repo-hours, 684 releases; waiting 464 ms; commit 0 ms)
2026-11-08T15:24:40Z [load_day 2026-02-23] 2026-02-23 hour 12: 153284 events in 0 files, snapshot none (task 3956 ms: download 2434 ms overlapping gunzip 482 ms, parse 1517 ms, sort 0 ms, write 0 ms, index 871 ms: 10 candidates, 92544 repo-hours, 457 releases; waiting 729 ms; commit 0 ms)
2026-11-08T15:24:40Z [load_day 2026-02-23] 2026-02-23 hour 13: 156619 events in 0 files, snapshot none (task 3747 ms: download 2075 ms overlapping gunzip 452 ms, parse 1359 ms, sort 0 ms, write 0 ms, index 950 ms: 12 candidates, 95478 repo-hours, 369 releases; waiting 613 ms; commit 0 ms)
2026-11-08T15:24:43Z [load_day 2026-02-23] 2026-02-23 hour 14: 152386 events in 0 files, snapshot none (task 2868 ms: download 1234 ms overlapping gunzip 281 ms, parse 900 ms, sort 0 ms, write 0 ms, index 1125 ms: 6 candidates, 89532 repo-hours, 388 releases; waiting 314 ms; commit 0 ms)
2026-11-08T15:24:43Z [load_day 2026-02-23] 2026-02-23 hour 15: 149365 events in 0 files, snapshot none (task 3061 ms: download 1693 ms overlapping gunzip 374 ms, parse 1246 ms, sort 0 ms, write 0 ms, index 773 ms: 2 candidates, 88274 repo-hours, 358 releases; waiting 350 ms; commit 0 ms)
2026-11-08T15:24:46Z [load_day 2026-02-23] 2026-02-23 hour 16: 147313 events in 0 files, snapshot none (task 2575 ms: download 1290 ms overlapping gunzip 294 ms, parse 910 ms, sort 0 ms, write 0 ms, index 752 ms: 7 candidates, 86254 repo-hours, 408 releases; waiting 313 ms; commit 0 ms)
2026-11-08T15:24:47Z [load_day 2026-02-23] 2026-02-23 hour 17: 153193 events in 0 files, snapshot none (task 3053 ms: download 1818 ms overlapping gunzip 346 ms, parse 1106 ms, sort 0 ms, write 0 ms, index 708 ms: 7 candidates, 88162 repo-hours, 461 releases; waiting 588 ms; commit 0 ms)
2026-11-08T15:24:50Z [load_day 2026-02-23] 2026-02-23 hour 18: 149513 events in 0 files, snapshot none (task 3013 ms: download 1873 ms overlapping gunzip 341 ms, parse 1063 ms, sort 0 ms, write 0 ms, index 655 ms: 5 candidates, 82748 repo-hours, 575 releases; waiting 650 ms; commit 0 ms)
2026-11-08T15:24:52Z [load_day 2026-02-23] 2026-02-23 hour 19: 153539 events in 0 files, snapshot none (task 4357 ms: download 2887 ms overlapping gunzip 403 ms, parse 1162 ms, sort 0 ms, write 0 ms, index 818 ms: 15 candidates, 83826 repo-hours, 634 releases; waiting 1621 ms; commit 0 ms)
2026-11-08T15:24:53Z [load_day 2026-02-23] 2026-02-23 hour 20: 152975 events in 0 files, snapshot none (task 3351 ms: download 2279 ms overlapping gunzip 478 ms, parse 1501 ms, sort 0 ms, write 0 ms, index 609 ms: 9 candidates, 82854 repo-hours, 744 releases; waiting 453 ms; commit 0 ms)
2026-11-08T15:24:56Z [load_day 2026-02-23] 2026-02-23 hour 21: 149636 events in 0 files, snapshot none (task 3906 ms: download 2575 ms overlapping gunzip 489 ms, parse 1467 ms, sort 0 ms, write 0 ms, index 794 ms: 13 candidates, 78931 repo-hours, 784 releases; waiting 835 ms; commit 0 ms)
2026-11-08T15:24:57Z [load_day 2026-02-23] 2026-02-23 hour 22: 148632 events in 0 files, snapshot none (task 3342 ms: download 1862 ms overlapping gunzip 538 ms, parse 1480 ms, sort 0 ms, write 0 ms, index 616 ms: 9 candidates, 78165 repo-hours, 857 releases; waiting 427 ms; commit 0 ms)
2026-11-08T15:25:01Z [load_day 2026-02-23] 2026-02-23 hour 23: 145690 events in 0 files, snapshot none (task 3564 ms: download 2415 ms overlapping gunzip 456 ms, parse 1360 ms, sort 0 ms, write 0 ms, index 612 ms: 3 candidates, 73026 repo-hours, 1001 releases; waiting 917 ms; commit 0 ms)
2026-11-08T15:25:09Z [load_day 2026-02-23] 2026-02-23: repo_hour merged from 24 files to 1 (1957457 rows, 8758 ms)
2026-11-08T15:25:13Z [load_day 2026-02-23] 2026-02-23: index committed in 12136 ms (24 + 1 + 24 files)
2026-11-08T15:25:13Z [load_day 2026-02-23] 2026-02-23: 3604056 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:25:13Z [load_day 2026-02-23] attempt 1 succeeded