orcaLog in

Runs · run 3349

load_day 2024-12-22, attempt 1 succeeded

Host
73ccef5e07c2:226551
Started
2026-11-08T09:29:53Z
Ended
2026-11-08T09:31:17Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
655 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
115.4 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3349/load_day/2024-12-22/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:29:53Z [load_day 2024-12-22] attempt 1 started
2026-11-08T09:29:54Z [load_day 2024-12-22] 2024-12-22: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:30:01Z [load_day 2024-12-22] 2024-12-22 hour 0: 145790 events in 0 files, snapshot none (task 6224 ms: download 2394 ms overlapping gunzip 685 ms, parse 3031 ms, sort 0 ms, write 0 ms, index 1681 ms: 7 candidates, 69329 repo-hours, 1203 releases; waiting 345 ms; commit 0 ms)
2026-11-08T09:30:01Z [load_day 2024-12-22] 2024-12-22 hour 1: 170951 events in 0 files, snapshot none (task 5499 ms: download 2653 ms overlapping gunzip 745 ms, parse 3300 ms, sort 0 ms, write 0 ms, index 637 ms: 8 candidates, 95575 repo-hours, 832 releases; waiting 485 ms; commit 0 ms)
2026-11-08T09:30:05Z [load_day 2024-12-22] 2024-12-22 hour 2: 126201 events in 0 files, snapshot none (task 3590 ms: download 2006 ms overlapping gunzip 448 ms, parse 1932 ms, sort 0 ms, write 0 ms, index 374 ms: 3 candidates, 55012 repo-hours, 670 releases; waiting 508 ms; commit 0 ms)
2026-11-08T09:30:06Z [load_day 2024-12-22] 2024-12-22 hour 3: 148655 events in 0 files, snapshot none (task 4776 ms: download 2911 ms overlapping gunzip 518 ms, parse 2280 ms, sort 0 ms, write 0 ms, index 412 ms: 6 candidates, 56299 repo-hours, 3871 releases; waiting 1223 ms; commit 0 ms)
2026-11-08T09:30:09Z [load_day 2024-12-22] 2024-12-22 hour 4: 132008 events in 0 files, snapshot none (task 3693 ms: download 2201 ms overlapping gunzip 456 ms, parse 2011 ms, sort 0 ms, write 0 ms, index 391 ms: 5 candidates, 46756 repo-hours, 564 releases; waiting 528 ms; commit 0 ms)
2026-11-08T09:30:10Z [load_day 2024-12-22] 2024-12-22 hour 5: 138620 events in 0 files, snapshot none (task 3694 ms: download 1976 ms overlapping gunzip 463 ms, parse 1966 ms, sort 0 ms, write 0 ms, index 482 ms: 4 candidates, 49283 repo-hours, 672 releases; waiting 500 ms; commit 0 ms)
2026-11-08T09:30:15Z [load_day 2024-12-22] 2024-12-22 hour 6: 160034 events in 0 files, snapshot none (task 5605 ms: download 2387 ms overlapping gunzip 792 ms, parse 3406 ms, sort 0 ms, write 0 ms, index 627 ms: 3 candidates, 69788 repo-hours, 743 releases; waiting 459 ms; commit 0 ms)
2026-11-08T09:30:16Z [load_day 2024-12-22] 2024-12-22 hour 7: 148164 events in 0 files, snapshot none (task 4982 ms: download 2709 ms overlapping gunzip 696 ms, parse 3019 ms, sort 0 ms, write 0 ms, index 393 ms: 0 candidates, 53618 repo-hours, 538 releases; waiting 490 ms; commit 0 ms)
2026-11-08T09:30:21Z [load_day 2024-12-22] 2024-12-22 hour 8: 157839 events in 0 files, snapshot none (task 5418 ms: download 2689 ms overlapping gunzip 778 ms, parse 3378 ms, sort 0 ms, write 0 ms, index 520 ms: 2 candidates, 59369 repo-hours, 718 releases; waiting 509 ms; commit 0 ms)
2026-11-08T09:30:22Z [load_day 2024-12-22] 2024-12-22 hour 9: 166531 events in 0 files, snapshot none (task 5750 ms: download 2731 ms overlapping gunzip 812 ms, parse 3549 ms, sort 0 ms, write 0 ms, index 557 ms: 2 candidates, 65871 repo-hours, 842 releases; waiting 502 ms; commit 0 ms)
2026-11-08T09:30:26Z [load_day 2024-12-22] 2024-12-22 hour 10: 166665 events in 0 files, snapshot none (task 5034 ms: download 2450 ms overlapping gunzip 649 ms, parse 2762 ms, sort 0 ms, write 0 ms, index 802 ms: 5 candidates, 63481 repo-hours, 717 releases; waiting 499 ms; commit 0 ms)
2026-11-08T09:30:27Z [load_day 2024-12-22] 2024-12-22 hour 11: 168409 events in 0 files, snapshot none (task 4898 ms: download 2155 ms overlapping gunzip 650 ms, parse 2776 ms, sort 0 ms, write 0 ms, index 671 ms: 3 candidates, 60915 repo-hours, 861 releases; waiting 500 ms; commit 0 ms)
2026-11-08T09:30:35Z [load_day 2024-12-22] 2024-12-22 hour 12: 231304 events in 0 files, snapshot none (task 5733 ms: download 3019 ms overlapping gunzip 776 ms, parse 3560 ms, sort 0 ms, write 0 ms, index 849 ms: 10 candidates, 113649 repo-hours, 962 releases; waiting 278 ms; commit 0 ms)
2026-11-08T09:30:35Z [load_day 2024-12-22] 2024-12-22 hour 13: 199511 events in 0 files, snapshot none (task 5985 ms: download 3036 ms overlapping gunzip 799 ms, parse 3406 ms, sort 0 ms, write 0 ms, index 906 ms: 11 candidates, 91780 repo-hours, 780 releases; waiting 540 ms; commit 0 ms)
2026-11-08T09:30:41Z [load_day 2024-12-22] 2024-12-22 hour 14: 188805 events in 0 files, snapshot none (task 5627 ms: download 3056 ms overlapping gunzip 782 ms, parse 3412 ms, sort 0 ms, write 0 ms, index 668 ms: 2 candidates, 75270 repo-hours, 904 releases; waiting 477 ms; commit 0 ms)
2026-11-08T09:30:42Z [load_day 2024-12-22] 2024-12-22 hour 15: 201442 events in 0 files, snapshot none (task 6132 ms: download 3419 ms overlapping gunzip 963 ms, parse 4013 ms, sort 0 ms, write 0 ms, index 609 ms: 7 candidates, 83709 repo-hours, 1131 releases; waiting 218 ms; commit 0 ms)
2026-11-08T09:30:48Z [load_day 2024-12-22] 2024-12-22 hour 16: 189861 events in 0 files, snapshot none (task 6753 ms: download 3365 ms overlapping gunzip 1004 ms, parse 4087 ms, sort 0 ms, write 0 ms, index 845 ms: 5 candidates, 74013 repo-hours, 1068 releases; waiting 450 ms; commit 0 ms)
2026-11-08T09:30:49Z [load_day 2024-12-22] 2024-12-22 hour 17: 179031 events in 0 files, snapshot none (task 6381 ms: download 3672 ms overlapping gunzip 956 ms, parse 4242 ms, sort 0 ms, write 0 ms, index 502 ms: 7 candidates, 66842 repo-hours, 780 releases; waiting 388 ms; commit 0 ms)
2026-11-08T09:30:55Z [load_day 2024-12-22] 2024-12-22 hour 18: 191963 events in 0 files, snapshot none (task 6682 ms: download 2880 ms overlapping gunzip 909 ms, parse 4101 ms, sort 0 ms, write 0 ms, index 852 ms: 14 candidates, 83070 repo-hours, 957 releases; waiting 516 ms; commit 0 ms)
2026-11-08T09:30:55Z [load_day 2024-12-22] 2024-12-22 hour 19: 169679 events in 0 files, snapshot none (task 6125 ms: download 3036 ms overlapping gunzip 888 ms, parse 3953 ms, sort 0 ms, write 0 ms, index 518 ms: 5 candidates, 58957 repo-hours, 800 releases; waiting 450 ms; commit 0 ms)
2026-11-08T09:31:01Z [load_day 2024-12-22] 2024-12-22 hour 20: 166929 events in 0 files, snapshot none (task 5575 ms: download 2785 ms overlapping gunzip 734 ms, parse 3211 ms, sort 0 ms, write 0 ms, index 812 ms: 9 candidates, 60125 repo-hours, 882 releases; waiting 501 ms; commit 0 ms)
2026-11-08T09:31:01Z [load_day 2024-12-22] 2024-12-22 hour 21: 162748 events in 0 files, snapshot none (task 5215 ms: download 2375 ms overlapping gunzip 670 ms, parse 3039 ms, sort 0 ms, write 0 ms, index 647 ms: 8 candidates, 60799 repo-hours, 976 releases; waiting 527 ms; commit 0 ms)
2026-11-08T09:31:07Z [load_day 2024-12-22] 2024-12-22 hour 22: 147061 events in 0 files, snapshot none (task 4956 ms: download 2360 ms overlapping gunzip 716 ms, parse 3244 ms, sort 0 ms, write 0 ms, index 470 ms: 10 candidates, 51232 repo-hours, 990 releases; waiting 203 ms; commit 0 ms)
2026-11-08T09:31:07Z [load_day 2024-12-22] 2024-12-22 hour 23: 141191 events in 0 files, snapshot none (task 5096 ms: download 2416 ms overlapping gunzip 733 ms, parse 3085 ms, sort 0 ms, write 0 ms, index 436 ms: 8 candidates, 49145 repo-hours, 775 releases; waiting 516 ms; commit 0 ms)
2026-11-08T09:31:14Z [load_day 2024-12-22] 2024-12-22: repo_hour merged from 24 files to 1 (1613887 rows, 7105 ms)
2026-11-08T09:31:17Z [load_day 2024-12-22] 2024-12-22: index committed in 9900 ms (23 + 1 + 24 files)
2026-11-08T09:31:17Z [load_day 2024-12-22] 2024-12-22: 3999392 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:31:17Z [load_day 2024-12-22] attempt 1 succeeded