orcaLog in

Runs · run 2992

load_day 2024-09-22, attempt 1 succeeded

Host
73ccef5e07c2:181448
Started
2026-11-08T08:02:37Z
Ended
2026-11-08T08:03:58Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
647 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
111.5 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2992/load_day/2024-09-22/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:02:37Z [load_day 2024-09-22] attempt 1 started
2026-11-08T08:02:38Z [load_day 2024-09-22] 2024-09-22: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:02:43Z [load_day 2024-09-22] 2024-09-22 hour 0: 142397 events in 0 files, snapshot none (task 4895 ms: download 1955 ms overlapping gunzip 650 ms, parse 2938 ms, sort 0 ms, write 0 ms, index 529 ms: 2 candidates, 66813 repo-hours, 1065 releases; waiting 518 ms; commit 0 ms)
2026-11-08T08:02:43Z [load_day 2024-09-22] 2024-09-22 hour 1: 162646 events in 0 files, snapshot none (task 4611 ms: download 1840 ms overlapping gunzip 563 ms, parse 2553 ms, sort 0 ms, write 0 ms, index 807 ms: 6 candidates, 90404 repo-hours, 730 releases; waiting 358 ms; commit 0 ms)
2026-11-08T08:02:47Z [load_day 2024-09-22] 2024-09-22 hour 2: 127858 events in 0 files, snapshot none (task 3721 ms: download 2203 ms overlapping gunzip 472 ms, parse 1984 ms, sort 0 ms, write 0 ms, index 389 ms: 4 candidates, 56954 repo-hours, 670 releases; waiting 516 ms; commit 0 ms)
2026-11-08T08:02:48Z [load_day 2024-09-22] 2024-09-22 hour 3: 145134 events in 0 files, snapshot none (task 3927 ms: download 2331 ms overlapping gunzip 503 ms, parse 2167 ms, sort 0 ms, write 0 ms, index 423 ms: 8 candidates, 57894 repo-hours, 3984 releases; waiting 559 ms; commit 0 ms)
2026-11-08T08:02:51Z [load_day 2024-09-22] 2024-09-22 hour 4: 127972 events in 0 files, snapshot none (task 3567 ms: download 1878 ms overlapping gunzip 478 ms, parse 1895 ms, sort 0 ms, write 0 ms, index 337 ms: 7 candidates, 48606 repo-hours, 619 releases; waiting 541 ms; commit 0 ms)
2026-11-08T08:02:52Z [load_day 2024-09-22] 2024-09-22 hour 5: 136254 events in 0 files, snapshot none (task 3750 ms: download 2120 ms overlapping gunzip 533 ms, parse 2179 ms, sort 0 ms, write 0 ms, index 374 ms: 5 candidates, 50917 repo-hours, 763 releases; waiting 390 ms; commit 0 ms)
2026-11-08T08:02:56Z [load_day 2024-09-22] 2024-09-22 hour 6: 160311 events in 0 files, snapshot none (task 4432 ms: download 2445 ms overlapping gunzip 589 ms, parse 2469 ms, sort 0 ms, write 0 ms, index 515 ms: 5 candidates, 68108 repo-hours, 774 releases; waiting 506 ms; commit 0 ms)
2026-11-08T08:02:56Z [load_day 2024-09-22] 2024-09-22 hour 7: 150059 events in 0 files, snapshot none (task 4005 ms: download 2075 ms overlapping gunzip 539 ms, parse 2259 ms, sort 0 ms, write 0 ms, index 410 ms: 6 candidates, 55608 repo-hours, 722 releases; waiting 505 ms; commit 0 ms)
2026-11-08T08:03:03Z [load_day 2024-09-22] 2024-09-22 hour 8: 162846 events in 0 files, snapshot none (task 5800 ms: download 2798 ms overlapping gunzip 884 ms, parse 3621 ms, sort 0 ms, write 0 ms, index 536 ms: 5 candidates, 61794 repo-hours, 852 releases; waiting 423 ms; commit 0 ms)
2026-11-08T08:03:03Z [load_day 2024-09-22] 2024-09-22 hour 9: 169781 events in 0 files, snapshot none (task 5942 ms: download 4056 ms overlapping gunzip 863 ms, parse 3709 ms, sort 0 ms, write 0 ms, index 500 ms: 3 candidates, 67250 repo-hours, 997 releases; waiting 553 ms; commit 0 ms)
2026-11-08T08:03:09Z [load_day 2024-09-22] 2024-09-22 hour 10: 166693 events in 0 files, snapshot none (task 5334 ms: download 2710 ms overlapping gunzip 736 ms, parse 3064 ms, sort 0 ms, write 0 ms, index 570 ms: 3 candidates, 62670 repo-hours, 699 releases; waiting 634 ms; commit 0 ms)
2026-11-08T08:03:09Z [load_day 2024-09-22] 2024-09-22 hour 11: 169390 events in 0 files, snapshot none (task 5442 ms: download 3500 ms overlapping gunzip 711 ms, parse 3073 ms, sort 0 ms, write 0 ms, index 610 ms: 8 candidates, 61497 repo-hours, 747 releases; waiting 631 ms; commit 0 ms)
2026-11-08T08:03:16Z [load_day 2024-09-22] 2024-09-22 hour 12: 231106 events in 0 files, snapshot none (task 6497 ms: download 3479 ms overlapping gunzip 803 ms, parse 3679 ms, sort 0 ms, write 0 ms, index 1140 ms: 7 candidates, 111007 repo-hours, 906 releases; waiting 528 ms; commit 0 ms)
2026-11-08T08:03:16Z [load_day 2024-09-22] 2024-09-22 hour 13: 201037 events in 0 files, snapshot none (task 6330 ms: download 3009 ms overlapping gunzip 858 ms, parse 3743 ms, sort 0 ms, write 0 ms, index 972 ms: 7 candidates, 91057 repo-hours, 840 releases; waiting 462 ms; commit 0 ms)
2026-11-08T08:03:23Z [load_day 2024-09-22] 2024-09-22 hour 14: 187685 events in 0 files, snapshot none (task 7217 ms: download 3675 ms overlapping gunzip 1002 ms, parse 4691 ms, sort 0 ms, write 0 ms, index 807 ms: 15 candidates, 73667 repo-hours, 922 releases; waiting 471 ms; commit 0 ms)
2026-11-08T08:03:23Z [load_day 2024-09-22] 2024-09-22 hour 15: 199120 events in 0 files, snapshot none (task 6842 ms: download 3014 ms overlapping gunzip 973 ms, parse 4146 ms, sort 0 ms, write 0 ms, index 834 ms: 4 candidates, 83065 repo-hours, 1126 releases; waiting 512 ms; commit 0 ms)
2026-11-08T08:03:30Z [load_day 2024-09-22] 2024-09-22 hour 16: 184687 events in 0 files, snapshot none (task 5894 ms: download 2995 ms overlapping gunzip 882 ms, parse 3843 ms, sort 0 ms, write 0 ms, index 607 ms: 4 candidates, 73484 repo-hours, 900 releases; waiting 226 ms; commit 0 ms)
2026-11-08T08:03:30Z [load_day 2024-09-22] 2024-09-22 hour 17: 175529 events in 0 files, snapshot none (task 5546 ms: download 3055 ms overlapping gunzip 787 ms, parse 3444 ms, sort 0 ms, write 0 ms, index 507 ms: 8 candidates, 68223 repo-hours, 839 releases; waiting 510 ms; commit 0 ms)
2026-11-08T08:03:37Z [load_day 2024-09-22] 2024-09-22 hour 18: 195856 events in 0 files, snapshot none (task 6556 ms: download 3617 ms overlapping gunzip 1001 ms, parse 4172 ms, sort 0 ms, write 0 ms, index 783 ms: 5 candidates, 83679 repo-hours, 1115 releases; waiting 282 ms; commit 0 ms)
2026-11-08T08:03:37Z [load_day 2024-09-22] 2024-09-22 hour 19: 168845 events in 0 files, snapshot none (task 6286 ms: download 3017 ms overlapping gunzip 917 ms, parse 4067 ms, sort 0 ms, write 0 ms, index 533 ms: 12 candidates, 62082 repo-hours, 873 releases; waiting 478 ms; commit 0 ms)
2026-11-08T08:03:43Z [load_day 2024-09-22] 2024-09-22 hour 20: 161800 events in 0 files, snapshot none (task 5841 ms: download 3001 ms overlapping gunzip 831 ms, parse 3653 ms, sort 0 ms, write 0 ms, index 745 ms: 10 candidates, 61750 repo-hours, 875 releases; waiting 357 ms; commit 0 ms)
2026-11-08T08:03:43Z [load_day 2024-09-22] 2024-09-22 hour 21: 152399 events in 0 files, snapshot none (task 5318 ms: download 2949 ms overlapping gunzip 781 ms, parse 3422 ms, sort 0 ms, write 0 ms, index 437 ms: 7 candidates, 59562 repo-hours, 946 releases; waiting 445 ms; commit 0 ms)
2026-11-08T08:03:48Z [load_day 2024-09-22] 2024-09-22 hour 22: 137938 events in 0 files, snapshot none (task 4536 ms: download 2101 ms overlapping gunzip 682 ms, parse 2894 ms, sort 0 ms, write 0 ms, index 437 ms: 4 candidates, 48952 repo-hours, 1054 releases; waiting 219 ms; commit 0 ms)
2026-11-08T08:03:48Z [load_day 2024-09-22] 2024-09-22 hour 23: 132936 events in 0 files, snapshot none (task 4984 ms: download 2736 ms overlapping gunzip 732 ms, parse 2890 ms, sort 0 ms, write 0 ms, index 330 ms: 9 candidates, 48316 repo-hours, 888 releases; waiting 526 ms; commit 0 ms)
2026-11-08T08:03:55Z [load_day 2024-09-22] 2024-09-22: repo_hour merged from 24 files to 1 (1613359 rows, 6922 ms)
2026-11-08T08:03:58Z [load_day 2024-09-22] 2024-09-22: index committed in 9416 ms (24 + 1 + 24 files)
2026-11-08T08:03:58Z [load_day 2024-09-22] 2024-09-22: 3950279 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:03:58Z [load_day 2024-09-22] attempt 1 succeeded