orcaLog in

Runs · run 2534

load_day 2024-06-02, attempt 1 succeeded

Host
73ccef5e07c2:130620
Started
2026-11-08T06:22:04Z
Ended
2026-11-08T06:23:21Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
653 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
109.3 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2534/load_day/2024-06-02/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:22:04Z [load_day 2024-06-02] attempt 1 started
2026-11-08T06:22:04Z [load_day 2024-06-02] 2024-06-02: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:22:08Z [load_day 2024-06-02] 2024-06-02 hour 0: 145050 events in 0 files, snapshot none (task 3343 ms: download 987 ms overlapping gunzip 481 ms, parse 2142 ms, sort 0 ms, write 0 ms, index 526 ms: 9 candidates, 75896 repo-hours, 1036 releases; waiting 9 ms; commit 0 ms)
2026-11-08T06:22:09Z [load_day 2024-06-02] 2024-06-02 hour 1: 153349 events in 0 files, snapshot none (task 4014 ms: download 1457 ms overlapping gunzip 551 ms, parse 2595 ms, sort 0 ms, write 0 ms, index 673 ms: 8 candidates, 87179 repo-hours, 844 releases; waiting 11 ms; commit 0 ms)
2026-11-08T06:22:13Z [load_day 2024-06-02] 2024-06-02 hour 2: 117488 events in 0 files, snapshot none (task 4532 ms: download 1259 ms overlapping gunzip 737 ms, parse 3129 ms, sort 0 ms, write 0 ms, index 454 ms: 3 candidates, 46319 repo-hours, 693 releases; waiting 15 ms; commit 0 ms)
2026-11-08T06:22:14Z [load_day 2024-06-02] 2024-06-02 hour 3: 138247 events in 0 files, snapshot none (task 4113 ms: download 984 ms overlapping gunzip 610 ms, parse 2835 ms, sort 0 ms, write 0 ms, index 449 ms: 10 candidates, 56095 repo-hours, 4198 releases; waiting 17 ms; commit 0 ms)
2026-11-08T06:22:17Z [load_day 2024-06-02] 2024-06-02 hour 4: 124717 events in 0 files, snapshot none (task 3375 ms: download 980 ms overlapping gunzip 544 ms, parse 2243 ms, sort 0 ms, write 0 ms, index 388 ms: 2 candidates, 46154 repo-hours, 522 releases; waiting 16 ms; commit 0 ms)
2026-11-08T06:22:19Z [load_day 2024-06-02] 2024-06-02 hour 5: 133001 events in 0 files, snapshot none (task 4428 ms: download 1151 ms overlapping gunzip 631 ms, parse 2806 ms, sort 0 ms, write 0 ms, index 767 ms: 6 candidates, 50221 repo-hours, 723 releases; waiting 18 ms; commit 0 ms)
2026-11-08T06:22:22Z [load_day 2024-06-02] 2024-06-02 hour 6: 160780 events in 0 files, snapshot none (task 4668 ms: download 1529 ms overlapping gunzip 680 ms, parse 3023 ms, sort 0 ms, write 0 ms, index 731 ms: 13 candidates, 66731 repo-hours, 751 releases; waiting 23 ms; commit 0 ms)
2026-11-08T06:22:24Z [load_day 2024-06-02] 2024-06-02 hour 7: 143327 events in 0 files, snapshot none (task 4890 ms: download 1709 ms overlapping gunzip 712 ms, parse 2982 ms, sort 0 ms, write 0 ms, index 999 ms: 2 candidates, 54229 repo-hours, 671 releases; waiting 14 ms; commit 0 ms)
2026-11-08T06:22:28Z [load_day 2024-06-02] 2024-06-02 hour 8: 152532 events in 0 files, snapshot none (task 5061 ms: download 1967 ms overlapping gunzip 807 ms, parse 3499 ms, sort 0 ms, write 0 ms, index 537 ms: 4 candidates, 59536 repo-hours, 753 releases; waiting 14 ms; commit 0 ms)
2026-11-08T06:22:30Z [load_day 2024-06-02] 2024-06-02 hour 9: 174627 events in 0 files, snapshot none (task 4806 ms: download 2080 ms overlapping gunzip 713 ms, parse 3212 ms, sort 0 ms, write 0 ms, index 646 ms: 4 candidates, 67663 repo-hours, 831 releases; waiting 25 ms; commit 0 ms)
2026-11-08T06:22:33Z [load_day 2024-06-02] 2024-06-02 hour 10: 160767 events in 0 files, snapshot none (task 4413 ms: download 1637 ms overlapping gunzip 727 ms, parse 2962 ms, sort 0 ms, write 0 ms, index 502 ms: 8 candidates, 63467 repo-hours, 740 releases; waiting 17 ms; commit 0 ms)
2026-11-08T06:22:35Z [load_day 2024-06-02] 2024-06-02 hour 11: 182370 events in 0 files, snapshot none (task 5446 ms: download 1847 ms overlapping gunzip 860 ms, parse 3703 ms, sort 0 ms, write 0 ms, index 652 ms: 7 candidates, 61308 repo-hours, 691 releases; waiting 24 ms; commit 0 ms)
2026-11-08T06:22:39Z [load_day 2024-06-02] 2024-06-02 hour 12: 248007 events in 0 files, snapshot none (task 5891 ms: download 2489 ms overlapping gunzip 861 ms, parse 3924 ms, sort 0 ms, write 0 ms, index 885 ms: 17 candidates, 109174 repo-hours, 879 releases; waiting 20 ms; commit 0 ms)
2026-11-08T06:22:42Z [load_day 2024-06-02] 2024-06-02 hour 13: 196630 events in 0 files, snapshot none (task 5996 ms: download 2718 ms overlapping gunzip 895 ms, parse 4105 ms, sort 0 ms, write 0 ms, index 754 ms: 12 candidates, 89528 repo-hours, 848 releases; waiting 24 ms; commit 0 ms)
2026-11-08T06:22:46Z [load_day 2024-06-02] 2024-06-02 hour 14: 194360 events in 0 files, snapshot none (task 6233 ms: download 2713 ms overlapping gunzip 999 ms, parse 4387 ms, sort 0 ms, write 0 ms, index 628 ms: 5 candidates, 75001 repo-hours, 840 releases; waiting 4 ms; commit 0 ms)
2026-11-08T06:22:48Z [load_day 2024-06-02] 2024-06-02 hour 15: 193506 events in 0 files, snapshot none (task 5778 ms: download 2654 ms overlapping gunzip 848 ms, parse 3854 ms, sort 0 ms, write 0 ms, index 850 ms: 7 candidates, 83259 repo-hours, 998 releases; waiting 13 ms; commit 0 ms)
2026-11-08T06:22:52Z [load_day 2024-06-02] 2024-06-02 hour 16: 184793 events in 0 files, snapshot none (task 6453 ms: download 2638 ms overlapping gunzip 1018 ms, parse 4364 ms, sort 0 ms, write 0 ms, index 843 ms: 14 candidates, 76049 repo-hours, 1133 releases; waiting 8 ms; commit 0 ms)
2026-11-08T06:22:55Z [load_day 2024-06-02] 2024-06-02 hour 17: 181120 events in 0 files, snapshot none (task 6665 ms: download 2708 ms overlapping gunzip 1057 ms, parse 4466 ms, sort 0 ms, write 0 ms, index 947 ms: 10 candidates, 71994 repo-hours, 972 releases; waiting 15 ms; commit 0 ms)
2026-11-08T06:22:59Z [load_day 2024-06-02] 2024-06-02 hour 18: 185815 events in 0 files, snapshot none (task 5981 ms: download 2541 ms overlapping gunzip 962 ms, parse 4043 ms, sort 0 ms, write 0 ms, index 747 ms: 9 candidates, 83498 repo-hours, 1133 releases; waiting 21 ms; commit 0 ms)
2026-11-08T06:23:01Z [load_day 2024-06-02] 2024-06-02 hour 19: 167541 events in 0 files, snapshot none (task 5323 ms: download 2193 ms overlapping gunzip 784 ms, parse 3453 ms, sort 0 ms, write 0 ms, index 870 ms: 9 candidates, 61611 repo-hours, 827 releases; waiting 12 ms; commit 0 ms)
2026-11-08T06:23:05Z [load_day 2024-06-02] 2024-06-02 hour 20: 171073 events in 0 files, snapshot none (task 5433 ms: download 2653 ms overlapping gunzip 853 ms, parse 3693 ms, sort 0 ms, write 0 ms, index 665 ms: 11 candidates, 65521 repo-hours, 836 releases; waiting 17 ms; commit 0 ms)
2026-11-08T06:23:06Z [load_day 2024-06-02] 2024-06-02 hour 21: 159815 events in 0 files, snapshot none (task 4492 ms: download 1391 ms overlapping gunzip 627 ms, parse 2909 ms, sort 0 ms, write 0 ms, index 737 ms: 9 candidates, 65623 repo-hours, 902 releases; waiting 15 ms; commit 0 ms)
2026-11-08T06:23:10Z [load_day 2024-06-02] 2024-06-02 hour 22: 143019 events in 0 files, snapshot none (task 4681 ms: download 1503 ms overlapping gunzip 790 ms, parse 3226 ms, sort 0 ms, write 0 ms, index 451 ms: 7 candidates, 52079 repo-hours, 771 releases; waiting 15 ms; commit 0 ms)
2026-11-08T06:23:11Z [load_day 2024-06-02] 2024-06-02 hour 23: 141939 events in 0 files, snapshot none (task 3972 ms: download 1642 ms overlapping gunzip 632 ms, parse 2735 ms, sort 0 ms, write 0 ms, index 372 ms: 5 candidates, 51289 repo-hours, 630 releases; waiting 20 ms; commit 0 ms)
2026-11-08T06:23:18Z [load_day 2024-06-02] 2024-06-02: repo_hour merged from 24 files to 1 (1619424 rows, 7416 ms)
2026-11-08T06:23:21Z [load_day 2024-06-02] 2024-06-02: index committed in 9826 ms (24 + 1 + 24 files)
2026-11-08T06:23:21Z [load_day 2024-06-02] 2024-06-02: 3953873 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:23:21Z [load_day 2024-06-02] attempt 1 succeeded