orcaLog in

Runs · run 2442

load_day 2024-05-11, attempt 1 succeeded

Host
73ccef5e07c2:121156
Started
2026-11-08T06:02:39Z
Ended
2026-11-08T06:03:57Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
619 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
111.0 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2442/load_day/2024-05-11/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:02:39Z [load_day 2024-05-11] attempt 1 started
2026-11-08T06:02:40Z [load_day 2024-05-11] 2024-05-11: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:02:46Z [load_day 2024-05-11] 2024-05-11 hour 0: 172878 events in 0 files, snapshot none (task 5439 ms: download 2710 ms overlapping gunzip 745 ms, parse 3188 ms, sort 0 ms, write 0 ms, index 751 ms: 8 candidates, 86316 repo-hours, 1034 releases; waiting 501 ms; commit 0 ms)
2026-11-08T06:02:46Z [load_day 2024-05-11] 2024-05-11 hour 1: 173364 events in 0 files, snapshot none (task 5090 ms: download 2634 ms overlapping gunzip 691 ms, parse 3033 ms, sort 0 ms, write 0 ms, index 632 ms: 4 candidates, 91579 repo-hours, 837 releases; waiting 502 ms; commit 0 ms)
2026-11-08T06:02:52Z [load_day 2024-05-11] 2024-05-11 hour 2: 142895 events in 0 files, snapshot none (task 5241 ms: download 2601 ms overlapping gunzip 804 ms, parse 3277 ms, sort 0 ms, write 0 ms, index 416 ms: 8 candidates, 54654 repo-hours, 734 releases; waiting 521 ms; commit 0 ms)
2026-11-08T06:02:52Z [load_day 2024-05-11] 2024-05-11 hour 3: 161130 events in 0 files, snapshot none (task 5360 ms: download 2527 ms overlapping gunzip 751 ms, parse 3204 ms, sort 0 ms, write 0 ms, index 590 ms: 9 candidates, 59764 repo-hours, 2918 releases; waiting 519 ms; commit 0 ms)
2026-11-08T06:02:58Z [load_day 2024-05-11] 2024-05-11 hour 4: 130880 events in 0 files, snapshot none (task 4919 ms: download 2450 ms overlapping gunzip 700 ms, parse 3023 ms, sort 0 ms, write 0 ms, index 372 ms: 7 candidates, 49364 repo-hours, 550 releases; waiting 543 ms; commit 0 ms)
2026-11-08T06:02:58Z [load_day 2024-05-11] 2024-05-11 hour 5: 138706 events in 0 files, snapshot none (task 4735 ms: download 2377 ms overlapping gunzip 655 ms, parse 2718 ms, sort 0 ms, write 0 ms, index 617 ms: 5 candidates, 53981 repo-hours, 695 releases; waiting 502 ms; commit 0 ms)
2026-11-08T06:03:03Z [load_day 2024-05-11] 2024-05-11 hour 6: 162734 events in 0 files, snapshot none (task 5261 ms: download 2800 ms overlapping gunzip 706 ms, parse 3227 ms, sort 0 ms, write 0 ms, index 566 ms: 6 candidates, 72073 repo-hours, 977 releases; waiting 492 ms; commit 0 ms)
2026-11-08T06:03:03Z [load_day 2024-05-11] 2024-05-11 hour 7: 162370 events in 0 files, snapshot none (task 5129 ms: download 2752 ms overlapping gunzip 713 ms, parse 3044 ms, sort 0 ms, write 0 ms, index 521 ms: 4 candidates, 62127 repo-hours, 859 releases; waiting 506 ms; commit 0 ms)
2026-11-08T06:03:09Z [load_day 2024-05-11] 2024-05-11 hour 8: 166875 events in 0 files, snapshot none (task 5054 ms: download 2625 ms overlapping gunzip 719 ms, parse 3088 ms, sort 0 ms, write 0 ms, index 532 ms: 7 candidates, 66710 repo-hours, 1055 releases; waiting 474 ms; commit 0 ms)
2026-11-08T06:03:09Z [load_day 2024-05-11] 2024-05-11 hour 9: 168620 events in 0 files, snapshot none (task 5127 ms: download 2659 ms overlapping gunzip 685 ms, parse 3134 ms, sort 0 ms, write 0 ms, index 536 ms: 8 candidates, 71789 repo-hours, 1089 releases; waiting 508 ms; commit 0 ms)
2026-11-08T06:03:15Z [load_day 2024-05-11] 2024-05-11 hour 10: 162094 events in 0 files, snapshot none (task 5190 ms: download 2733 ms overlapping gunzip 721 ms, parse 3151 ms, sort 0 ms, write 0 ms, index 514 ms: 4 candidates, 67083 repo-hours, 799 releases; waiting 524 ms; commit 0 ms)
2026-11-08T06:03:15Z [load_day 2024-05-11] 2024-05-11 hour 11: 166473 events in 0 files, snapshot none (task 5133 ms: download 2859 ms overlapping gunzip 743 ms, parse 3222 ms, sort 0 ms, write 0 ms, index 440 ms: 2 candidates, 61996 repo-hours, 746 releases; waiting 502 ms; commit 0 ms)
2026-11-08T06:03:20Z [load_day 2024-05-11] 2024-05-11 hour 12: 243631 events in 0 files, snapshot none (task 5493 ms: download 2678 ms overlapping gunzip 695 ms, parse 3334 ms, sort 0 ms, write 0 ms, index 708 ms: 7 candidates, 105711 repo-hours, 882 releases; waiting 501 ms; commit 0 ms)
2026-11-08T06:03:20Z [load_day 2024-05-11] 2024-05-11 hour 13: 196351 events in 0 files, snapshot none (task 4930 ms: download 2425 ms overlapping gunzip 632 ms, parse 2841 ms, sort 0 ms, write 0 ms, index 592 ms: 8 candidates, 87190 repo-hours, 922 releases; waiting 552 ms; commit 0 ms)
2026-11-08T06:03:26Z [load_day 2024-05-11] 2024-05-11 hour 14: 180821 events in 0 files, snapshot none (task 4820 ms: download 2367 ms overlapping gunzip 628 ms, parse 2727 ms, sort 0 ms, write 0 ms, index 566 ms: 7 candidates, 72992 repo-hours, 954 releases; waiting 509 ms; commit 0 ms)
2026-11-08T06:03:26Z [load_day 2024-05-11] 2024-05-11 hour 15: 186532 events in 0 files, snapshot none (task 4733 ms: download 2481 ms overlapping gunzip 649 ms, parse 2654 ms, sort 0 ms, write 0 ms, index 580 ms: 17 candidates, 77128 repo-hours, 1011 releases; waiting 551 ms; commit 0 ms)
2026-11-08T06:03:31Z [load_day 2024-05-11] 2024-05-11 hour 16: 177611 events in 0 files, snapshot none (task 5005 ms: download 2418 ms overlapping gunzip 656 ms, parse 2849 ms, sort 0 ms, write 0 ms, index 717 ms: 17 candidates, 74209 repo-hours, 953 releases; waiting 513 ms; commit 0 ms)
2026-11-08T06:03:31Z [load_day 2024-05-11] 2024-05-11 hour 17: 161428 events in 0 files, snapshot none (task 4332 ms: download 2298 ms overlapping gunzip 566 ms, parse 2485 ms, sort 0 ms, write 0 ms, index 510 ms: 9 candidates, 64937 repo-hours, 770 releases; waiting 483 ms; commit 0 ms)
2026-11-08T06:03:37Z [load_day 2024-05-11] 2024-05-11 hour 18: 171891 events in 0 files, snapshot none (task 5400 ms: download 2575 ms overlapping gunzip 701 ms, parse 3133 ms, sort 0 ms, write 0 ms, index 731 ms: 9 candidates, 75684 repo-hours, 920 releases; waiting 516 ms; commit 0 ms)
2026-11-08T06:03:37Z [load_day 2024-05-11] 2024-05-11 hour 19: 152211 events in 0 files, snapshot none (task 4368 ms: download 2225 ms overlapping gunzip 575 ms, parse 2505 ms, sort 0 ms, write 0 ms, index 519 ms: 10 candidates, 55219 repo-hours, 793 releases; waiting 516 ms; commit 0 ms)
2026-11-08T06:03:43Z [load_day 2024-05-11] 2024-05-11 hour 20: 148005 events in 0 files, snapshot none (task 4886 ms: download 2108 ms overlapping gunzip 667 ms, parse 3022 ms, sort 0 ms, write 0 ms, index 420 ms: 3 candidates, 55592 repo-hours, 657 releases; waiting 522 ms; commit 0 ms)
2026-11-08T06:03:43Z [load_day 2024-05-11] 2024-05-11 hour 21: 140719 events in 0 files, snapshot none (task 4354 ms: download 2173 ms overlapping gunzip 557 ms, parse 2449 ms, sort 0 ms, write 0 ms, index 561 ms: 7 candidates, 53799 repo-hours, 780 releases; waiting 507 ms; commit 0 ms)
2026-11-08T06:03:46Z [load_day 2024-05-11] 2024-05-11 hour 22: 126261 events in 0 files, snapshot none (task 3498 ms: download 1879 ms overlapping gunzip 492 ms, parse 2208 ms, sort 0 ms, write 0 ms, index 310 ms: 4 candidates, 43535 repo-hours, 679 releases; waiting 253 ms; commit 0 ms)
2026-11-08T06:03:48Z [load_day 2024-05-11] 2024-05-11 hour 23: 122553 events in 0 files, snapshot none (task 4547 ms: download 1882 ms overlapping gunzip 616 ms, parse 2807 ms, sort 0 ms, write 0 ms, index 344 ms: 7 candidates, 43385 repo-hours, 532 releases; waiting 524 ms; commit 0 ms)
2026-11-08T06:03:54Z [load_day 2024-05-11] 2024-05-11: repo_hour merged from 24 files to 1 (1606817 rows, 6827 ms)
2026-11-08T06:03:57Z [load_day 2024-05-11] 2024-05-11: index committed in 9247 ms (24 + 1 + 24 files)
2026-11-08T06:03:57Z [load_day 2024-05-11] 2024-05-11: 3917033 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:03:57Z [load_day 2024-05-11] attempt 1 succeeded