orcaLog in

Runs · run 2768

load_day 2024-07-28, attempt 1 succeeded

Host
73ccef5e07c2:155580
Started
2026-11-08T07:11:30Z
Ended
2026-11-08T07:12:48Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
629 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
106.2 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2768/load_day/2024-07-28/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:11:30Z [load_day 2024-07-28] attempt 1 started
2026-11-08T07:11:31Z [load_day 2024-07-28] 2024-07-28: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:11:36Z [load_day 2024-07-28] 2024-07-28 hour 0: 133976 events in 0 files, snapshot none (task 4266 ms: download 1978 ms overlapping gunzip 539 ms, parse 2436 ms, sort 0 ms, write 0 ms, index 529 ms: 9 candidates, 69737 repo-hours, 1085 releases; waiting 478 ms; commit 0 ms)
2026-11-08T07:11:36Z [load_day 2024-07-28] 2024-07-28 hour 1: 143274 events in 0 files, snapshot none (task 4604 ms: download 1825 ms overlapping gunzip 560 ms, parse 2544 ms, sort 0 ms, write 0 ms, index 689 ms: 2 candidates, 84969 repo-hours, 778 releases; waiting 483 ms; commit 0 ms)
2026-11-08T07:11:41Z [load_day 2024-07-28] 2024-07-28 hour 2: 111451 events in 0 files, snapshot none (task 4725 ms: download 1854 ms overlapping gunzip 670 ms, parse 2926 ms, sort 0 ms, write 0 ms, index 433 ms: 3 candidates, 49083 repo-hours, 648 releases; waiting 446 ms; commit 0 ms)
2026-11-08T07:11:42Z [load_day 2024-07-28] 2024-07-28 hour 3: 137332 events in 0 files, snapshot none (task 4914 ms: download 1963 ms overlapping gunzip 681 ms, parse 3005 ms, sort 0 ms, write 0 ms, index 431 ms: 2 candidates, 57178 repo-hours, 5402 releases; waiting 520 ms; commit 0 ms)
2026-11-08T07:11:46Z [load_day 2024-07-28] 2024-07-28 hour 4: 114099 events in 0 files, snapshot none (task 4194 ms: download 1749 ms overlapping gunzip 605 ms, parse 2457 ms, sort 0 ms, write 0 ms, index 412 ms: 1 candidates, 44278 repo-hours, 447 releases; waiting 494 ms; commit 0 ms)
2026-11-08T07:11:46Z [load_day 2024-07-28] 2024-07-28 hour 5: 123339 events in 0 files, snapshot none (task 4028 ms: download 1964 ms overlapping gunzip 564 ms, parse 2361 ms, sort 0 ms, write 0 ms, index 367 ms: 1 candidates, 48738 repo-hours, 609 releases; waiting 464 ms; commit 0 ms)
2026-11-08T07:11:51Z [load_day 2024-07-28] 2024-07-28 hour 6: 146773 events in 0 files, snapshot none (task 4955 ms: download 2124 ms overlapping gunzip 692 ms, parse 2967 ms, sort 0 ms, write 0 ms, index 531 ms: 5 candidates, 66823 repo-hours, 702 releases; waiting 513 ms; commit 0 ms)
2026-11-08T07:11:51Z [load_day 2024-07-28] 2024-07-28 hour 7: 138019 events in 0 files, snapshot none (task 4620 ms: download 2310 ms overlapping gunzip 653 ms, parse 2796 ms, sort 0 ms, write 0 ms, index 409 ms: 1 candidates, 53272 repo-hours, 551 releases; waiting 492 ms; commit 0 ms)
2026-11-08T07:11:56Z [load_day 2024-07-28] 2024-07-28 hour 8: 147638 events in 0 files, snapshot none (task 4214 ms: download 2276 ms overlapping gunzip 548 ms, parse 2417 ms, sort 0 ms, write 0 ms, index 418 ms: 4 candidates, 58623 repo-hours, 705 releases; waiting 500 ms; commit 0 ms)
2026-11-08T07:11:56Z [load_day 2024-07-28] 2024-07-28 hour 9: 157268 events in 0 files, snapshot none (task 4193 ms: download 2577 ms overlapping gunzip 547 ms, parse 2368 ms, sort 0 ms, write 0 ms, index 562 ms: 4 candidates, 67270 repo-hours, 853 releases; waiting 422 ms; commit 0 ms)
2026-11-08T07:12:01Z [load_day 2024-07-28] 2024-07-28 hour 10: 148309 events in 0 files, snapshot none (task 4100 ms: download 2706 ms overlapping gunzip 503 ms, parse 2239 ms, sort 0 ms, write 0 ms, index 421 ms: 4 candidates, 60991 repo-hours, 707 releases; waiting 631 ms; commit 0 ms)
2026-11-08T07:12:01Z [load_day 2024-07-28] 2024-07-28 hour 11: 147368 events in 0 files, snapshot none (task 4129 ms: download 1952 ms overlapping gunzip 541 ms, parse 2316 ms, sort 0 ms, write 0 ms, index 511 ms: 2 candidates, 59118 repo-hours, 791 releases; waiting 519 ms; commit 0 ms)
2026-11-08T07:12:08Z [load_day 2024-07-28] 2024-07-28 hour 12: 232862 events in 0 files, snapshot none (task 6335 ms: download 2920 ms overlapping gunzip 741 ms, parse 3629 ms, sort 0 ms, write 0 ms, index 1118 ms: 7 candidates, 109740 repo-hours, 881 releases; waiting 593 ms; commit 0 ms)
2026-11-08T07:12:08Z [load_day 2024-07-28] 2024-07-28 hour 13: 185339 events in 0 files, snapshot none (task 5677 ms: download 2131 ms overlapping gunzip 658 ms, parse 2807 ms, sort 0 ms, write 0 ms, index 1456 ms: 7 candidates, 89138 repo-hours, 795 releases; waiting 507 ms; commit 0 ms)
2026-11-08T07:12:13Z [load_day 2024-07-28] 2024-07-28 hour 14: 179953 events in 0 files, snapshot none (task 5147 ms: download 2371 ms overlapping gunzip 709 ms, parse 2969 ms, sort 0 ms, write 0 ms, index 791 ms: 12 candidates, 70993 repo-hours, 861 releases; waiting 374 ms; commit 0 ms)
2026-11-08T07:12:14Z [load_day 2024-07-28] 2024-07-28 hour 15: 188331 events in 0 files, snapshot none (task 5995 ms: download 2615 ms overlapping gunzip 793 ms, parse 3452 ms, sort 0 ms, write 0 ms, index 932 ms: 5 candidates, 85836 repo-hours, 1082 releases; waiting 497 ms; commit 0 ms)
2026-11-08T07:12:20Z [load_day 2024-07-28] 2024-07-28 hour 16: 180488 events in 0 files, snapshot none (task 5650 ms: download 2637 ms overlapping gunzip 764 ms, parse 3519 ms, sort 0 ms, write 0 ms, index 602 ms: 8 candidates, 79712 repo-hours, 1004 releases; waiting 501 ms; commit 0 ms)
2026-11-08T07:12:20Z [load_day 2024-07-28] 2024-07-28 hour 17: 182497 events in 0 files, snapshot none (task 5347 ms: download 2780 ms overlapping gunzip 730 ms, parse 3175 ms, sort 0 ms, write 0 ms, index 605 ms: 8 candidates, 80423 repo-hours, 883 releases; waiting 473 ms; commit 0 ms)
2026-11-08T07:12:26Z [load_day 2024-07-28] 2024-07-28 hour 18: 179546 events in 0 files, snapshot none (task 6639 ms: download 3263 ms overlapping gunzip 903 ms, parse 4196 ms, sort 0 ms, write 0 ms, index 708 ms: 10 candidates, 83005 repo-hours, 943 releases; waiting 544 ms; commit 0 ms)
2026-11-08T07:12:27Z [load_day 2024-07-28] 2024-07-28 hour 19: 150338 events in 0 files, snapshot none (task 6116 ms: download 2937 ms overlapping gunzip 896 ms, parse 3994 ms, sort 0 ms, write 0 ms, index 466 ms: 10 candidates, 58004 repo-hours, 890 releases; waiting 525 ms; commit 0 ms)
2026-11-08T07:12:33Z [load_day 2024-07-28] 2024-07-28 hour 20: 149120 events in 0 files, snapshot none (task 5884 ms: download 2622 ms overlapping gunzip 809 ms, parse 3648 ms, sort 0 ms, write 0 ms, index 552 ms: 2 candidates, 61779 repo-hours, 845 releases; waiting 558 ms; commit 0 ms)
2026-11-08T07:12:33Z [load_day 2024-07-28] 2024-07-28 hour 21: 141567 events in 0 files, snapshot none (task 5713 ms: download 2650 ms overlapping gunzip 827 ms, parse 3755 ms, sort 0 ms, write 0 ms, index 451 ms: 2 candidates, 58034 repo-hours, 887 releases; waiting 476 ms; commit 0 ms)
2026-11-08T07:12:38Z [load_day 2024-07-28] 2024-07-28 hour 22: 124866 events in 0 files, snapshot none (task 4440 ms: download 2318 ms overlapping gunzip 599 ms, parse 2578 ms, sort 0 ms, write 0 ms, index 501 ms: 1 candidates, 46071 repo-hours, 889 releases; waiting 533 ms; commit 0 ms)
2026-11-08T07:12:38Z [load_day 2024-07-28] 2024-07-28 hour 23: 124529 events in 0 files, snapshot none (task 4612 ms: download 2608 ms overlapping gunzip 645 ms, parse 2802 ms, sort 0 ms, write 0 ms, index 389 ms: 2 candidates, 45431 repo-hours, 691 releases; waiting 497 ms; commit 0 ms)
2026-11-08T07:12:45Z [load_day 2024-07-28] 2024-07-28: repo_hour merged from 24 files to 1 (1588246 rows, 7511 ms)
2026-11-08T07:12:48Z [load_day 2024-07-28] 2024-07-28: index committed in 9784 ms (24 + 1 + 24 files)
2026-11-08T07:12:48Z [load_day 2024-07-28] 2024-07-28: 3668282 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:12:48Z [load_day 2024-07-28] attempt 1 succeeded