orcaLog in

Runs · run 3043

load_day 2024-10-05, attempt 1 succeeded

Host
73ccef5e07c2:187617
Started
2026-11-08T08:13:13Z
Ended
2026-11-08T08:14:25Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
671 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
98.9 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3043/load_day/2024-10-05/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:13:13Z [load_day 2024-10-05] attempt 1 started
2026-11-08T08:13:14Z [load_day 2024-10-05] 2024-10-05: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:13:19Z [load_day 2024-10-05] 2024-10-05 hour 0: 158281 events in 0 files, snapshot none (task 4658 ms: download 2217 ms overlapping gunzip 652 ms, parse 2598 ms, sort 0 ms, write 0 ms, index 588 ms: 4 candidates, 75761 repo-hours, 1072 releases; waiting 496 ms; commit 0 ms)
2026-11-08T08:13:19Z [load_day 2024-10-05] 2024-10-05 hour 1: 160166 events in 0 files, snapshot none (task 5127 ms: download 3691 ms overlapping gunzip 597 ms, parse 2467 ms, sort 0 ms, write 0 ms, index 871 ms: 8 candidates, 87781 repo-hours, 703 releases; waiting 856 ms; commit 0 ms)
2026-11-08T08:13:24Z [load_day 2024-10-05] 2024-10-05 hour 2: 135473 events in 0 files, snapshot none (task 5062 ms: download 3534 ms overlapping gunzip 681 ms, parse 2909 ms, sort 0 ms, write 0 ms, index 628 ms: 4 candidates, 59629 repo-hours, 651 releases; waiting 506 ms; commit 0 ms)
2026-11-08T08:13:24Z [load_day 2024-10-05] 2024-10-05 hour 3: 150813 events in 0 files, snapshot none (task 4692 ms: download 1813 ms overlapping gunzip 721 ms, parse 3046 ms, sort 0 ms, write 0 ms, index 455 ms: 6 candidates, 60827 repo-hours, 3901 releases; waiting 189 ms; commit 0 ms)
2026-11-08T08:13:29Z [load_day 2024-10-05] 2024-10-05 hour 4: 136257 events in 0 files, snapshot none (task 4214 ms: download 2160 ms overlapping gunzip 574 ms, parse 2368 ms, sort 0 ms, write 0 ms, index 466 ms: 4 candidates, 51304 repo-hours, 570 releases; waiting 559 ms; commit 0 ms)
2026-11-08T08:13:29Z [load_day 2024-10-05] 2024-10-05 hour 5: 149965 events in 0 files, snapshot none (task 3819 ms: download 1870 ms overlapping gunzip 543 ms, parse 2102 ms, sort 0 ms, write 0 ms, index 659 ms: 3 candidates, 55292 repo-hours, 783 releases; waiting 182 ms; commit 0 ms)
2026-11-08T08:13:35Z [load_day 2024-10-05] 2024-10-05 hour 6: 173884 events in 0 files, snapshot none (task 5459 ms: download 2888 ms overlapping gunzip 684 ms, parse 2768 ms, sort 0 ms, write 0 ms, index 1020 ms: 6 candidates, 72328 repo-hours, 923 releases; waiting 491 ms; commit 0 ms)
2026-11-08T08:13:35Z [load_day 2024-10-05] 2024-10-05 hour 7: 164942 events in 0 files, snapshot none (task 4601 ms: download 2381 ms overlapping gunzip 561 ms, parse 2460 ms, sort 0 ms, write 0 ms, index 784 ms: 1 candidates, 58877 repo-hours, 839 releases; waiting 525 ms; commit 0 ms)
2026-11-08T08:13:39Z [load_day 2024-10-05] 2024-10-05 hour 8: 169035 events in 0 files, snapshot none (task 3982 ms: download 2910 ms overlapping gunzip 507 ms, parse 2069 ms, sort 0 ms, write 0 ms, index 437 ms: 5 candidates, 63482 repo-hours, 849 releases; waiting 651 ms; commit 0 ms)
2026-11-08T08:13:39Z [load_day 2024-10-05] 2024-10-05 hour 9: 175902 events in 0 files, snapshot none (task 4018 ms: download 2112 ms overlapping gunzip 508 ms, parse 2152 ms, sort 0 ms, write 0 ms, index 552 ms: 4 candidates, 70040 repo-hours, 1053 releases; waiting 534 ms; commit 0 ms)
2026-11-08T08:13:44Z [load_day 2024-10-05] 2024-10-05 hour 10: 170714 events in 0 files, snapshot none (task 4031 ms: download 2308 ms overlapping gunzip 512 ms, parse 2175 ms, sort 0 ms, write 0 ms, index 518 ms: 6 candidates, 65737 repo-hours, 806 releases; waiting 528 ms; commit 0 ms)
2026-11-08T08:13:44Z [load_day 2024-10-05] 2024-10-05 hour 11: 168178 events in 0 files, snapshot none (task 3760 ms: download 2303 ms overlapping gunzip 478 ms, parse 2005 ms, sort 0 ms, write 0 ms, index 441 ms: 3 candidates, 62425 repo-hours, 769 releases; waiting 517 ms; commit 0 ms)
2026-11-08T08:13:49Z [load_day 2024-10-05] 2024-10-05 hour 12: 221708 events in 0 files, snapshot none (task 4658 ms: download 2201 ms overlapping gunzip 561 ms, parse 2517 ms, sort 0 ms, write 0 ms, index 770 ms: 6 candidates, 108406 repo-hours, 818 releases; waiting 518 ms; commit 0 ms)
2026-11-08T08:13:49Z [load_day 2024-10-05] 2024-10-05 hour 13: 202270 events in 0 files, snapshot none (task 4509 ms: download 2468 ms overlapping gunzip 585 ms, parse 2460 ms, sort 0 ms, write 0 ms, index 643 ms: 9 candidates, 90362 repo-hours, 737 releases; waiting 485 ms; commit 0 ms)
2026-11-08T08:13:55Z [load_day 2024-10-05] 2024-10-05 hour 14: 184654 events in 0 files, snapshot none (task 5196 ms: download 2570 ms overlapping gunzip 710 ms, parse 3057 ms, sort 0 ms, write 0 ms, index 632 ms: 5 candidates, 72885 repo-hours, 792 releases; waiting 503 ms; commit 0 ms)
2026-11-08T08:13:55Z [load_day 2024-10-05] 2024-10-05 hour 15: 196087 events in 0 files, snapshot none (task 5124 ms: download 2635 ms overlapping gunzip 734 ms, parse 3039 ms, sort 0 ms, write 0 ms, index 572 ms: 6 candidates, 80715 repo-hours, 970 releases; waiting 510 ms; commit 0 ms)
2026-11-08T08:14:00Z [load_day 2024-10-05] 2024-10-05 hour 16: 184366 events in 0 files, snapshot none (task 4852 ms: download 2623 ms overlapping gunzip 715 ms, parse 2790 ms, sort 0 ms, write 0 ms, index 572 ms: 3 candidates, 73785 repo-hours, 794 releases; waiting 478 ms; commit 0 ms)
2026-11-08T08:14:00Z [load_day 2024-10-05] 2024-10-05 hour 17: 178094 events in 0 files, snapshot none (task 4793 ms: download 2390 ms overlapping gunzip 661 ms, parse 2800 ms, sort 0 ms, write 0 ms, index 532 ms: 3 candidates, 67790 repo-hours, 806 releases; waiting 491 ms; commit 0 ms)
2026-11-08T08:14:05Z [load_day 2024-10-05] 2024-10-05 hour 18: 192965 events in 0 files, snapshot none (task 4448 ms: download 2044 ms overlapping gunzip 622 ms, parse 2563 ms, sort 0 ms, write 0 ms, index 697 ms: 7 candidates, 83723 repo-hours, 918 releases; waiting 259 ms; commit 0 ms)
2026-11-08T08:14:06Z [load_day 2024-10-05] 2024-10-05 hour 19: 171891 events in 0 files, snapshot none (task 4876 ms: download 2363 ms overlapping gunzip 622 ms, parse 2630 ms, sort 0 ms, write 0 ms, index 821 ms: 3 candidates, 61570 repo-hours, 748 releases; waiting 497 ms; commit 0 ms)
2026-11-08T08:14:10Z [load_day 2024-10-05] 2024-10-05 hour 20: 162755 events in 0 files, snapshot none (task 4020 ms: download 2091 ms overlapping gunzip 534 ms, parse 2122 ms, sort 0 ms, write 0 ms, index 541 ms: 16 candidates, 59854 repo-hours, 796 releases; waiting 517 ms; commit 0 ms)
2026-11-08T08:14:10Z [load_day 2024-10-05] 2024-10-05 hour 21: 158509 events in 0 files, snapshot none (task 4245 ms: download 2239 ms overlapping gunzip 540 ms, parse 2165 ms, sort 0 ms, write 0 ms, index 701 ms: 11 candidates, 60374 repo-hours, 877 releases; waiting 480 ms; commit 0 ms)
2026-11-08T08:14:14Z [load_day 2024-10-05] 2024-10-05 hour 22: 140575 events in 0 files, snapshot none (task 3438 ms: download 1848 ms overlapping gunzip 458 ms, parse 1802 ms, sort 0 ms, write 0 ms, index 354 ms: 5 candidates, 48822 repo-hours, 957 releases; waiting 518 ms; commit 0 ms)
2026-11-08T08:14:14Z [load_day 2024-10-05] 2024-10-05 hour 23: 130810 events in 0 files, snapshot none (task 3410 ms: download 1639 ms overlapping gunzip 402 ms, parse 1783 ms, sort 0 ms, write 0 ms, index 411 ms: 3 candidates, 46161 repo-hours, 637 releases; waiting 529 ms; commit 0 ms)
2026-11-08T08:14:22Z [load_day 2024-10-05] 2024-10-05: repo_hour merged from 24 files to 1 (1637930 rows, 7640 ms)
2026-11-08T08:14:25Z [load_day 2024-10-05] 2024-10-05: index committed in 10898 ms (24 + 1 + 24 files)
2026-11-08T08:14:25Z [load_day 2024-10-05] 2024-10-05: 4038294 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:14:25Z [load_day 2024-10-05] attempt 1 succeeded