orcaLog in

Runs · run 4304

load_day 2025-08-23, attempt 1 succeeded

Host
73ccef5e07c2:365643
Started
2026-11-08T13:30:41Z
Ended
2026-11-08T13:32:06Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
607 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
111.9 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4304/load_day/2025-08-23/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:30:41Z [load_day 2025-08-23] attempt 1 started
2026-11-08T13:30:43Z [load_day 2025-08-23] 2025-08-23: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:30:49Z [load_day 2025-08-23] 2025-08-23 hour 0: 142760 events in 0 files, snapshot none (task 5681 ms: download 2641 ms overlapping gunzip 828 ms, parse 3486 ms, sort 0 ms, write 0 ms, index 887 ms: 5 candidates, 71052 repo-hours, 1014 releases; waiting 189 ms; commit 0 ms)
2026-11-08T13:30:49Z [load_day 2025-08-23] 2025-08-23 hour 1: 147839 events in 0 files, snapshot none (task 5848 ms: download 2865 ms overlapping gunzip 784 ms, parse 3356 ms, sort 0 ms, write 0 ms, index 887 ms: 9 candidates, 86336 repo-hours, 728 releases; waiting 539 ms; commit 0 ms)
2026-11-08T13:30:55Z [load_day 2025-08-23] 2025-08-23 hour 2: 133212 events in 0 files, snapshot none (task 5011 ms: download 2558 ms overlapping gunzip 693 ms, parse 2979 ms, sort 0 ms, write 0 ms, index 668 ms: 5 candidates, 59311 repo-hours, 798 releases; waiting 356 ms; commit 0 ms)
2026-11-08T13:30:55Z [load_day 2025-08-23] 2025-08-23 hour 3: 142972 events in 0 files, snapshot none (task 4956 ms: download 2512 ms overlapping gunzip 656 ms, parse 2878 ms, sort 0 ms, write 0 ms, index 577 ms: 2 candidates, 59783 repo-hours, 2177 releases; waiting 521 ms; commit 0 ms)
2026-11-08T13:31:02Z [load_day 2025-08-23] 2025-08-23 hour 4: 142116 events in 0 files, snapshot none (task 6688 ms: download 3178 ms overlapping gunzip 992 ms, parse 4248 ms, sort 0 ms, write 0 ms, index 643 ms: 8 candidates, 57967 repo-hours, 610 releases; waiting 476 ms; commit 0 ms)
2026-11-08T13:31:02Z [load_day 2025-08-23] 2025-08-23 hour 5: 138333 events in 0 files, snapshot none (task 5994 ms: download 3221 ms overlapping gunzip 895 ms, parse 3803 ms, sort 0 ms, write 0 ms, index 568 ms: 2 candidates, 56501 repo-hours, 588 releases; waiting 466 ms; commit 0 ms)
2026-11-08T13:31:09Z [load_day 2025-08-23] 2025-08-23 hour 6: 145079 events in 0 files, snapshot none (task 6686 ms: download 3198 ms overlapping gunzip 1040 ms, parse 4120 ms, sort 0 ms, write 0 ms, index 687 ms: 3 candidates, 67198 repo-hours, 798 releases; waiting 509 ms; commit 0 ms)
2026-11-08T13:31:10Z [load_day 2025-08-23] 2025-08-23 hour 7: 150867 events in 0 files, snapshot none (task 7039 ms: download 3850 ms overlapping gunzip 1132 ms, parse 4531 ms, sort 0 ms, write 0 ms, index 476 ms: 3 candidates, 57881 repo-hours, 696 releases; waiting 545 ms; commit 0 ms)
2026-11-08T13:31:15Z [load_day 2025-08-23] 2025-08-23 hour 8: 152210 events in 0 files, snapshot none (task 5086 ms: download 2714 ms overlapping gunzip 750 ms, parse 2930 ms, sort 0 ms, write 0 ms, index 510 ms: 2 candidates, 60349 repo-hours, 671 releases; waiting 512 ms; commit 0 ms)
2026-11-08T13:31:16Z [load_day 2025-08-23] 2025-08-23 hour 9: 159274 events in 0 files, snapshot none (task 5473 ms: download 2806 ms overlapping gunzip 788 ms, parse 3396 ms, sort 0 ms, write 0 ms, index 505 ms: 3 candidates, 61154 repo-hours, 770 releases; waiting 566 ms; commit 0 ms)
2026-11-08T13:31:22Z [load_day 2025-08-23] 2025-08-23 hour 10: 153334 events in 0 files, snapshot none (task 6146 ms: download 3162 ms overlapping gunzip 956 ms, parse 3837 ms, sort 0 ms, write 0 ms, index 574 ms: 4 candidates, 59344 repo-hours, 652 releases; waiting 539 ms; commit 0 ms)
2026-11-08T13:31:22Z [load_day 2025-08-23] 2025-08-23 hour 11: 155947 events in 0 files, snapshot none (task 5900 ms: download 2568 ms overlapping gunzip 876 ms, parse 3671 ms, sort 0 ms, write 0 ms, index 520 ms: 5 candidates, 58664 repo-hours, 587 releases; waiting 214 ms; commit 0 ms)
2026-11-08T13:31:28Z [load_day 2025-08-23] 2025-08-23 hour 12: 169016 events in 0 files, snapshot none (task 5158 ms: download 2645 ms overlapping gunzip 628 ms, parse 2832 ms, sort 0 ms, write 0 ms, index 868 ms: 10 candidates, 88294 repo-hours, 618 releases; waiting 510 ms; commit 0 ms)
2026-11-08T13:31:28Z [load_day 2025-08-23] 2025-08-23 hour 13: 163879 events in 0 files, snapshot none (task 5167 ms: download 2523 ms overlapping gunzip 662 ms, parse 2850 ms, sort 0 ms, write 0 ms, index 819 ms: 8 candidates, 74839 repo-hours, 608 releases; waiting 504 ms; commit 0 ms)
2026-11-08T13:31:34Z [load_day 2025-08-23] 2025-08-23 hour 14: 158047 events in 0 files, snapshot none (task 5048 ms: download 2703 ms overlapping gunzip 750 ms, parse 2995 ms, sort 0 ms, write 0 ms, index 554 ms: 12 candidates, 63722 repo-hours, 623 releases; waiting 403 ms; commit 0 ms)
2026-11-08T13:31:34Z [load_day 2025-08-23] 2025-08-23 hour 15: 152707 events in 0 files, snapshot none (task 5171 ms: download 2899 ms overlapping gunzip 775 ms, parse 3148 ms, sort 0 ms, write 0 ms, index 462 ms: 7 candidates, 63831 repo-hours, 723 releases; waiting 501 ms; commit 0 ms)
2026-11-08T13:31:40Z [load_day 2025-08-23] 2025-08-23 hour 16: 152269 events in 0 files, snapshot none (task 6083 ms: download 3714 ms overlapping gunzip 855 ms, parse 3352 ms, sort 0 ms, write 0 ms, index 494 ms: 5 candidates, 63580 repo-hours, 575 releases; waiting 1017 ms; commit 0 ms)
2026-11-08T13:31:40Z [load_day 2025-08-23] 2025-08-23 hour 17: 152074 events in 0 files, snapshot none (task 5604 ms: download 2583 ms overlapping gunzip 763 ms, parse 3411 ms, sort 0 ms, write 0 ms, index 478 ms: 2 candidates, 60366 repo-hours, 687 releases; waiting 582 ms; commit 0 ms)
2026-11-08T13:31:45Z [load_day 2025-08-23] 2025-08-23 hour 18: 147160 events in 0 files, snapshot none (task 4560 ms: download 2581 ms overlapping gunzip 607 ms, parse 2584 ms, sort 0 ms, write 0 ms, index 534 ms: 5 candidates, 64623 repo-hours, 655 releases; waiting 524 ms; commit 0 ms)
2026-11-08T13:31:45Z [load_day 2025-08-23] 2025-08-23 hour 19: 145932 events in 0 files, snapshot none (task 4436 ms: download 2886 ms overlapping gunzip 637 ms, parse 2755 ms, sort 0 ms, write 0 ms, index 407 ms: 10 candidates, 53348 repo-hours, 547 releases; waiting 422 ms; commit 0 ms)
2026-11-08T13:31:51Z [load_day 2025-08-23] 2025-08-23 hour 20: 144682 events in 0 files, snapshot none (task 4697 ms: download 2782 ms overlapping gunzip 571 ms, parse 2341 ms, sort 0 ms, write 0 ms, index 391 ms: 5 candidates, 53178 repo-hours, 541 releases; waiting 1111 ms; commit 0 ms)
2026-11-08T13:31:51Z [load_day 2025-08-23] 2025-08-23 hour 21: 143523 events in 0 files, snapshot none (task 4070 ms: download 2253 ms overlapping gunzip 534 ms, parse 2329 ms, sort 0 ms, write 0 ms, index 380 ms: 4 candidates, 51093 repo-hours, 659 releases; waiting 566 ms; commit 0 ms)
2026-11-08T13:31:55Z [load_day 2025-08-23] 2025-08-23 hour 22: 139180 events in 0 files, snapshot none (task 4310 ms: download 2669 ms overlapping gunzip 561 ms, parse 2491 ms, sort 0 ms, write 0 ms, index 352 ms: 8 candidates, 46337 repo-hours, 728 releases; waiting 618 ms; commit 0 ms)
2026-11-08T13:31:55Z [load_day 2025-08-23] 2025-08-23 hour 23: 134238 events in 0 files, snapshot none (task 3508 ms: download 1976 ms overlapping gunzip 499 ms, parse 2149 ms, sort 0 ms, write 0 ms, index 310 ms: 6 candidates, 42850 repo-hours, 669 releases; waiting 299 ms; commit 0 ms)
2026-11-08T13:32:03Z [load_day 2025-08-23] 2025-08-23: repo_hour merged from 24 files to 1 (1481601 rows, 7652 ms)
2026-11-08T13:32:06Z [load_day 2025-08-23] 2025-08-23: index committed in 10378 ms (24 + 1 + 24 files)
2026-11-08T13:32:06Z [load_day 2025-08-23] 2025-08-23: 3566650 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:32:06Z [load_day 2025-08-23] attempt 1 succeeded