orcaLog in

Runs · run 3860

load_day 2025-05-04, attempt 1 succeeded

Host
73ccef5e07c2:298346
Started
2026-11-08T11:45:26Z
Ended
2026-11-08T11:47:07Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
703 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
139.5 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3860/load_day/2025-05-04/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:45:26Z [load_day 2025-05-04] attempt 1 started
2026-11-08T11:45:28Z [load_day 2025-05-04] 2025-05-04: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:45:34Z [load_day 2025-05-04] 2025-05-04 hour 0: 160056 events in 0 files, snapshot none (task 6180 ms: download 3372 ms overlapping gunzip 929 ms, parse 3951 ms, sort 0 ms, write 0 ms, index 521 ms: 13 candidates, 70072 repo-hours, 1053 releases; waiting 463 ms; commit 0 ms)
2026-11-08T11:45:35Z [load_day 2025-05-04] 2025-05-04 hour 1: 190140 events in 0 files, snapshot none (task 6313 ms: download 3443 ms overlapping gunzip 866 ms, parse 4185 ms, sort 0 ms, write 0 ms, index 749 ms: 7 candidates, 103181 repo-hours, 866 releases; waiting 263 ms; commit 0 ms)
2026-11-08T11:45:45Z [load_day 2025-05-04] 2025-05-04 hour 2: 165459 events in 0 files, snapshot none (task 6605 ms: download 3689 ms overlapping gunzip 985 ms, parse 4406 ms, sort 0 ms, write 0 ms, index 503 ms: 4 candidates, 74016 repo-hours, 862 releases; waiting 423 ms; commit 0 ms)
2026-11-08T11:45:45Z [load_day 2025-05-04] 2025-05-04 hour 3: 167992 events in 0 files, snapshot none (task 6347 ms: download 3150 ms overlapping gunzip 956 ms, parse 4034 ms, sort 0 ms, write 0 ms, index 558 ms: 6 candidates, 66011 repo-hours, 2792 releases; waiting 493 ms; commit 0 ms)
2026-11-08T11:45:52Z [load_day 2025-05-04] 2025-05-04 hour 4: 164482 events in 0 files, snapshot none (task 6204 ms: download 3329 ms overlapping gunzip 904 ms, parse 3923 ms, sort 0 ms, write 0 ms, index 441 ms: 7 candidates, 58611 repo-hours, 678 releases; waiting 605 ms; commit 0 ms)
2026-11-08T11:45:52Z [load_day 2025-05-04] 2025-05-04 hour 5: 170613 events in 0 files, snapshot none (task 5708 ms: download 3249 ms overlapping gunzip 831 ms, parse 3621 ms, sort 0 ms, write 0 ms, index 436 ms: 3 candidates, 61229 repo-hours, 671 releases; waiting 534 ms; commit 0 ms)
2026-11-08T11:45:59Z [load_day 2025-05-04] 2025-05-04 hour 6: 185641 events in 0 files, snapshot none (task 6311 ms: download 2964 ms overlapping gunzip 864 ms, parse 3879 ms, sort 0 ms, write 0 ms, index 833 ms: 6 candidates, 78153 repo-hours, 822 releases; waiting 503 ms; commit 0 ms)
2026-11-08T11:45:59Z [load_day 2025-05-04] 2025-05-04 hour 7: 183609 events in 0 files, snapshot none (task 6935 ms: download 3342 ms overlapping gunzip 949 ms, parse 4061 ms, sort 0 ms, write 0 ms, index 691 ms: 10 candidates, 68198 repo-hours, 676 releases; waiting 525 ms; commit 0 ms)
2026-11-08T11:46:05Z [load_day 2025-05-04] 2025-05-04 hour 8: 188191 events in 0 files, snapshot none (task 5419 ms: download 2847 ms overlapping gunzip 741 ms, parse 3192 ms, sort 0 ms, write 0 ms, index 566 ms: 4 candidates, 73234 repo-hours, 764 releases; waiting 591 ms; commit 0 ms)
2026-11-08T11:46:05Z [load_day 2025-05-04] 2025-05-04 hour 9: 196231 events in 0 files, snapshot none (task 5664 ms: download 3166 ms overlapping gunzip 804 ms, parse 3409 ms, sort 0 ms, write 0 ms, index 617 ms: 3 candidates, 78456 repo-hours, 924 releases; waiting 505 ms; commit 0 ms)
2026-11-08T11:46:11Z [load_day 2025-05-04] 2025-05-04 hour 10: 194178 events in 0 files, snapshot none (task 5489 ms: download 3245 ms overlapping gunzip 758 ms, parse 3271 ms, sort 0 ms, write 0 ms, index 568 ms: 5 candidates, 77975 repo-hours, 873 releases; waiting 617 ms; commit 0 ms)
2026-11-08T11:46:11Z [load_day 2025-05-04] 2025-05-04 hour 11: 200271 events in 0 files, snapshot none (task 5482 ms: download 3066 ms overlapping gunzip 767 ms, parse 3242 ms, sort 0 ms, write 0 ms, index 562 ms: 7 candidates, 77432 repo-hours, 881 releases; waiting 654 ms; commit 0 ms)
2026-11-08T11:46:18Z [load_day 2025-05-04] 2025-05-04 hour 12: 228275 events in 0 files, snapshot none (task 7326 ms: download 3252 ms overlapping gunzip 1027 ms, parse 4347 ms, sort 0 ms, write 0 ms, index 1099 ms: 4 candidates, 116977 repo-hours, 999 releases; waiting 501 ms; commit 0 ms)
2026-11-08T11:46:19Z [load_day 2025-05-04] 2025-05-04 hour 13: 219810 events in 0 files, snapshot none (task 7271 ms: download 3739 ms overlapping gunzip 1028 ms, parse 4774 ms, sort 0 ms, write 0 ms, index 943 ms: 6 candidates, 102081 repo-hours, 858 releases; waiting 203 ms; commit 0 ms)
2026-11-08T11:46:26Z [load_day 2025-05-04] 2025-05-04 hour 14: 210933 events in 0 files, snapshot none (task 7050 ms: download 3657 ms overlapping gunzip 1048 ms, parse 4317 ms, sort 0 ms, write 0 ms, index 793 ms: 6 candidates, 85567 repo-hours, 1017 releases; waiting 584 ms; commit 0 ms)
2026-11-08T11:46:27Z [load_day 2025-05-04] 2025-05-04 hour 15: 222547 events in 0 files, snapshot none (task 7458 ms: download 4177 ms overlapping gunzip 1044 ms, parse 4675 ms, sort 0 ms, write 0 ms, index 781 ms: 4 candidates, 93233 repo-hours, 1130 releases; waiting 569 ms; commit 0 ms)
2026-11-08T11:46:33Z [load_day 2025-05-04] 2025-05-04 hour 16: 223239 events in 0 files, snapshot none (task 6119 ms: download 3300 ms overlapping gunzip 872 ms, parse 3846 ms, sort 0 ms, write 0 ms, index 757 ms: 7 candidates, 84488 repo-hours, 901 releases; waiting 334 ms; commit 0 ms)
2026-11-08T11:46:33Z [load_day 2025-05-04] 2025-05-04 hour 17: 191866 events in 0 files, snapshot none (task 5844 ms: download 3073 ms overlapping gunzip 787 ms, parse 3492 ms, sort 0 ms, write 0 ms, index 744 ms: 5 candidates, 77867 repo-hours, 964 releases; waiting 515 ms; commit 0 ms)
2026-11-08T11:46:40Z [load_day 2025-05-04] 2025-05-04 hour 18: 193302 events in 0 files, snapshot none (task 6918 ms: download 4087 ms overlapping gunzip 884 ms, parse 3841 ms, sort 0 ms, write 0 ms, index 725 ms: 6 candidates, 89028 repo-hours, 1130 releases; waiting 1247 ms; commit 0 ms)
2026-11-08T11:46:41Z [load_day 2025-05-04] 2025-05-04 hour 19: 209590 events in 0 files, snapshot none (task 6888 ms: download 4071 ms overlapping gunzip 1010 ms, parse 4497 ms, sort 0 ms, write 0 ms, index 584 ms: 6 candidates, 79100 repo-hours, 1194 releases; waiting 434 ms; commit 0 ms)
2026-11-08T11:46:48Z [load_day 2025-05-04] 2025-05-04 hour 20: 199678 events in 0 files, snapshot none (task 7662 ms: download 4826 ms overlapping gunzip 1154 ms, parse 4772 ms, sort 0 ms, write 0 ms, index 728 ms: 7 candidates, 76886 repo-hours, 1024 releases; waiting 721 ms; commit 0 ms)
2026-11-08T11:46:49Z [load_day 2025-05-04] 2025-05-04 hour 21: 190251 events in 0 files, snapshot none (task 7683 ms: download 4654 ms overlapping gunzip 1143 ms, parse 5214 ms, sort 0 ms, write 0 ms, index 597 ms: 10 candidates, 72074 repo-hours, 1068 releases; waiting 507 ms; commit 0 ms)
2026-11-08T11:46:56Z [load_day 2025-05-04] 2025-05-04 hour 22: 177646 events in 0 files, snapshot none (task 6921 ms: download 3503 ms overlapping gunzip 1059 ms, parse 4498 ms, sort 0 ms, write 0 ms, index 626 ms: 8 candidates, 64871 repo-hours, 1034 releases; waiting 522 ms; commit 0 ms)
2026-11-08T11:46:56Z [load_day 2025-05-04] 2025-05-04 hour 23: 165988 events in 0 files, snapshot none (task 6144 ms: download 2866 ms overlapping gunzip 869 ms, parse 3859 ms, sort 0 ms, write 0 ms, index 682 ms: 5 candidates, 60264 repo-hours, 871 releases; waiting 439 ms; commit 0 ms)
2026-11-08T11:47:04Z [load_day 2025-05-04] 2025-05-04: repo_hour merged from 24 files to 1 (1889004 rows, 8674 ms)
2026-11-08T11:47:07Z [load_day 2025-05-04] 2025-05-04: index committed in 11535 ms (24 + 1 + 24 files)
2026-11-08T11:47:07Z [load_day 2025-05-04] 2025-05-04: 4599988 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:47:07Z [load_day 2025-05-04] attempt 1 succeeded