orcaLog in

Runs · run 5045

load_day 2026-03-17, attempt 1 succeeded

Host
73ccef5e07c2:456494
Started
2026-11-08T15:36:06Z
Ended
2026-11-08T15:37:09Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
728 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
70.7 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/5045/load_day/2026-03-17/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:36:06Z [load_day 2026-03-17] attempt 1 started
2026-11-08T15:36:07Z [load_day 2026-03-17] 2026-03-17: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:36:11Z [load_day 2026-03-17] 2026-03-17 hour 0: 151764 events in 0 files, snapshot none (task 3908 ms: download 2688 ms overlapping gunzip 450 ms, parse 1304 ms, sort 0 ms, write 0 ms, index 700 ms: 9 candidates, 76996 repo-hours, 763 releases; waiting 1179 ms; commit 0 ms)
2026-11-08T15:36:11Z [load_day 2026-03-17] 2026-03-17 hour 1: 159723 events in 0 files, snapshot none (task 4182 ms: download 2417 ms overlapping gunzip 334 ms, parse 1098 ms, sort 0 ms, write 0 ms, index 758 ms: 8 candidates, 95805 repo-hours, 418 releases; waiting 1701 ms; commit 0 ms)
2026-11-08T15:36:15Z [load_day 2026-03-17] 2026-03-17 hour 2: 160160 events in 0 files, snapshot none (task 3469 ms: download 2104 ms overlapping gunzip 349 ms, parse 1145 ms, sort 0 ms, write 0 ms, index 838 ms: 9 candidates, 94578 repo-hours, 518 releases; waiting 769 ms; commit 0 ms)
2026-11-08T15:36:15Z [load_day 2026-03-17] 2026-03-17 hour 3: 145935 events in 0 files, snapshot none (task 3436 ms: download 1996 ms overlapping gunzip 420 ms, parse 1249 ms, sort 0 ms, write 0 ms, index 719 ms: 8 candidates, 71273 repo-hours, 805 releases; waiting 713 ms; commit 0 ms)
2026-11-08T15:36:20Z [load_day 2026-03-17] 2026-03-17 hour 4: 152236 events in 0 files, snapshot none (task 3807 ms: download 2262 ms overlapping gunzip 464 ms, parse 1322 ms, sort 0 ms, write 0 ms, index 979 ms: 6 candidates, 77634 repo-hours, 778 releases; waiting 696 ms; commit 0 ms)
2026-11-08T15:36:20Z [load_day 2026-03-17] 2026-03-17 hour 5: 149272 events in 0 files, snapshot none (task 3991 ms: download 2522 ms overlapping gunzip 464 ms, parse 1396 ms, sort 0 ms, write 0 ms, index 1018 ms: 4 candidates, 78990 repo-hours, 761 releases; waiting 843 ms; commit 0 ms)
2026-11-08T15:36:24Z [load_day 2026-03-17] 2026-03-17 hour 6: 149461 events in 0 files, snapshot none (task 3499 ms: download 2395 ms overlapping gunzip 379 ms, parse 1153 ms, sort 0 ms, write 0 ms, index 622 ms: 8 candidates, 82073 repo-hours, 664 releases; waiting 1025 ms; commit 0 ms)
2026-11-08T15:36:24Z [load_day 2026-03-17] 2026-03-17 hour 7: 151198 events in 0 files, snapshot none (task 2940 ms: download 1732 ms overlapping gunzip 323 ms, parse 992 ms, sort 0 ms, write 0 ms, index 688 ms: 10 candidates, 83579 repo-hours, 453 releases; waiting 625 ms; commit 0 ms)
2026-11-08T15:36:28Z [load_day 2026-03-17] 2026-03-17 hour 8: 149966 events in 0 files, snapshot none (task 3359 ms: download 2131 ms overlapping gunzip 384 ms, parse 1173 ms, sort 0 ms, write 0 ms, index 647 ms: 5 candidates, 82460 repo-hours, 501 releases; waiting 859 ms; commit 0 ms)
2026-11-08T15:36:28Z [load_day 2026-03-17] 2026-03-17 hour 9: 154613 events in 0 files, snapshot none (task 3174 ms: download 2032 ms overlapping gunzip 316 ms, parse 1013 ms, sort 0 ms, write 0 ms, index 674 ms: 8 candidates, 88157 repo-hours, 350 releases; waiting 832 ms; commit 0 ms)
2026-11-08T15:36:31Z [load_day 2026-03-17] 2026-03-17 hour 10: 155232 events in 0 files, snapshot none (task 2374 ms: download 1204 ms overlapping gunzip 262 ms, parse 823 ms, sort 0 ms, write 0 ms, index 683 ms: 9 candidates, 87576 repo-hours, 280 releases; waiting 284 ms; commit 0 ms)
2026-11-08T15:36:32Z [load_day 2026-03-17] 2026-03-17 hour 11: 155310 events in 0 files, snapshot none (task 3214 ms: download 1766 ms overlapping gunzip 337 ms, parse 1003 ms, sort 0 ms, write 0 ms, index 721 ms: 9 candidates, 87095 repo-hours, 377 releases; waiting 869 ms; commit 0 ms)
2026-11-08T15:36:34Z [load_day 2026-03-17] 2026-03-17 hour 12: 157876 events in 0 files, snapshot none (task 2793 ms: download 1499 ms overlapping gunzip 246 ms, parse 832 ms, sort 0 ms, write 0 ms, index 839 ms: 11 candidates, 93184 repo-hours, 212 releases; waiting 599 ms; commit 0 ms)
2026-11-08T15:36:35Z [load_day 2026-03-17] 2026-03-17 hour 13: 156142 events in 0 files, snapshot none (task 2956 ms: download 1947 ms overlapping gunzip 237 ms, parse 813 ms, sort 0 ms, write 0 ms, index 699 ms: 12 candidates, 94723 repo-hours, 118 releases; waiting 926 ms; commit 0 ms)
2026-11-08T15:36:38Z [load_day 2026-03-17] 2026-03-17 hour 14: 156945 events in 0 files, snapshot none (task 2914 ms: download 1386 ms overlapping gunzip 258 ms, parse 831 ms, sort 0 ms, write 0 ms, index 977 ms: 11 candidates, 93746 repo-hours, 135 releases; waiting 401 ms; commit 0 ms)
2026-11-08T15:36:39Z [load_day 2026-03-17] 2026-03-17 hour 15: 149125 events in 0 files, snapshot none (task 3090 ms: download 1725 ms overlapping gunzip 376 ms, parse 1269 ms, sort 0 ms, write 0 ms, index 692 ms: 6 candidates, 87669 repo-hours, 159 releases; waiting 415 ms; commit 0 ms)
2026-11-08T15:36:41Z [load_day 2026-03-17] 2026-03-17 hour 16: 151096 events in 0 files, snapshot none (task 2801 ms: download 1660 ms overlapping gunzip 276 ms, parse 865 ms, sort 0 ms, write 0 ms, index 690 ms: 10 candidates, 87438 repo-hours, 155 releases; waiting 649 ms; commit 0 ms)
2026-11-08T15:36:43Z [load_day 2026-03-17] 2026-03-17 hour 17: 154237 events in 0 files, snapshot none (task 3172 ms: download 1866 ms overlapping gunzip 353 ms, parse 992 ms, sort 0 ms, write 0 ms, index 791 ms: 16 candidates, 88160 repo-hours, 127 releases; waiting 679 ms; commit 0 ms)
2026-11-08T15:36:45Z [load_day 2026-03-17] 2026-03-17 hour 18: 156557 events in 0 files, snapshot none (task 2839 ms: download 1665 ms overlapping gunzip 294 ms, parse 875 ms, sort 0 ms, write 0 ms, index 645 ms: 17 candidates, 86288 repo-hours, 202 releases; waiting 748 ms; commit 0 ms)
2026-11-08T15:36:47Z [load_day 2026-03-17] 2026-03-17 hour 19: 150667 events in 0 files, snapshot none (task 3520 ms: download 2048 ms overlapping gunzip 385 ms, parse 1171 ms, sort 0 ms, write 0 ms, index 857 ms: 12 candidates, 83249 repo-hours, 282 releases; waiting 770 ms; commit 0 ms)
2026-11-08T15:36:50Z [load_day 2026-03-17] 2026-03-17 hour 20: 149058 events in 0 files, snapshot none (task 4662 ms: download 2793 ms overlapping gunzip 408 ms, parse 1140 ms, sort 0 ms, write 0 ms, index 1230 ms: 8 candidates, 82184 repo-hours, 413 releases; waiting 1518 ms; commit 0 ms)
2026-11-08T15:36:51Z [load_day 2026-03-17] 2026-03-17 hour 21: 154690 events in 0 files, snapshot none (task 3684 ms: download 2306 ms overlapping gunzip 561 ms, parse 1614 ms, sort 0 ms, write 0 ms, index 596 ms: 11 candidates, 80446 repo-hours, 539 releases; waiting 608 ms; commit 0 ms)
2026-11-08T15:36:54Z [load_day 2026-03-17] 2026-03-17 hour 22: 147140 events in 0 files, snapshot none (task 3509 ms: download 2232 ms overlapping gunzip 415 ms, parse 1199 ms, sort 0 ms, write 0 ms, index 857 ms: 7 candidates, 75421 repo-hours, 852 releases; waiting 749 ms; commit 0 ms)
2026-11-08T15:36:56Z [load_day 2026-03-17] 2026-03-17 hour 23: 148376 events in 0 files, snapshot none (task 4291 ms: download 2842 ms overlapping gunzip 603 ms, parse 1742 ms, sort 0 ms, write 0 ms, index 590 ms: 6 candidates, 72744 repo-hours, 1142 releases; waiting 999 ms; commit 0 ms)
2026-11-08T15:37:06Z [load_day 2026-03-17] 2026-03-17: repo_hour merged from 24 files to 1 (2031468 rows, 10228 ms)
2026-11-08T15:37:09Z [load_day 2026-03-17] 2026-03-17: index committed in 13526 ms (24 + 1 + 24 files)
2026-11-08T15:37:09Z [load_day 2026-03-17] 2026-03-17: 3666779 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:37:09Z [load_day 2026-03-17] attempt 1 succeeded