orcaLog in

Runs · run 2960

load_day 2024-09-14, attempt 1 succeeded

Host
73ccef5e07c2:177634
Started
2026-11-08T07:55:06Z
Ended
2026-11-08T07:56:25Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
637 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
112.8 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2960/load_day/2024-09-14/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:55:06Z [load_day 2024-09-14] attempt 1 started
2026-11-08T07:55:07Z [load_day 2024-09-14] 2024-09-14: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:55:13Z [load_day 2024-09-14] 2024-09-14 hour 0: 162180 events in 0 files, snapshot none (task 5829 ms: download 2927 ms overlapping gunzip 776 ms, parse 3202 ms, sort 0 ms, write 0 ms, index 983 ms: 6 candidates, 84172 repo-hours, 1101 releases; waiting 515 ms; commit 0 ms)
2026-11-08T07:55:15Z [load_day 2024-09-14] 2024-09-14 hour 1: 173511 events in 0 files, snapshot none (task 7726 ms: download 4806 ms overlapping gunzip 861 ms, parse 3860 ms, sort 0 ms, write 0 ms, index 961 ms: 10 candidates, 98080 repo-hours, 802 releases; waiting 1364 ms; commit 0 ms)
2026-11-08T07:55:19Z [load_day 2024-09-14] 2024-09-14 hour 2: 139604 events in 0 files, snapshot none (task 5031 ms: download 2418 ms overlapping gunzip 750 ms, parse 3176 ms, sort 0 ms, write 0 ms, index 562 ms: 5 candidates, 63039 repo-hours, 866 releases; waiting 181 ms; commit 0 ms)
2026-11-08T07:55:20Z [load_day 2024-09-14] 2024-09-14 hour 3: 158083 events in 0 files, snapshot none (task 4648 ms: download 2242 ms overlapping gunzip 604 ms, parse 2696 ms, sort 0 ms, write 0 ms, index 552 ms: 1 candidates, 64271 repo-hours, 4031 releases; waiting 474 ms; commit 0 ms)
2026-11-08T07:55:24Z [load_day 2024-09-14] 2024-09-14 hour 4: 134441 events in 0 files, snapshot none (task 5059 ms: download 3542 ms overlapping gunzip 657 ms, parse 2784 ms, sort 0 ms, write 0 ms, index 644 ms: 5 candidates, 50114 repo-hours, 583 releases; waiting 689 ms; commit 0 ms)
2026-11-08T07:55:26Z [load_day 2024-09-14] 2024-09-14 hour 5: 140298 events in 0 files, snapshot none (task 5387 ms: download 2462 ms overlapping gunzip 772 ms, parse 3157 ms, sort 0 ms, write 0 ms, index 626 ms: 7 candidates, 54572 repo-hours, 819 releases; waiting 497 ms; commit 0 ms)
2026-11-08T07:55:29Z [load_day 2024-09-14] 2024-09-14 hour 6: 169689 events in 0 files, snapshot none (task 4747 ms: download 3360 ms overlapping gunzip 673 ms, parse 2800 ms, sort 0 ms, write 0 ms, index 590 ms: 8 candidates, 76637 repo-hours, 1279 releases; waiting 352 ms; commit 0 ms)
2026-11-08T07:55:32Z [load_day 2024-09-14] 2024-09-14 hour 7: 158687 events in 0 files, snapshot none (task 5030 ms: download 2662 ms overlapping gunzip 634 ms, parse 2583 ms, sort 0 ms, write 0 ms, index 951 ms: 6 candidates, 61657 repo-hours, 980 releases; waiting 528 ms; commit 0 ms)
2026-11-08T07:55:36Z [load_day 2024-09-14] 2024-09-14 hour 8: 161118 events in 0 files, snapshot none (task 6217 ms: download 3549 ms overlapping gunzip 944 ms, parse 3803 ms, sort 0 ms, write 0 ms, index 669 ms: 11 candidates, 66044 repo-hours, 930 releases; waiting 501 ms; commit 0 ms)
2026-11-08T07:55:39Z [load_day 2024-09-14] 2024-09-14 hour 9: 172666 events in 0 files, snapshot none (task 6366 ms: download 3960 ms overlapping gunzip 666 ms, parse 3105 ms, sort 0 ms, write 0 ms, index 544 ms: 5 candidates, 72392 repo-hours, 1069 releases; waiting 1798 ms; commit 0 ms)
2026-11-08T07:55:41Z [load_day 2024-09-14] 2024-09-14 hour 10: 158161 events in 0 files, snapshot none (task 4367 ms: download 2042 ms overlapping gunzip 557 ms, parse 2475 ms, sort 0 ms, write 0 ms, index 665 ms: 5 candidates, 63531 repo-hours, 836 releases; waiting 379 ms; commit 0 ms)
2026-11-08T07:55:44Z [load_day 2024-09-14] 2024-09-14 hour 11: 159079 events in 0 files, snapshot none (task 4876 ms: download 2620 ms overlapping gunzip 679 ms, parse 2783 ms, sort 0 ms, write 0 ms, index 586 ms: 8 candidates, 58945 repo-hours, 723 releases; waiting 517 ms; commit 0 ms)
2026-11-08T07:55:47Z [load_day 2024-09-14] 2024-09-14 hour 12: 224008 events in 0 files, snapshot none (task 5697 ms: download 2922 ms overlapping gunzip 689 ms, parse 3212 ms, sort 0 ms, write 0 ms, index 942 ms: 8 candidates, 106446 repo-hours, 856 releases; waiting 507 ms; commit 0 ms)
2026-11-08T07:55:51Z [load_day 2024-09-14] 2024-09-14 hour 13: 191756 events in 0 files, snapshot none (task 6118 ms: download 2716 ms overlapping gunzip 824 ms, parse 3642 ms, sort 0 ms, write 0 ms, index 995 ms: 14 candidates, 87360 repo-hours, 867 releases; waiting 364 ms; commit 0 ms)
2026-11-08T07:55:53Z [load_day 2024-09-14] 2024-09-14 hour 14: 175977 events in 0 files, snapshot none (task 5230 ms: download 2966 ms overlapping gunzip 717 ms, parse 3044 ms, sort 0 ms, write 0 ms, index 580 ms: 12 candidates, 68760 repo-hours, 885 releases; waiting 511 ms; commit 0 ms)
2026-11-08T07:55:57Z [load_day 2024-09-14] 2024-09-14 hour 15: 186376 events in 0 files, snapshot none (task 5212 ms: download 3302 ms overlapping gunzip 710 ms, parse 3054 ms, sort 0 ms, write 0 ms, index 672 ms: 21 candidates, 78383 repo-hours, 1021 releases; waiting 487 ms; commit 0 ms)
2026-11-08T07:55:58Z [load_day 2024-09-14] 2024-09-14 hour 16: 172048 events in 0 files, snapshot none (task 4887 ms: download 2270 ms overlapping gunzip 617 ms, parse 2733 ms, sort 0 ms, write 0 ms, index 701 ms: 6 candidates, 69815 repo-hours, 827 releases; waiting 506 ms; commit 0 ms)
2026-11-08T07:56:01Z [load_day 2024-09-14] 2024-09-14 hour 17: 164296 events in 0 files, snapshot none (task 4023 ms: download 1688 ms overlapping gunzip 555 ms, parse 2432 ms, sort 0 ms, write 0 ms, index 534 ms: 8 candidates, 64151 repo-hours, 774 releases; waiting 173 ms; commit 0 ms)
2026-11-08T07:56:03Z [load_day 2024-09-14] 2024-09-14 hour 18: 177186 events in 0 files, snapshot none (task 4577 ms: download 2382 ms overlapping gunzip 601 ms, parse 2634 ms, sort 0 ms, write 0 ms, index 619 ms: 7 candidates, 78157 repo-hours, 928 releases; waiting 398 ms; commit 0 ms)
2026-11-08T07:56:06Z [load_day 2024-09-14] 2024-09-14 hour 19: 158400 events in 0 files, snapshot none (task 4288 ms: download 2195 ms overlapping gunzip 557 ms, parse 2480 ms, sort 0 ms, write 0 ms, index 436 ms: 14 candidates, 60228 repo-hours, 851 releases; waiting 488 ms; commit 0 ms)
2026-11-08T07:56:09Z [load_day 2024-09-14] 2024-09-14 hour 20: 154418 events in 0 files, snapshot none (task 4738 ms: download 3281 ms overlapping gunzip 565 ms, parse 2495 ms, sort 0 ms, write 0 ms, index 819 ms: 8 candidates, 60942 repo-hours, 758 releases; waiting 567 ms; commit 0 ms)
2026-11-08T07:56:11Z [load_day 2024-09-14] 2024-09-14 hour 21: 144705 events in 0 files, snapshot none (task 4443 ms: download 2170 ms overlapping gunzip 549 ms, parse 2428 ms, sort 0 ms, write 0 ms, index 610 ms: 7 candidates, 55699 repo-hours, 933 releases; waiting 536 ms; commit 0 ms)
2026-11-08T07:56:13Z [load_day 2024-09-14] 2024-09-14 hour 22: 138345 events in 0 files, snapshot none (task 3815 ms: download 2393 ms overlapping gunzip 439 ms, parse 1977 ms, sort 0 ms, write 0 ms, index 663 ms: 5 candidates, 47763 repo-hours, 878 releases; waiting 475 ms; commit 0 ms)
2026-11-08T07:56:15Z [load_day 2024-09-14] 2024-09-14 hour 23: 121156 events in 0 files, snapshot none (task 3394 ms: download 1120 ms overlapping gunzip 464 ms, parse 2116 ms, sort 0 ms, write 0 ms, index 324 ms: 23 candidates, 44037 repo-hours, 597 releases; waiting 222 ms; commit 0 ms)
2026-11-08T07:56:22Z [load_day 2024-09-14] 2024-09-14: repo_hour merged from 24 files to 1 (1635195 rows, 7137 ms)
2026-11-08T07:56:25Z [load_day 2024-09-14] 2024-09-14: index committed in 9877 ms (24 + 1 + 24 files)
2026-11-08T07:56:25Z [load_day 2024-09-14] 2024-09-14: 3896188 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:56:25Z [load_day 2024-09-14] attempt 1 succeeded