orcaLog in

Runs · run 4457

load_day 2025-09-30, attempt 1 succeeded

Host
73ccef5e07c2:387935
Started
2026-11-08T14:03:59Z
Ended
2026-11-08T14:05:52Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
684 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
158.1 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4457/load_day/2025-09-30/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:03:59Z [load_day 2025-09-30] attempt 1 started
2026-11-08T14:04:00Z [load_day 2025-09-30] 2025-09-30: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:04:09Z [load_day 2025-09-30] 2025-09-30 hour 0: 174069 events in 0 files, snapshot none (task 8020 ms: download 5415 ms overlapping gunzip 1167 ms, parse 4577 ms, sort 0 ms, write 0 ms, index 588 ms: 6 candidates, 71161 repo-hours, 735 releases; waiting 1271 ms; commit 0 ms)
2026-11-08T14:04:09Z [load_day 2025-09-30] 2025-09-30 hour 1: 175363 events in 0 files, snapshot none (task 6975 ms: download 3970 ms overlapping gunzip 926 ms, parse 3869 ms, sort 0 ms, write 0 ms, index 910 ms: 5 candidates, 85994 repo-hours, 549 releases; waiting 715 ms; commit 0 ms)
2026-11-08T14:04:17Z [load_day 2025-09-30] 2025-09-30 hour 2: 167057 events in 0 files, snapshot none (task 7323 ms: download 4195 ms overlapping gunzip 1181 ms, parse 4686 ms, sort 0 ms, write 0 ms, index 579 ms: 6 candidates, 67100 repo-hours, 617 releases; waiting 633 ms; commit 0 ms)
2026-11-08T14:04:17Z [load_day 2025-09-30] 2025-09-30 hour 3: 164898 events in 0 files, snapshot none (task 7450 ms: download 4576 ms overlapping gunzip 1163 ms, parse 4478 ms, sort 0 ms, write 0 ms, index 574 ms: 7 candidates, 72003 repo-hours, 1686 releases; waiting 778 ms; commit 0 ms)
2026-11-08T14:04:24Z [load_day 2025-09-30] 2025-09-30 hour 4: 160827 events in 0 files, snapshot none (task 6191 ms: download 3944 ms overlapping gunzip 956 ms, parse 3634 ms, sort 0 ms, write 0 ms, index 695 ms: 5 candidates, 69464 repo-hours, 635 releases; waiting 562 ms; commit 0 ms)
2026-11-08T14:04:24Z [load_day 2025-09-30] 2025-09-30 hour 5: 160905 events in 0 files, snapshot none (task 5851 ms: download 3282 ms overlapping gunzip 902 ms, parse 3662 ms, sort 0 ms, write 0 ms, index 554 ms: 7 candidates, 67743 repo-hours, 684 releases; waiting 516 ms; commit 0 ms)
2026-11-08T14:04:30Z [load_day 2025-09-30] 2025-09-30 hour 6: 169290 events in 0 files, snapshot none (task 6001 ms: download 4237 ms overlapping gunzip 841 ms, parse 3386 ms, sort 0 ms, write 0 ms, index 667 ms: 10 candidates, 83678 repo-hours, 715 releases; waiting 746 ms; commit 0 ms)
2026-11-08T14:04:30Z [load_day 2025-09-30] 2025-09-30 hour 7: 170154 events in 0 files, snapshot none (task 6044 ms: download 3823 ms overlapping gunzip 916 ms, parse 3609 ms, sort 0 ms, write 0 ms, index 549 ms: 12 candidates, 77514 repo-hours, 675 releases; waiting 685 ms; commit 0 ms)
2026-11-08T14:04:39Z [load_day 2025-09-30] 2025-09-30 hour 8: 170149 events in 0 files, snapshot none (task 8275 ms: download 5377 ms overlapping gunzip 1332 ms, parse 5402 ms, sort 0 ms, write 0 ms, index 651 ms: 19 candidates, 81263 repo-hours, 772 releases; waiting 581 ms; commit 0 ms)
2026-11-08T14:04:39Z [load_day 2025-09-30] 2025-09-30 hour 9: 170052 events in 0 files, snapshot none (task 8050 ms: download 5375 ms overlapping gunzip 1184 ms, parse 4766 ms, sort 0 ms, write 0 ms, index 645 ms: 23 candidates, 79397 repo-hours, 794 releases; waiting 1120 ms; commit 0 ms)
2026-11-08T14:04:47Z [load_day 2025-09-30] 2025-09-30 hour 10: 173730 events in 0 files, snapshot none (task 7958 ms: download 4686 ms overlapping gunzip 1295 ms, parse 5146 ms, sort 0 ms, write 0 ms, index 719 ms: 14 candidates, 80975 repo-hours, 718 releases; waiting 502 ms; commit 0 ms)
2026-11-08T14:04:47Z [load_day 2025-09-30] 2025-09-30 hour 11: 172496 events in 0 files, snapshot none (task 7955 ms: download 4712 ms overlapping gunzip 1348 ms, parse 5247 ms, sort 0 ms, write 0 ms, index 693 ms: 18 candidates, 74488 repo-hours, 682 releases; waiting 238 ms; commit 0 ms)
2026-11-08T14:04:57Z [load_day 2025-09-30] 2025-09-30 hour 12: 173242 events in 0 files, snapshot none (task 8505 ms: download 5862 ms overlapping gunzip 1058 ms, parse 4396 ms, sort 0 ms, write 0 ms, index 697 ms: 14 candidates, 93666 repo-hours, 776 releases; waiting 2025 ms; commit 0 ms)
2026-11-08T14:04:57Z [load_day 2025-09-30] 2025-09-30 hour 13: 170215 events in 0 files, snapshot none (task 7216 ms: download 4256 ms overlapping gunzip 1154 ms, parse 4562 ms, sort 0 ms, write 0 ms, index 686 ms: 17 candidates, 88250 repo-hours, 745 releases; waiting 497 ms; commit 0 ms)
2026-11-08T14:05:05Z [load_day 2025-09-30] 2025-09-30 hour 14: 171622 events in 0 files, snapshot none (task 8035 ms: download 5396 ms overlapping gunzip 1274 ms, parse 5265 ms, sort 0 ms, write 0 ms, index 651 ms: 11 candidates, 83601 repo-hours, 861 releases; waiting 503 ms; commit 0 ms)
2026-11-08T14:05:05Z [load_day 2025-09-30] 2025-09-30 hour 15: 173343 events in 0 files, snapshot none (task 8009 ms: download 5428 ms overlapping gunzip 1271 ms, parse 5219 ms, sort 0 ms, write 0 ms, index 696 ms: 18 candidates, 84199 repo-hours, 890 releases; waiting 516 ms; commit 0 ms)
2026-11-08T14:05:14Z [load_day 2025-09-30] 2025-09-30 hour 16: 167779 events in 0 files, snapshot none (task 8344 ms: download 5633 ms overlapping gunzip 1301 ms, parse 5462 ms, sort 0 ms, write 0 ms, index 612 ms: 17 candidates, 80481 repo-hours, 868 releases; waiting 475 ms; commit 0 ms)
2026-11-08T14:05:14Z [load_day 2025-09-30] 2025-09-30 hour 17: 147058 events in 0 files, snapshot none (task 7185 ms: download 4209 ms overlapping gunzip 1155 ms, parse 4631 ms, sort 0 ms, write 0 ms, index 553 ms: 13 candidates, 65601 repo-hours, 726 releases; waiting 503 ms; commit 0 ms)
2026-11-08T14:05:22Z [load_day 2025-09-30] 2025-09-30 hour 18: 153594 events in 0 files, snapshot none (task 7529 ms: download 4573 ms overlapping gunzip 1148 ms, parse 4922 ms, sort 0 ms, write 0 ms, index 618 ms: 8 candidates, 73701 repo-hours, 704 releases; waiting 520 ms; commit 0 ms)
2026-11-08T14:05:23Z [load_day 2025-09-30] 2025-09-30 hour 19: 169173 events in 0 files, snapshot none (task 8697 ms: download 5992 ms overlapping gunzip 1486 ms, parse 5655 ms, sort 0 ms, write 0 ms, index 774 ms: 14 candidates, 73400 repo-hours, 886 releases; waiting 491 ms; commit 0 ms)
2026-11-08T14:05:31Z [load_day 2025-09-30] 2025-09-30 hour 20: 164973 events in 0 files, snapshot none (task 8798 ms: download 6404 ms overlapping gunzip 1298 ms, parse 5330 ms, sort 0 ms, write 0 ms, index 601 ms: 9 candidates, 70126 repo-hours, 736 releases; waiting 1308 ms; commit 0 ms)
2026-11-08T14:05:31Z [load_day 2025-09-30] 2025-09-30 hour 21: 164798 events in 0 files, snapshot none (task 7488 ms: download 4845 ms overlapping gunzip 1190 ms, parse 4725 ms, sort 0 ms, write 0 ms, index 651 ms: 18 candidates, 69078 repo-hours, 716 releases; waiting 669 ms; commit 0 ms)
2026-11-08T14:05:40Z [load_day 2025-09-30] 2025-09-30 hour 22: 159762 events in 0 files, snapshot none (task 8236 ms: download 5828 ms overlapping gunzip 1303 ms, parse 4961 ms, sort 0 ms, write 0 ms, index 524 ms: 11 candidates, 62587 repo-hours, 770 releases; waiting 1119 ms; commit 0 ms)
2026-11-08T14:05:40Z [load_day 2025-09-30] 2025-09-30 hour 23: 159968 events in 0 files, snapshot none (task 7923 ms: download 4646 ms overlapping gunzip 1287 ms, parse 5322 ms, sort 0 ms, write 0 ms, index 486 ms: 5 candidates, 58338 repo-hours, 765 releases; waiting 480 ms; commit 0 ms)
2026-11-08T14:05:49Z [load_day 2025-09-30] 2025-09-30: repo_hour merged from 24 files to 1 (1813808 rows, 8952 ms)
2026-11-08T14:05:52Z [load_day 2025-09-30] 2025-09-30: index committed in 11991 ms (24 + 1 + 24 files)
2026-11-08T14:05:52Z [load_day 2025-09-30] 2025-09-30: 4004517 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:05:52Z [load_day 2025-09-30] attempt 1 succeeded