orcaLog in

Runs · run 4114

load_day 2025-07-05, attempt 1 succeeded

Host
73ccef5e07c2:338067
Started
2026-11-08T12:48:41Z
Ended
2026-11-08T12:49:59Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
634 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
107.8 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4114/load_day/2025-07-05/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:48:41Z [load_day 2025-07-05] attempt 1 started
2026-11-08T12:48:41Z [load_day 2025-07-05] 2025-07-05: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:48:48Z [load_day 2025-07-05] 2025-07-05 hour 0: 135574 events in 0 files, snapshot none (task 5804 ms: download 3037 ms overlapping gunzip 852 ms, parse 3652 ms, sort 0 ms, write 0 ms, index 449 ms: 7 candidates, 63376 repo-hours, 918 releases; waiting 552 ms; commit 0 ms)
2026-11-08T12:48:48Z [load_day 2025-07-05] 2025-07-05 hour 1: 146391 events in 0 files, snapshot none (task 5557 ms: download 2448 ms overlapping gunzip 785 ms, parse 3244 ms, sort 0 ms, write 0 ms, index 668 ms: 5 candidates, 82364 repo-hours, 647 releases; waiting 489 ms; commit 0 ms)
2026-11-08T12:48:53Z [load_day 2025-07-05] 2025-07-05 hour 2: 130438 events in 0 files, snapshot none (task 4843 ms: download 2108 ms overlapping gunzip 599 ms, parse 2706 ms, sort 0 ms, write 0 ms, index 1026 ms: 8 candidates, 59643 repo-hours, 702 releases; waiting 299 ms; commit 0 ms)
2026-11-08T12:48:53Z [load_day 2025-07-05] 2025-07-05 hour 3: 137738 events in 0 files, snapshot none (task 5357 ms: download 2946 ms overlapping gunzip 772 ms, parse 3134 ms, sort 0 ms, write 0 ms, index 472 ms: 0 candidates, 59293 repo-hours, 1929 releases; waiting 648 ms; commit 0 ms)
2026-11-08T12:48:58Z [load_day 2025-07-05] 2025-07-05 hour 4: 134047 events in 0 files, snapshot none (task 4234 ms: download 2411 ms overlapping gunzip 567 ms, parse 2366 ms, sort 0 ms, write 0 ms, index 500 ms: 9 candidates, 55388 repo-hours, 831 releases; waiting 478 ms; commit 0 ms)
2026-11-08T12:48:59Z [load_day 2025-07-05] 2025-07-05 hour 5: 136425 events in 0 files, snapshot none (task 4530 ms: download 3007 ms overlapping gunzip 627 ms, parse 2452 ms, sort 0 ms, write 0 ms, index 515 ms: 6 candidates, 58138 repo-hours, 611 releases; waiting 663 ms; commit 0 ms)
2026-11-08T12:49:02Z [load_day 2025-07-05] 2025-07-05 hour 6: 143860 events in 0 files, snapshot none (task 4229 ms: download 2563 ms overlapping gunzip 570 ms, parse 2304 ms, sort 0 ms, write 0 ms, index 550 ms: 2 candidates, 66936 repo-hours, 826 releases; waiting 504 ms; commit 0 ms)
2026-11-08T12:49:05Z [load_day 2025-07-05] 2025-07-05 hour 7: 146942 events in 0 files, snapshot none (task 5459 ms: download 3039 ms overlapping gunzip 583 ms, parse 2530 ms, sort 0 ms, write 0 ms, index 862 ms: 5 candidates, 62021 repo-hours, 681 releases; waiting 1082 ms; commit 0 ms)
2026-11-08T12:49:08Z [load_day 2025-07-05] 2025-07-05 hour 8: 145341 events in 0 files, snapshot none (task 4895 ms: download 2046 ms overlapping gunzip 694 ms, parse 2975 ms, sort 0 ms, write 0 ms, index 716 ms: 14 candidates, 65147 repo-hours, 732 releases; waiting 280 ms; commit 0 ms)
2026-11-08T12:49:10Z [load_day 2025-07-05] 2025-07-05 hour 9: 147897 events in 0 files, snapshot none (task 4569 ms: download 2521 ms overlapping gunzip 531 ms, parse 2275 ms, sort 0 ms, write 0 ms, index 742 ms: 14 candidates, 64983 repo-hours, 828 releases; waiting 548 ms; commit 0 ms)
2026-11-08T12:49:13Z [load_day 2025-07-05] 2025-07-05 hour 10: 149671 events in 0 files, snapshot none (task 5151 ms: download 2890 ms overlapping gunzip 710 ms, parse 3086 ms, sort 0 ms, write 0 ms, index 522 ms: 4 candidates, 68230 repo-hours, 618 releases; waiting 544 ms; commit 0 ms)
2026-11-08T12:49:16Z [load_day 2025-07-05] 2025-07-05 hour 11: 146382 events in 0 files, snapshot none (task 6023 ms: download 3708 ms overlapping gunzip 602 ms, parse 2558 ms, sort 0 ms, write 0 ms, index 635 ms: 6 candidates, 62907 repo-hours, 570 releases; waiting 1870 ms; commit 0 ms)
2026-11-08T12:49:18Z [load_day 2025-07-05] 2025-07-05 hour 12: 161217 events in 0 files, snapshot none (task 4477 ms: download 2336 ms overlapping gunzip 570 ms, parse 2398 ms, sort 0 ms, write 0 ms, index 659 ms: 9 candidates, 87797 repo-hours, 619 releases; waiting 514 ms; commit 0 ms)
2026-11-08T12:49:21Z [load_day 2025-07-05] 2025-07-05 hour 13: 157335 events in 0 files, snapshot none (task 4435 ms: download 2646 ms overlapping gunzip 566 ms, parse 2487 ms, sort 0 ms, write 0 ms, index 561 ms: 2 candidates, 78050 repo-hours, 681 releases; waiting 507 ms; commit 0 ms)
2026-11-08T12:49:23Z [load_day 2025-07-05] 2025-07-05 hour 14: 151258 events in 0 files, snapshot none (task 4023 ms: download 2228 ms overlapping gunzip 575 ms, parse 2392 ms, sort 0 ms, write 0 ms, index 587 ms: 5 candidates, 66905 repo-hours, 762 releases; waiting 185 ms; commit 0 ms)
2026-11-08T12:49:26Z [load_day 2025-07-05] 2025-07-05 hour 15: 151644 events in 0 files, snapshot none (task 4176 ms: download 2963 ms overlapping gunzip 590 ms, parse 2402 ms, sort 0 ms, write 0 ms, index 517 ms: 3 candidates, 70776 repo-hours, 792 releases; waiting 432 ms; commit 0 ms)
2026-11-08T12:49:28Z [load_day 2025-07-05] 2025-07-05 hour 16: 157268 events in 0 files, snapshot none (task 4979 ms: download 3023 ms overlapping gunzip 612 ms, parse 2576 ms, sort 0 ms, write 0 ms, index 816 ms: 8 candidates, 70669 repo-hours, 704 releases; waiting 662 ms; commit 0 ms)
2026-11-08T12:49:32Z [load_day 2025-07-05] 2025-07-05 hour 17: 146525 events in 0 files, snapshot none (task 5084 ms: download 2917 ms overlapping gunzip 681 ms, parse 3030 ms, sort 0 ms, write 0 ms, index 512 ms: 4 candidates, 63082 repo-hours, 667 releases; waiting 496 ms; commit 0 ms)
2026-11-08T12:49:33Z [load_day 2025-07-05] 2025-07-05 hour 18: 152548 events in 0 files, snapshot none (task 4561 ms: download 2671 ms overlapping gunzip 648 ms, parse 2695 ms, sort 0 ms, write 0 ms, index 605 ms: 5 candidates, 71968 repo-hours, 789 releases; waiting 294 ms; commit 0 ms)
2026-11-08T12:49:38Z [load_day 2025-07-05] 2025-07-05 hour 19: 145901 events in 0 files, snapshot none (task 5583 ms: download 2913 ms overlapping gunzip 857 ms, parse 3581 ms, sort 0 ms, write 0 ms, index 452 ms: 10 candidates, 59852 repo-hours, 679 releases; waiting 351 ms; commit 0 ms)
2026-11-08T12:49:39Z [load_day 2025-07-05] 2025-07-05 hour 20: 141153 events in 0 files, snapshot none (task 4616 ms: download 2991 ms overlapping gunzip 660 ms, parse 2719 ms, sort 0 ms, write 0 ms, index 404 ms: 6 candidates, 60585 repo-hours, 789 releases; waiting 543 ms; commit 0 ms)
2026-11-08T12:49:44Z [load_day 2025-07-05] 2025-07-05 hour 21: 137822 events in 0 files, snapshot none (task 5212 ms: download 2902 ms overlapping gunzip 730 ms, parse 3083 ms, sort 0 ms, write 0 ms, index 505 ms: 6 candidates, 55801 repo-hours, 1078 releases; waiting 513 ms; commit 0 ms)
2026-11-08T12:49:44Z [load_day 2025-07-05] 2025-07-05 hour 22: 130815 events in 0 files, snapshot none (task 4742 ms: download 2242 ms overlapping gunzip 768 ms, parse 3002 ms, sort 0 ms, write 0 ms, index 369 ms: 3 candidates, 52143 repo-hours, 843 releases; waiting 305 ms; commit 0 ms)
2026-11-08T12:49:49Z [load_day 2025-07-05] 2025-07-05 hour 23: 125370 events in 0 files, snapshot none (task 5078 ms: download 2701 ms overlapping gunzip 574 ms, parse 2477 ms, sort 0 ms, write 0 ms, index 1349 ms: 1 candidates, 49783 repo-hours, 821 releases; waiting 404 ms; commit 0 ms)
2026-11-08T12:49:56Z [load_day 2025-07-05] 2025-07-05: repo_hour merged from 24 files to 1 (1555837 rows, 6991 ms)
2026-11-08T12:49:59Z [load_day 2025-07-05] 2025-07-05: index committed in 9650 ms (23 + 1 + 24 files)
2026-11-08T12:49:59Z [load_day 2025-07-05] 2025-07-05: 3459562 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:49:59Z [load_day 2025-07-05] attempt 1 succeeded