orcaLog in

Runs · run 2380

load_day 2024-04-27, attempt 1 succeeded

Host
73ccef5e07c2:115065
Started
2026-11-08T05:49:25Z
Ended
2026-11-08T05:50:48Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
614 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
120.7 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2380/load_day/2024-04-27/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:49:25Z [load_day 2024-04-27] attempt 1 started
2026-11-08T05:49:26Z [load_day 2024-04-27] 2024-04-27: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:49:33Z [load_day 2024-04-27] 2024-04-27 hour 0: 179791 events in 0 files, snapshot none (task 6738 ms: download 3904 ms overlapping gunzip 991 ms, parse 4369 ms, sort 0 ms, write 0 ms, index 612 ms: 9 candidates, 86479 repo-hours, 1127 releases; waiting 496 ms; commit 0 ms)
2026-11-08T05:49:33Z [load_day 2024-04-27] 2024-04-27 hour 1: 169301 events in 0 files, snapshot none (task 6713 ms: download 3983 ms overlapping gunzip 913 ms, parse 4412 ms, sort 0 ms, write 0 ms, index 632 ms: 6 candidates, 85154 repo-hours, 734 releases; waiting 453 ms; commit 0 ms)
2026-11-08T05:49:39Z [load_day 2024-04-27] 2024-04-27 hour 2: 139987 events in 0 files, snapshot none (task 5513 ms: download 2874 ms overlapping gunzip 771 ms, parse 3510 ms, sort 0 ms, write 0 ms, index 390 ms: 4 candidates, 49050 repo-hours, 632 releases; waiting 516 ms; commit 0 ms)
2026-11-08T05:49:39Z [load_day 2024-04-27] 2024-04-27 hour 3: 163704 events in 0 files, snapshot none (task 5785 ms: download 2406 ms overlapping gunzip 860 ms, parse 3688 ms, sort 0 ms, write 0 ms, index 415 ms: 3 candidates, 52349 repo-hours, 2596 releases; waiting 478 ms; commit 0 ms)
2026-11-08T05:49:44Z [load_day 2024-04-27] 2024-04-27 hour 4: 136020 events in 0 files, snapshot none (task 4823 ms: download 2627 ms overlapping gunzip 632 ms, parse 2949 ms, sort 0 ms, write 0 ms, index 414 ms: 5 candidates, 50025 repo-hours, 562 releases; waiting 506 ms; commit 0 ms)
2026-11-08T05:49:45Z [load_day 2024-04-27] 2024-04-27 hour 5: 149822 events in 0 files, snapshot none (task 4744 ms: download 2339 ms overlapping gunzip 676 ms, parse 2797 ms, sort 0 ms, write 0 ms, index 500 ms: 9 candidates, 52266 repo-hours, 673 releases; waiting 487 ms; commit 0 ms)
2026-11-08T05:49:50Z [load_day 2024-04-27] 2024-04-27 hour 6: 181011 events in 0 files, snapshot none (task 5687 ms: download 2914 ms overlapping gunzip 813 ms, parse 3461 ms, sort 0 ms, write 0 ms, index 512 ms: 5 candidates, 65891 repo-hours, 892 releases; waiting 504 ms; commit 0 ms)
2026-11-08T05:49:51Z [load_day 2024-04-27] 2024-04-27 hour 7: 157350 events in 0 files, snapshot none (task 5430 ms: download 3721 ms overlapping gunzip 773 ms, parse 3225 ms, sort 0 ms, write 0 ms, index 481 ms: 13 candidates, 58238 repo-hours, 860 releases; waiting 512 ms; commit 0 ms)
2026-11-08T05:49:57Z [load_day 2024-04-27] 2024-04-27 hour 8: 165747 events in 0 files, snapshot none (task 6193 ms: download 3131 ms overlapping gunzip 955 ms, parse 3940 ms, sort 0 ms, write 0 ms, index 471 ms: 5 candidates, 64676 repo-hours, 821 releases; waiting 514 ms; commit 0 ms)
2026-11-08T05:49:57Z [load_day 2024-04-27] 2024-04-27 hour 9: 168138 events in 0 files, snapshot none (task 5851 ms: download 3094 ms overlapping gunzip 802 ms, parse 3722 ms, sort 0 ms, write 0 ms, index 520 ms: 1 candidates, 63327 repo-hours, 1174 releases; waiting 499 ms; commit 0 ms)
2026-11-08T05:50:03Z [load_day 2024-04-27] 2024-04-27 hour 10: 164187 events in 0 files, snapshot none (task 5352 ms: download 2436 ms overlapping gunzip 708 ms, parse 3174 ms, sort 0 ms, write 0 ms, index 776 ms: 2 candidates, 61617 repo-hours, 938 releases; waiting 469 ms; commit 0 ms)
2026-11-08T05:50:03Z [load_day 2024-04-27] 2024-04-27 hour 11: 161818 events in 0 files, snapshot none (task 5073 ms: download 2270 ms overlapping gunzip 689 ms, parse 2961 ms, sort 0 ms, write 0 ms, index 830 ms: 5 candidates, 58930 repo-hours, 735 releases; waiting 231 ms; commit 0 ms)
2026-11-08T05:50:09Z [load_day 2024-04-27] 2024-04-27 hour 12: 246644 events in 0 files, snapshot none (task 5840 ms: download 2934 ms overlapping gunzip 755 ms, parse 3669 ms, sort 0 ms, write 0 ms, index 667 ms: 7 candidates, 98372 repo-hours, 820 releases; waiting 452 ms; commit 0 ms)
2026-11-08T05:50:09Z [load_day 2024-04-27] 2024-04-27 hour 13: 200231 events in 0 files, snapshot none (task 5760 ms: download 3184 ms overlapping gunzip 751 ms, parse 3578 ms, sort 0 ms, write 0 ms, index 628 ms: 8 candidates, 88875 repo-hours, 840 releases; waiting 502 ms; commit 0 ms)
2026-11-08T05:50:16Z [load_day 2024-04-27] 2024-04-27 hour 14: 185616 events in 0 files, snapshot none (task 5669 ms: download 3093 ms overlapping gunzip 751 ms, parse 3549 ms, sort 0 ms, write 0 ms, index 594 ms: 12 candidates, 70097 repo-hours, 877 releases; waiting 516 ms; commit 0 ms)
2026-11-08T05:50:16Z [load_day 2024-04-27] 2024-04-27 hour 15: 192540 events in 0 files, snapshot none (task 5642 ms: download 3035 ms overlapping gunzip 769 ms, parse 3623 ms, sort 0 ms, write 0 ms, index 599 ms: 12 candidates, 73478 repo-hours, 898 releases; waiting 381 ms; commit 0 ms)
2026-11-08T05:50:22Z [load_day 2024-04-27] 2024-04-27 hour 16: 194771 events in 0 files, snapshot none (task 5436 ms: download 3284 ms overlapping gunzip 716 ms, parse 3253 ms, sort 0 ms, write 0 ms, index 576 ms: 14 candidates, 77147 repo-hours, 868 releases; waiting 541 ms; commit 0 ms)
2026-11-08T05:50:22Z [load_day 2024-04-27] 2024-04-27 hour 17: 178357 events in 0 files, snapshot none (task 4776 ms: download 3064 ms overlapping gunzip 649 ms, parse 2858 ms, sort 0 ms, write 0 ms, index 448 ms: 10 candidates, 63303 repo-hours, 770 releases; waiting 538 ms; commit 0 ms)
2026-11-08T05:50:28Z [load_day 2024-04-27] 2024-04-27 hour 18: 185906 events in 0 files, snapshot none (task 5781 ms: download 3000 ms overlapping gunzip 775 ms, parse 3546 ms, sort 0 ms, write 0 ms, index 614 ms: 16 candidates, 74526 repo-hours, 912 releases; waiting 531 ms; commit 0 ms)
2026-11-08T05:50:28Z [load_day 2024-04-27] 2024-04-27 hour 19: 162561 events in 0 files, snapshot none (task 5544 ms: download 3432 ms overlapping gunzip 747 ms, parse 3338 ms, sort 0 ms, write 0 ms, index 523 ms: 6 candidates, 57348 repo-hours, 759 releases; waiting 554 ms; commit 0 ms)
2026-11-08T05:50:34Z [load_day 2024-04-27] 2024-04-27 hour 20: 166295 events in 0 files, snapshot none (task 5400 ms: download 2921 ms overlapping gunzip 757 ms, parse 3342 ms, sort 0 ms, write 0 ms, index 465 ms: 6 candidates, 56853 repo-hours, 686 releases; waiting 533 ms; commit 0 ms)
2026-11-08T05:50:34Z [load_day 2024-04-27] 2024-04-27 hour 21: 150263 events in 0 files, snapshot none (task 4579 ms: download 2495 ms overlapping gunzip 604 ms, parse 2753 ms, sort 0 ms, write 0 ms, index 440 ms: 8 candidates, 54289 repo-hours, 739 releases; waiting 486 ms; commit 0 ms)
2026-11-08T05:50:39Z [load_day 2024-04-27] 2024-04-27 hour 22: 142025 events in 0 files, snapshot none (task 4450 ms: download 2161 ms overlapping gunzip 522 ms, parse 2627 ms, sort 0 ms, write 0 ms, index 464 ms: 10 candidates, 47508 repo-hours, 976 releases; waiting 529 ms; commit 0 ms)
2026-11-08T05:50:39Z [load_day 2024-04-27] 2024-04-27 hour 23: 132811 events in 0 files, snapshot none (task 4259 ms: download 2115 ms overlapping gunzip 550 ms, parse 2535 ms, sort 0 ms, write 0 ms, index 362 ms: 10 candidates, 44895 repo-hours, 656 releases; waiting 501 ms; commit 0 ms)
2026-11-08T05:50:46Z [load_day 2024-04-27] 2024-04-27: repo_hour merged from 24 files to 1 (1554693 rows, 7347 ms)
2026-11-08T05:50:48Z [load_day 2024-04-27] 2024-04-27: index committed in 9717 ms (24 + 1 + 24 files)
2026-11-08T05:50:48Z [load_day 2024-04-27] 2024-04-27: 4074896 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:50:48Z [load_day 2024-04-27] attempt 1 succeeded