orcaLog in

Runs · run 3360

load_day 2024-12-25, attempt 1 succeeded

Host
73ccef5e07c2:227874
Started
2026-11-08T09:32:02Z
Ended
2026-11-08T09:33:18Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
636 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
108.8 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3360/load_day/2024-12-25/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:32:02Z [load_day 2024-12-25] attempt 1 started
2026-11-08T09:32:03Z [load_day 2024-12-25] 2024-12-25: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:32:08Z [load_day 2024-12-25] 2024-12-25 hour 0: 140821 events in 0 files, snapshot none (task 4852 ms: download 2513 ms overlapping gunzip 707 ms, parse 2953 ms, sort 0 ms, write 0 ms, index 565 ms: 6 candidates, 69926 repo-hours, 1060 releases; waiting 183 ms; commit 0 ms)
2026-11-08T09:32:08Z [load_day 2024-12-25] 2024-12-25 hour 1: 160336 events in 0 files, snapshot none (task 5103 ms: download 2481 ms overlapping gunzip 695 ms, parse 2992 ms, sort 0 ms, write 0 ms, index 643 ms: 7 candidates, 90770 repo-hours, 944 releases; waiting 451 ms; commit 0 ms)
2026-11-08T09:32:14Z [load_day 2024-12-25] 2024-12-25 hour 2: 135019 events in 0 files, snapshot none (task 5503 ms: download 2968 ms overlapping gunzip 801 ms, parse 3189 ms, sort 0 ms, write 0 ms, index 548 ms: 4 candidates, 61612 repo-hours, 734 releases; waiting 515 ms; commit 0 ms)
2026-11-08T09:32:15Z [load_day 2024-12-25] 2024-12-25 hour 3: 155068 events in 0 files, snapshot none (task 5819 ms: download 2890 ms overlapping gunzip 853 ms, parse 3645 ms, sort 0 ms, write 0 ms, index 464 ms: 5 candidates, 60889 repo-hours, 3879 releases; waiting 500 ms; commit 0 ms)
2026-11-08T09:32:20Z [load_day 2024-12-25] 2024-12-25 hour 4: 136017 events in 0 files, snapshot none (task 4652 ms: download 1836 ms overlapping gunzip 601 ms, parse 2640 ms, sort 0 ms, write 0 ms, index 595 ms: 6 candidates, 47503 repo-hours, 578 releases; waiting 525 ms; commit 0 ms)
2026-11-08T09:32:20Z [load_day 2024-12-25] 2024-12-25 hour 5: 147858 events in 0 files, snapshot none (task 5087 ms: download 2211 ms overlapping gunzip 785 ms, parse 3074 ms, sort 0 ms, write 0 ms, index 450 ms: 4 candidates, 53319 repo-hours, 634 releases; waiting 479 ms; commit 0 ms)
2026-11-08T09:32:25Z [load_day 2024-12-25] 2024-12-25 hour 6: 172769 events in 0 files, snapshot none (task 5013 ms: download 2321 ms overlapping gunzip 624 ms, parse 2745 ms, sort 0 ms, write 0 ms, index 869 ms: 8 candidates, 77454 repo-hours, 815 releases; waiting 474 ms; commit 0 ms)
2026-11-08T09:32:26Z [load_day 2024-12-25] 2024-12-25 hour 7: 163219 events in 0 files, snapshot none (task 5499 ms: download 2712 ms overlapping gunzip 777 ms, parse 3404 ms, sort 0 ms, write 0 ms, index 503 ms: 4 candidates, 61623 repo-hours, 706 releases; waiting 484 ms; commit 0 ms)
2026-11-08T09:32:31Z [load_day 2024-12-25] 2024-12-25 hour 8: 167407 events in 0 files, snapshot none (task 4845 ms: download 2116 ms overlapping gunzip 650 ms, parse 2674 ms, sort 0 ms, write 0 ms, index 904 ms: 6 candidates, 66357 repo-hours, 741 releases; waiting 300 ms; commit 0 ms)
2026-11-08T09:32:32Z [load_day 2024-12-25] 2024-12-25 hour 9: 176126 events in 0 files, snapshot none (task 5239 ms: download 3728 ms overlapping gunzip 710 ms, parse 3050 ms, sort 0 ms, write 0 ms, index 644 ms: 5 candidates, 71071 repo-hours, 1084 releases; waiting 480 ms; commit 0 ms)
2026-11-08T09:32:36Z [load_day 2024-12-25] 2024-12-25 hour 10: 168041 events in 0 files, snapshot none (task 4608 ms: download 2568 ms overlapping gunzip 586 ms, parse 2433 ms, sort 0 ms, write 0 ms, index 612 ms: 3 candidates, 63735 repo-hours, 864 releases; waiting 632 ms; commit 0 ms)
2026-11-08T09:32:38Z [load_day 2024-12-25] 2024-12-25 hour 11: 167825 events in 0 files, snapshot none (task 5175 ms: download 2917 ms overlapping gunzip 708 ms, parse 2983 ms, sort 0 ms, write 0 ms, index 678 ms: 2 candidates, 58752 repo-hours, 716 releases; waiting 502 ms; commit 0 ms)
2026-11-08T09:32:42Z [load_day 2024-12-25] 2024-12-25 hour 12: 219737 events in 0 files, snapshot none (task 5013 ms: download 2826 ms overlapping gunzip 638 ms, parse 2945 ms, sort 0 ms, write 0 ms, index 761 ms: 6 candidates, 107218 repo-hours, 951 releases; waiting 347 ms; commit 0 ms)
2026-11-08T09:32:43Z [load_day 2024-12-25] 2024-12-25 hour 13: 188668 events in 0 files, snapshot none (task 4640 ms: download 2251 ms overlapping gunzip 588 ms, parse 2600 ms, sort 0 ms, write 0 ms, index 635 ms: 8 candidates, 85502 repo-hours, 897 releases; waiting 509 ms; commit 0 ms)
2026-11-08T09:32:46Z [load_day 2024-12-25] 2024-12-25 hour 14: 174394 events in 0 files, snapshot none (task 4249 ms: download 2383 ms overlapping gunzip 565 ms, parse 2427 ms, sort 0 ms, write 0 ms, index 539 ms: 7 candidates, 66305 repo-hours, 882 releases; waiting 389 ms; commit 0 ms)
2026-11-08T09:32:48Z [load_day 2024-12-25] 2024-12-25 hour 15: 182260 events in 0 files, snapshot none (task 4493 ms: download 2396 ms overlapping gunzip 552 ms, parse 2469 ms, sort 0 ms, write 0 ms, index 633 ms: 6 candidates, 73484 repo-hours, 1084 releases; waiting 517 ms; commit 0 ms)
2026-11-08T09:32:52Z [load_day 2024-12-25] 2024-12-25 hour 16: 168762 events in 0 files, snapshot none (task 5187 ms: download 3173 ms overlapping gunzip 585 ms, parse 2556 ms, sort 0 ms, write 0 ms, index 806 ms: 4 candidates, 65656 repo-hours, 828 releases; waiting 880 ms; commit 0 ms)
2026-11-08T09:32:54Z [load_day 2024-12-25] 2024-12-25 hour 17: 180540 events in 0 files, snapshot none (task 5603 ms: download 3370 ms overlapping gunzip 821 ms, parse 3032 ms, sort 0 ms, write 0 ms, index 513 ms: 6 candidates, 68671 repo-hours, 615 releases; waiting 865 ms; commit 0 ms)
2026-11-08T09:32:57Z [load_day 2024-12-25] 2024-12-25 hour 18: 170976 events in 0 files, snapshot none (task 4559 ms: download 1805 ms overlapping gunzip 574 ms, parse 2577 ms, sort 0 ms, write 0 ms, index 941 ms: 5 candidates, 72562 repo-hours, 783 releases; waiting 176 ms; commit 0 ms)
2026-11-08T09:32:59Z [load_day 2024-12-25] 2024-12-25 hour 19: 144872 events in 0 files, snapshot none (task 4244 ms: download 2312 ms overlapping gunzip 589 ms, parse 2395 ms, sort 0 ms, write 0 ms, index 481 ms: 6 candidates, 50127 repo-hours, 644 releases; waiting 516 ms; commit 0 ms)
2026-11-08T09:33:02Z [load_day 2024-12-25] 2024-12-25 hour 20: 143671 events in 0 files, snapshot none (task 4185 ms: download 1940 ms overlapping gunzip 547 ms, parse 2324 ms, sort 0 ms, write 0 ms, index 506 ms: 2 candidates, 52124 repo-hours, 661 releases; waiting 511 ms; commit 0 ms)
2026-11-08T09:33:04Z [load_day 2024-12-25] 2024-12-25 hour 21: 144104 events in 0 files, snapshot none (task 4406 ms: download 2649 ms overlapping gunzip 606 ms, parse 2583 ms, sort 0 ms, write 0 ms, index 424 ms: 4 candidates, 54224 repo-hours, 896 releases; waiting 514 ms; commit 0 ms)
2026-11-08T09:33:06Z [load_day 2024-12-25] 2024-12-25 hour 22: 129717 events in 0 files, snapshot none (task 3598 ms: download 2322 ms overlapping gunzip 530 ms, parse 2153 ms, sort 0 ms, write 0 ms, index 383 ms: 2 candidates, 44740 repo-hours, 885 releases; waiting 196 ms; commit 0 ms)
2026-11-08T09:33:08Z [load_day 2024-12-25] 2024-12-25 hour 23: 127025 events in 0 files, snapshot none (task 3573 ms: download 1830 ms overlapping gunzip 456 ms, parse 1989 ms, sort 0 ms, write 0 ms, index 362 ms: 3 candidates, 43271 repo-hours, 882 releases; waiting 488 ms; commit 0 ms)
2026-11-08T09:33:16Z [load_day 2024-12-25] 2024-12-25: repo_hour merged from 24 files to 1 (1566895 rows, 7224 ms)
2026-11-08T09:33:18Z [load_day 2024-12-25] 2024-12-25: index committed in 10023 ms (24 + 1 + 24 files)
2026-11-08T09:33:18Z [load_day 2024-12-25] 2024-12-25: 3865232 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:33:18Z [load_day 2024-12-25] attempt 1 succeeded