orcaLog in

Runs · run 2476

load_day 2024-05-19, attempt 1 succeeded

Host
73ccef5e07c2:124552
Started
2026-11-08T06:09:53Z
Ended
2026-11-08T06:11:12Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
638 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
111.5 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2476/load_day/2024-05-19/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:09:53Z [load_day 2024-05-19] attempt 1 started
2026-11-08T06:09:54Z [load_day 2024-05-19] 2024-05-19: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:09:59Z [load_day 2024-05-19] 2024-05-19 hour 0: 156106 events in 0 files, snapshot none (task 4861 ms: download 2456 ms overlapping gunzip 692 ms, parse 2929 ms, sort 0 ms, write 0 ms, index 575 ms: 12 candidates, 75647 repo-hours, 1014 releases; waiting 367 ms; commit 0 ms)
2026-11-08T06:10:00Z [load_day 2024-05-19] 2024-05-19 hour 1: 163592 events in 0 files, snapshot none (task 5150 ms: download 2750 ms overlapping gunzip 693 ms, parse 3024 ms, sort 0 ms, write 0 ms, index 596 ms: 11 candidates, 87259 repo-hours, 753 releases; waiting 586 ms; commit 0 ms)
2026-11-08T06:10:03Z [load_day 2024-05-19] 2024-05-19 hour 2: 128376 events in 0 files, snapshot none (task 3518 ms: download 2458 ms overlapping gunzip 422 ms, parse 1842 ms, sort 0 ms, write 0 ms, index 327 ms: 1 candidates, 46597 repo-hours, 677 releases; waiting 603 ms; commit 0 ms)
2026-11-08T06:10:04Z [load_day 2024-05-19] 2024-05-19 hour 3: 144009 events in 0 files, snapshot none (task 3561 ms: download 1791 ms overlapping gunzip 445 ms, parse 1983 ms, sort 0 ms, write 0 ms, index 372 ms: 2 candidates, 53147 repo-hours, 2823 releases; waiting 496 ms; commit 0 ms)
2026-11-08T06:10:07Z [load_day 2024-05-19] 2024-05-19 hour 4: 134090 events in 0 files, snapshot none (task 3259 ms: download 1627 ms overlapping gunzip 412 ms, parse 1772 ms, sort 0 ms, write 0 ms, index 324 ms: 6 candidates, 46432 repo-hours, 503 releases; waiting 506 ms; commit 0 ms)
2026-11-08T06:10:08Z [load_day 2024-05-19] 2024-05-19 hour 5: 142494 events in 0 files, snapshot none (task 3597 ms: download 1933 ms overlapping gunzip 442 ms, parse 1986 ms, sort 0 ms, write 0 ms, index 364 ms: 4 candidates, 49906 repo-hours, 680 releases; waiting 495 ms; commit 0 ms)
2026-11-08T06:10:12Z [load_day 2024-05-19] 2024-05-19 hour 6: 163805 events in 0 files, snapshot none (task 4029 ms: download 2168 ms overlapping gunzip 541 ms, parse 2228 ms, sort 0 ms, write 0 ms, index 474 ms: 7 candidates, 65920 repo-hours, 727 releases; waiting 515 ms; commit 0 ms)
2026-11-08T06:10:12Z [load_day 2024-05-19] 2024-05-19 hour 7: 153909 events in 0 files, snapshot none (task 3817 ms: download 1886 ms overlapping gunzip 512 ms, parse 2166 ms, sort 0 ms, write 0 ms, index 378 ms: 4 candidates, 54918 repo-hours, 633 releases; waiting 481 ms; commit 0 ms)
2026-11-08T06:10:17Z [load_day 2024-05-19] 2024-05-19 hour 8: 166496 events in 0 files, snapshot none (task 5022 ms: download 2433 ms overlapping gunzip 711 ms, parse 3147 ms, sort 0 ms, write 0 ms, index 425 ms: 8 candidates, 63434 repo-hours, 744 releases; waiting 504 ms; commit 0 ms)
2026-11-08T06:10:17Z [load_day 2024-05-19] 2024-05-19 hour 9: 175823 events in 0 files, snapshot none (task 5081 ms: download 2597 ms overlapping gunzip 726 ms, parse 3127 ms, sort 0 ms, write 0 ms, index 495 ms: 2 candidates, 67912 repo-hours, 825 releases; waiting 479 ms; commit 0 ms)
2026-11-08T06:10:24Z [load_day 2024-05-19] 2024-05-19 hour 10: 190809 events in 0 files, snapshot none (task 5792 ms: download 2826 ms overlapping gunzip 843 ms, parse 3799 ms, sort 0 ms, write 0 ms, index 433 ms: 6 candidates, 63908 repo-hours, 752 releases; waiting 507 ms; commit 0 ms)
2026-11-08T06:10:24Z [load_day 2024-05-19] 2024-05-19 hour 11: 199783 events in 0 files, snapshot none (task 5565 ms: download 2930 ms overlapping gunzip 781 ms, parse 3549 ms, sort 0 ms, write 0 ms, index 408 ms: 4 candidates, 63300 repo-hours, 803 releases; waiting 509 ms; commit 0 ms)
2026-11-08T06:10:30Z [load_day 2024-05-19] 2024-05-19 hour 12: 259445 events in 0 files, snapshot none (task 6251 ms: download 2699 ms overlapping gunzip 842 ms, parse 3792 ms, sort 0 ms, write 0 ms, index 820 ms: 12 candidates, 104114 repo-hours, 899 releases; waiting 539 ms; commit 0 ms)
2026-11-08T06:10:31Z [load_day 2024-05-19] 2024-05-19 hour 13: 208681 events in 0 files, snapshot none (task 7265 ms: download 4045 ms overlapping gunzip 1007 ms, parse 4508 ms, sort 0 ms, write 0 ms, index 695 ms: 7 candidates, 90980 repo-hours, 1523 releases; waiting 627 ms; commit 0 ms)
2026-11-08T06:10:37Z [load_day 2024-05-19] 2024-05-19 hour 14: 196246 events in 0 files, snapshot none (task 6252 ms: download 2365 ms overlapping gunzip 886 ms, parse 3721 ms, sort 0 ms, write 0 ms, index 898 ms: 9 candidates, 76637 repo-hours, 828 releases; waiting 521 ms; commit 0 ms)
2026-11-08T06:10:38Z [load_day 2024-05-19] 2024-05-19 hour 15: 209241 events in 0 files, snapshot none (task 6211 ms: download 3172 ms overlapping gunzip 828 ms, parse 3803 ms, sort 0 ms, write 0 ms, index 740 ms: 5 candidates, 85367 repo-hours, 976 releases; waiting 506 ms; commit 0 ms)
2026-11-08T06:10:43Z [load_day 2024-05-19] 2024-05-19 hour 16: 193928 events in 0 files, snapshot none (task 5581 ms: download 2706 ms overlapping gunzip 724 ms, parse 3207 ms, sort 0 ms, write 0 ms, index 838 ms: 6 candidates, 75758 repo-hours, 837 releases; waiting 551 ms; commit 0 ms)
2026-11-08T06:10:44Z [load_day 2024-05-19] 2024-05-19 hour 17: 187050 events in 0 files, snapshot none (task 5445 ms: download 2421 ms overlapping gunzip 724 ms, parse 3123 ms, sort 0 ms, write 0 ms, index 825 ms: 10 candidates, 71661 repo-hours, 834 releases; waiting 492 ms; commit 0 ms)
2026-11-08T06:10:50Z [load_day 2024-05-19] 2024-05-19 hour 18: 200572 events in 0 files, snapshot none (task 6077 ms: download 3025 ms overlapping gunzip 857 ms, parse 3806 ms, sort 0 ms, write 0 ms, index 713 ms: 8 candidates, 88383 repo-hours, 1083 releases; waiting 372 ms; commit 0 ms)
2026-11-08T06:10:50Z [load_day 2024-05-19] 2024-05-19 hour 19: 180837 events in 0 files, snapshot none (task 5358 ms: download 2687 ms overlapping gunzip 811 ms, parse 3595 ms, sort 0 ms, write 0 ms, index 519 ms: 5 candidates, 69127 repo-hours, 788 releases; waiting 190 ms; commit 0 ms)
2026-11-08T06:10:56Z [load_day 2024-05-19] 2024-05-19 hour 20: 175519 events in 0 files, snapshot none (task 5850 ms: download 2857 ms overlapping gunzip 813 ms, parse 3496 ms, sort 0 ms, write 0 ms, index 779 ms: 10 candidates, 64050 repo-hours, 880 releases; waiting 511 ms; commit 0 ms)
2026-11-08T06:10:57Z [load_day 2024-05-19] 2024-05-19 hour 21: 168940 events in 0 files, snapshot none (task 6121 ms: download 2913 ms overlapping gunzip 901 ms, parse 3909 ms, sort 0 ms, write 0 ms, index 535 ms: 12 candidates, 60972 repo-hours, 885 releases; waiting 501 ms; commit 0 ms)
2026-11-08T06:11:01Z [load_day 2024-05-19] 2024-05-19 hour 22: 148028 events in 0 files, snapshot none (task 4455 ms: download 2130 ms overlapping gunzip 634 ms, parse 2675 ms, sort 0 ms, write 0 ms, index 393 ms: 13 candidates, 50911 repo-hours, 848 releases; waiting 514 ms; commit 0 ms)
2026-11-08T06:11:01Z [load_day 2024-05-19] 2024-05-19 hour 23: 140530 events in 0 files, snapshot none (task 4259 ms: download 2137 ms overlapping gunzip 591 ms, parse 2470 ms, sort 0 ms, write 0 ms, index 437 ms: 9 candidates, 48619 repo-hours, 665 releases; waiting 501 ms; commit 0 ms)
2026-11-08T06:11:09Z [load_day 2024-05-19] 2024-05-19: repo_hour merged from 24 files to 1 (1624959 rows, 7775 ms)
2026-11-08T06:11:12Z [load_day 2024-05-19] 2024-05-19: index committed in 10296 ms (24 + 1 + 24 files)
2026-11-08T06:11:12Z [load_day 2024-05-19] 2024-05-19: 4188309 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:11:12Z [load_day 2024-05-19] attempt 1 succeeded