orcaLog in

Runs · run 3808

load_day 2025-04-20, attempt 1 succeeded

Host
73ccef5e07c2:290912
Started
2026-11-08T11:30:45Z
Ended
2026-11-08T11:32:21Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
721 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
133.3 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3808/load_day/2025-04-20/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:30:45Z [load_day 2025-04-20] attempt 1 started
2026-11-08T11:30:46Z [load_day 2025-04-20] 2025-04-20: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:30:53Z [load_day 2025-04-20] 2025-04-20 hour 0: 162614 events in 0 files, snapshot none (task 6413 ms: download 3509 ms overlapping gunzip 915 ms, parse 3888 ms, sort 0 ms, write 0 ms, index 596 ms: 13 candidates, 75554 repo-hours, 1239 releases; waiting 733 ms; commit 0 ms)
2026-11-08T11:30:53Z [load_day 2025-04-20] 2025-04-20 hour 1: 197575 events in 0 files, snapshot none (task 6327 ms: download 3407 ms overlapping gunzip 887 ms, parse 3921 ms, sort 0 ms, write 0 ms, index 830 ms: 7 candidates, 109712 repo-hours, 1058 releases; waiting 437 ms; commit 0 ms)
2026-11-08T11:30:59Z [load_day 2025-04-20] 2025-04-20 hour 2: 152826 events in 0 files, snapshot none (task 5632 ms: download 2802 ms overlapping gunzip 814 ms, parse 3360 ms, sort 0 ms, write 0 ms, index 540 ms: 4 candidates, 69180 repo-hours, 878 releases; waiting 515 ms; commit 0 ms)
2026-11-08T11:30:59Z [load_day 2025-04-20] 2025-04-20 hour 3: 175039 events in 0 files, snapshot none (task 5670 ms: download 3080 ms overlapping gunzip 817 ms, parse 3563 ms, sort 0 ms, write 0 ms, index 520 ms: 9 candidates, 69656 repo-hours, 3099 releases; waiting 463 ms; commit 0 ms)
2026-11-08T11:31:05Z [load_day 2025-04-20] 2025-04-20 hour 4: 160989 events in 0 files, snapshot none (task 5808 ms: download 2861 ms overlapping gunzip 870 ms, parse 3637 ms, sort 0 ms, write 0 ms, index 463 ms: 6 candidates, 59706 repo-hours, 806 releases; waiting 509 ms; commit 0 ms)
2026-11-08T11:31:06Z [load_day 2025-04-20] 2025-04-20 hour 5: 166231 events in 0 files, snapshot none (task 6381 ms: download 3800 ms overlapping gunzip 800 ms, parse 3744 ms, sort 0 ms, write 0 ms, index 450 ms: 6 candidates, 62309 repo-hours, 876 releases; waiting 1156 ms; commit 0 ms)
2026-11-08T11:31:12Z [load_day 2025-04-20] 2025-04-20 hour 6: 189076 events in 0 files, snapshot none (task 6535 ms: download 3318 ms overlapping gunzip 945 ms, parse 4035 ms, sort 0 ms, write 0 ms, index 646 ms: 3 candidates, 80456 repo-hours, 1157 releases; waiting 560 ms; commit 0 ms)
2026-11-08T11:31:13Z [load_day 2025-04-20] 2025-04-20 hour 7: 177967 events in 0 files, snapshot none (task 6464 ms: download 3709 ms overlapping gunzip 1009 ms, parse 4310 ms, sort 0 ms, write 0 ms, index 493 ms: 6 candidates, 67147 repo-hours, 852 releases; waiting 363 ms; commit 0 ms)
2026-11-08T11:31:19Z [load_day 2025-04-20] 2025-04-20 hour 8: 188389 events in 0 files, snapshot none (task 6772 ms: download 3946 ms overlapping gunzip 946 ms, parse 4114 ms, sort 0 ms, write 0 ms, index 634 ms: 6 candidates, 73076 repo-hours, 1006 releases; waiting 775 ms; commit 0 ms)
2026-11-08T11:31:20Z [load_day 2025-04-20] 2025-04-20 hour 9: 199025 events in 0 files, snapshot none (task 6872 ms: download 4168 ms overlapping gunzip 994 ms, parse 4426 ms, sort 0 ms, write 0 ms, index 563 ms: 4 candidates, 78500 repo-hours, 1097 releases; waiting 518 ms; commit 0 ms)
2026-11-08T11:31:25Z [load_day 2025-04-20] 2025-04-20 hour 10: 195088 events in 0 files, snapshot none (task 5392 ms: download 3043 ms overlapping gunzip 706 ms, parse 3209 ms, sort 0 ms, write 0 ms, index 617 ms: 8 candidates, 75810 repo-hours, 930 releases; waiting 533 ms; commit 0 ms)
2026-11-08T11:31:25Z [load_day 2025-04-20] 2025-04-20 hour 11: 191389 events in 0 files, snapshot none (task 4964 ms: download 2756 ms overlapping gunzip 681 ms, parse 2921 ms, sort 0 ms, write 0 ms, index 567 ms: 6 candidates, 71828 repo-hours, 891 releases; waiting 577 ms; commit 0 ms)
2026-11-08T11:31:31Z [load_day 2025-04-20] 2025-04-20 hour 12: 246348 events in 0 files, snapshot none (task 5556 ms: download 2960 ms overlapping gunzip 713 ms, parse 3240 ms, sort 0 ms, write 0 ms, index 828 ms: 6 candidates, 122491 repo-hours, 1149 releases; waiting 503 ms; commit 0 ms)
2026-11-08T11:31:32Z [load_day 2025-04-20] 2025-04-20 hour 13: 221600 events in 0 files, snapshot none (task 5637 ms: download 3364 ms overlapping gunzip 728 ms, parse 3259 ms, sort 0 ms, write 0 ms, index 686 ms: 4 candidates, 100236 repo-hours, 974 releases; waiting 685 ms; commit 0 ms)
2026-11-08T11:31:39Z [load_day 2025-04-20] 2025-04-20 hour 14: 216861 events in 0 files, snapshot none (task 7018 ms: download 4008 ms overlapping gunzip 1005 ms, parse 4422 ms, sort 0 ms, write 0 ms, index 632 ms: 4 candidates, 84243 repo-hours, 1116 releases; waiting 518 ms; commit 0 ms)
2026-11-08T11:31:39Z [load_day 2025-04-20] 2025-04-20 hour 15: 224289 events in 0 files, snapshot none (task 7479 ms: download 4606 ms overlapping gunzip 1122 ms, parse 4832 ms, sort 0 ms, write 0 ms, index 708 ms: 5 candidates, 91142 repo-hours, 1233 releases; waiting 473 ms; commit 0 ms)
2026-11-08T11:31:47Z [load_day 2025-04-20] 2025-04-20 hour 16: 215201 events in 0 files, snapshot none (task 7772 ms: download 4312 ms overlapping gunzip 1099 ms, parse 5065 ms, sort 0 ms, write 0 ms, index 758 ms: 8 candidates, 84597 repo-hours, 1145 releases; waiting 499 ms; commit 0 ms)
2026-11-08T11:31:48Z [load_day 2025-04-20] 2025-04-20 hour 17: 206217 events in 0 files, snapshot none (task 7625 ms: download 4489 ms overlapping gunzip 1147 ms, parse 4970 ms, sort 0 ms, write 0 ms, index 721 ms: 3 candidates, 79228 repo-hours, 993 releases; waiting 547 ms; commit 0 ms)
2026-11-08T11:31:56Z [load_day 2025-04-20] 2025-04-20 hour 18: 216568 events in 0 files, snapshot none (task 7953 ms: download 4135 ms overlapping gunzip 1147 ms, parse 5072 ms, sort 0 ms, write 0 ms, index 1074 ms: 6 candidates, 93084 repo-hours, 1075 releases; waiting 411 ms; commit 0 ms)
2026-11-08T11:31:56Z [load_day 2025-04-20] 2025-04-20 hour 19: 194642 events in 0 files, snapshot none (task 7517 ms: download 3822 ms overlapping gunzip 1081 ms, parse 4777 ms, sort 0 ms, write 0 ms, index 637 ms: 8 candidates, 71797 repo-hours, 1092 releases; waiting 507 ms; commit 0 ms)
2026-11-08T11:32:03Z [load_day 2025-04-20] 2025-04-20 hour 20: 190320 events in 0 files, snapshot none (task 6585 ms: download 3669 ms overlapping gunzip 900 ms, parse 4050 ms, sort 0 ms, write 0 ms, index 787 ms: 4 candidates, 72448 repo-hours, 1065 releases; waiting 518 ms; commit 0 ms)
2026-11-08T11:32:03Z [load_day 2025-04-20] 2025-04-20 hour 21: 185267 events in 0 files, snapshot none (task 6948 ms: download 3988 ms overlapping gunzip 945 ms, parse 4045 ms, sort 0 ms, write 0 ms, index 557 ms: 11 candidates, 71232 repo-hours, 1116 releases; waiting 924 ms; commit 0 ms)
2026-11-08T11:32:08Z [load_day 2025-04-20] 2025-04-20 hour 22: 167514 events in 0 files, snapshot none (task 5189 ms: download 2461 ms overlapping gunzip 680 ms, parse 3125 ms, sort 0 ms, write 0 ms, index 546 ms: 4 candidates, 60684 repo-hours, 1131 releases; waiting 502 ms; commit 0 ms)
2026-11-08T11:32:10Z [load_day 2025-04-20] 2025-04-20 hour 23: 163336 events in 0 files, snapshot none (task 6391 ms: download 3536 ms overlapping gunzip 702 ms, parse 3228 ms, sort 0 ms, write 0 ms, index 665 ms: 3 candidates, 58673 repo-hours, 967 releases; waiting 1431 ms; commit 0 ms)
2026-11-08T11:32:18Z [load_day 2025-04-20] 2025-04-20: repo_hour merged from 24 files to 1 (1882789 rows, 8378 ms)
2026-11-08T11:32:21Z [load_day 2025-04-20] 2025-04-20: index committed in 11362 ms (24 + 1 + 24 files)
2026-11-08T11:32:21Z [load_day 2025-04-20] 2025-04-20: 4604371 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:32:21Z [load_day 2025-04-20] attempt 1 succeeded