orcaLog in

Runs · run 3261

load_day 2024-11-30, attempt 1 succeeded

Host
73ccef5e07c2:214931
Started
2026-11-08T09:07:49Z
Ended
2026-11-08T09:09:35Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
657 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
165.3 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3261/load_day/2024-11-30/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:07:49Z [load_day 2024-11-30] attempt 1 started
2026-11-08T09:07:50Z [load_day 2024-11-30] 2024-11-30: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:07:56Z [load_day 2024-11-30] 2024-11-30 hour 0: 159795 events in 0 files, snapshot none (task 5823 ms: download 2727 ms overlapping gunzip 853 ms, parse 3698 ms, sort 0 ms, write 0 ms, index 766 ms: 5 candidates, 75906 repo-hours, 1092 releases; waiting 271 ms; commit 0 ms)
2026-11-08T09:07:57Z [load_day 2024-11-30] 2024-11-30 hour 1: 175755 events in 0 files, snapshot none (task 6271 ms: download 2941 ms overlapping gunzip 857 ms, parse 3569 ms, sort 0 ms, write 0 ms, index 1029 ms: 6 candidates, 96189 repo-hours, 732 releases; waiting 472 ms; commit 0 ms)
2026-11-08T09:08:02Z [load_day 2024-11-30] 2024-11-30 hour 2: 143955 events in 0 files, snapshot none (task 5584 ms: download 2952 ms overlapping gunzip 774 ms, parse 3159 ms, sort 0 ms, write 0 ms, index 780 ms: 6 candidates, 61644 repo-hours, 631 releases; waiting 504 ms; commit 0 ms)
2026-11-08T09:08:04Z [load_day 2024-11-30] 2024-11-30 hour 3: 185696 events in 0 files, snapshot none (task 7102 ms: download 4564 ms overlapping gunzip 1210 ms, parse 4686 ms, sort 0 ms, write 0 ms, index 742 ms: 2 candidates, 61402 repo-hours, 3817 releases; waiting 182 ms; commit 0 ms)
2026-11-08T09:08:11Z [load_day 2024-11-30] 2024-11-30 hour 4: 172661 events in 0 files, snapshot none (task 8029 ms: download 4252 ms overlapping gunzip 1467 ms, parse 5231 ms, sort 0 ms, write 0 ms, index 544 ms: 6 candidates, 51171 repo-hours, 575 releases; waiting 525 ms; commit 0 ms)
2026-11-08T09:08:13Z [load_day 2024-11-30] 2024-11-30 hour 5: 177721 events in 0 files, snapshot none (task 8013 ms: download 5678 ms overlapping gunzip 1311 ms, parse 5062 ms, sort 0 ms, write 0 ms, index 487 ms: 1 candidates, 54284 repo-hours, 728 releases; waiting 805 ms; commit 0 ms)
2026-11-08T09:08:20Z [load_day 2024-11-30] 2024-11-30 hour 6: 194475 events in 0 files, snapshot none (task 8411 ms: download 5021 ms overlapping gunzip 1449 ms, parse 5494 ms, sort 0 ms, write 0 ms, index 667 ms: 8 candidates, 69923 repo-hours, 906 releases; waiting 499 ms; commit 0 ms)
2026-11-08T09:08:20Z [load_day 2024-11-30] 2024-11-30 hour 7: 178921 events in 0 files, snapshot none (task 7127 ms: download 4764 ms overlapping gunzip 1140 ms, parse 4702 ms, sort 0 ms, write 0 ms, index 470 ms: 2 candidates, 56778 repo-hours, 834 releases; waiting 506 ms; commit 0 ms)
2026-11-08T09:08:27Z [load_day 2024-11-30] 2024-11-30 hour 8: 187094 events in 0 files, snapshot none (task 7098 ms: download 4050 ms overlapping gunzip 1191 ms, parse 4615 ms, sort 0 ms, write 0 ms, index 710 ms: 3 candidates, 60912 repo-hours, 958 releases; waiting 277 ms; commit 0 ms)
2026-11-08T09:08:28Z [load_day 2024-11-30] 2024-11-30 hour 9: 194859 events in 0 files, snapshot none (task 7042 ms: download 4466 ms overlapping gunzip 1176 ms, parse 4456 ms, sort 0 ms, write 0 ms, index 589 ms: 5 candidates, 67136 repo-hours, 1066 releases; waiting 490 ms; commit 0 ms)
2026-11-08T09:08:34Z [load_day 2024-11-30] 2024-11-30 hour 10: 189777 events in 0 files, snapshot none (task 6197 ms: download 3616 ms overlapping gunzip 1083 ms, parse 4044 ms, sort 0 ms, write 0 ms, index 503 ms: 4 candidates, 62918 repo-hours, 733 releases; waiting 218 ms; commit 0 ms)
2026-11-08T09:08:35Z [load_day 2024-11-30] 2024-11-30 hour 11: 190251 events in 0 files, snapshot none (task 6047 ms: download 4223 ms overlapping gunzip 1039 ms, parse 3854 ms, sort 0 ms, write 0 ms, index 416 ms: 1 candidates, 60232 repo-hours, 680 releases; waiting 493 ms; commit 0 ms)
2026-11-08T09:08:40Z [load_day 2024-11-30] 2024-11-30 hour 12: 230197 events in 0 files, snapshot none (task 5306 ms: download 2618 ms overlapping gunzip 715 ms, parse 2997 ms, sort 0 ms, write 0 ms, index 829 ms: 7 candidates, 111361 repo-hours, 837 releases; waiting 509 ms; commit 0 ms)
2026-11-08T09:08:42Z [load_day 2024-11-30] 2024-11-30 hour 13: 224191 events in 0 files, snapshot none (task 6734 ms: download 4375 ms overlapping gunzip 1069 ms, parse 4181 ms, sort 0 ms, write 0 ms, index 625 ms: 5 candidates, 88458 repo-hours, 782 releases; waiting 558 ms; commit 0 ms)
2026-11-08T09:08:47Z [load_day 2024-11-30] 2024-11-30 hour 14: 209714 events in 0 files, snapshot none (task 6773 ms: download 4425 ms overlapping gunzip 1061 ms, parse 4137 ms, sort 0 ms, write 0 ms, index 561 ms: 2 candidates, 70601 repo-hours, 790 releases; waiting 738 ms; commit 0 ms)
2026-11-08T09:08:51Z [load_day 2024-11-30] 2024-11-30 hour 15: 218796 events in 0 files, snapshot none (task 8872 ms: download 4446 ms overlapping gunzip 1154 ms, parse 4375 ms, sort 0 ms, write 0 ms, index 2543 ms: 6 candidates, 79967 repo-hours, 969 releases; waiting 502 ms; commit 0 ms)
2026-11-08T09:08:58Z [load_day 2024-11-30] 2024-11-30 hour 16: 209742 events in 0 files, snapshot none (task 10228 ms: download 5255 ms overlapping gunzip 1198 ms, parse 4462 ms, sort 0 ms, write 0 ms, index 3048 ms: 3 candidates, 73398 repo-hours, 919 releases; waiting 1205 ms; commit 0 ms)
2026-11-08T09:08:59Z [load_day 2024-11-30] 2024-11-30 hour 17: 205679 events in 0 files, snapshot none (task 7354 ms: download 5160 ms overlapping gunzip 1271 ms, parse 5061 ms, sort 0 ms, write 0 ms, index 587 ms: 10 candidates, 67010 repo-hours, 789 releases; waiting 238 ms; commit 0 ms)
2026-11-08T09:09:06Z [load_day 2024-11-30] 2024-11-30 hour 18: 216220 events in 0 files, snapshot none (task 8238 ms: download 5314 ms overlapping gunzip 1350 ms, parse 5443 ms, sort 0 ms, write 0 ms, index 746 ms: 10 candidates, 80149 repo-hours, 906 releases; waiting 365 ms; commit 0 ms)
2026-11-08T09:09:08Z [load_day 2024-11-30] 2024-11-30 hour 19: 193139 events in 0 files, snapshot none (task 7917 ms: download 5410 ms overlapping gunzip 1373 ms, parse 5056 ms, sort 0 ms, write 0 ms, index 743 ms: 5 candidates, 59238 repo-hours, 714 releases; waiting 512 ms; commit 0 ms)
2026-11-08T09:09:14Z [load_day 2024-11-30] 2024-11-30 hour 20: 189430 events in 0 files, snapshot none (task 7260 ms: download 4233 ms overlapping gunzip 1293 ms, parse 4885 ms, sort 0 ms, write 0 ms, index 496 ms: 4 candidates, 59672 repo-hours, 669 releases; waiting 264 ms; commit 0 ms)
2026-11-08T09:09:17Z [load_day 2024-11-30] 2024-11-30 hour 21: 185491 events in 0 files, snapshot none (task 8159 ms: download 5375 ms overlapping gunzip 1305 ms, parse 5235 ms, sort 0 ms, write 0 ms, index 756 ms: 2 candidates, 60721 repo-hours, 835 releases; waiting 502 ms; commit 0 ms)
2026-11-08T09:09:22Z [load_day 2024-11-30] 2024-11-30 hour 22: 173635 events in 0 files, snapshot none (task 6987 ms: download 3533 ms overlapping gunzip 1169 ms, parse 4490 ms, sort 0 ms, write 0 ms, index 696 ms: 2 candidates, 51573 repo-hours, 901 releases; waiting 227 ms; commit 0 ms)
2026-11-08T09:09:24Z [load_day 2024-11-30] 2024-11-30 hour 23: 165866 events in 0 files, snapshot none (task 7204 ms: download 4824 ms overlapping gunzip 1127 ms, parse 4622 ms, sort 0 ms, write 0 ms, index 474 ms: 1 candidates, 50720 repo-hours, 672 releases; waiting 508 ms; commit 0 ms)
2026-11-08T09:09:32Z [load_day 2024-11-30] 2024-11-30: repo_hour merged from 24 files to 1 (1631363 rows, 7682 ms)
2026-11-08T09:09:35Z [load_day 2024-11-30] 2024-11-30: index committed in 10587 ms (24 + 1 + 24 files)
2026-11-08T09:09:35Z [load_day 2024-11-30] 2024-11-30: 4573060 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:09:35Z [load_day 2024-11-30] attempt 1 succeeded