orcaLog in

Runs · run 3324

load_day 2024-12-15, attempt 1 succeeded

Host
73ccef5e07c2:223306
Started
2026-11-08T09:23:11Z
Ended
2026-11-08T09:24:34Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
654 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
118.2 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3324/load_day/2024-12-15/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:23:11Z [load_day 2024-12-15] attempt 1 started
2026-11-08T09:23:12Z [load_day 2024-12-15] 2024-12-15: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:23:19Z [load_day 2024-12-15] 2024-12-15 hour 0: 145142 events in 0 files, snapshot none (task 6291 ms: download 2549 ms overlapping gunzip 815 ms, parse 3791 ms, sort 0 ms, write 0 ms, index 900 ms: 1 candidates, 65171 repo-hours, 1191 releases; waiting 429 ms; commit 0 ms)
2026-11-08T09:23:20Z [load_day 2024-12-15] 2024-12-15 hour 1: 177855 events in 0 files, snapshot none (task 6990 ms: download 2684 ms overlapping gunzip 968 ms, parse 4209 ms, sort 0 ms, write 0 ms, index 991 ms: 5 candidates, 102433 repo-hours, 987 releases; waiting 479 ms; commit 0 ms)
2026-11-08T09:23:24Z [load_day 2024-12-15] 2024-12-15 hour 2: 131010 events in 0 files, snapshot none (task 4350 ms: download 2285 ms overlapping gunzip 587 ms, parse 2580 ms, sort 0 ms, write 0 ms, index 383 ms: 4 candidates, 56326 repo-hours, 788 releases; waiting 506 ms; commit 0 ms)
2026-11-08T09:23:24Z [load_day 2024-12-15] 2024-12-15 hour 3: 154814 events in 0 files, snapshot none (task 4180 ms: download 2314 ms overlapping gunzip 503 ms, parse 2311 ms, sort 0 ms, write 0 ms, index 534 ms: 5 candidates, 60571 repo-hours, 3928 releases; waiting 485 ms; commit 0 ms)
2026-11-08T09:23:28Z [load_day 2024-12-15] 2024-12-15 hour 4: 142009 events in 0 files, snapshot none (task 4145 ms: download 2094 ms overlapping gunzip 607 ms, parse 2616 ms, sort 0 ms, write 0 ms, index 371 ms: 2 candidates, 48899 repo-hours, 560 releases; waiting 211 ms; commit 0 ms)
2026-11-08T09:23:29Z [load_day 2024-12-15] 2024-12-15 hour 5: 143912 events in 0 files, snapshot none (task 4349 ms: download 2643 ms overlapping gunzip 594 ms, parse 2556 ms, sort 0 ms, write 0 ms, index 395 ms: 3 candidates, 51233 repo-hours, 644 releases; waiting 523 ms; commit 0 ms)
2026-11-08T09:23:35Z [load_day 2024-12-15] 2024-12-15 hour 6: 165790 events in 0 files, snapshot none (task 5709 ms: download 2917 ms overlapping gunzip 806 ms, parse 3496 ms, sort 0 ms, write 0 ms, index 583 ms: 2 candidates, 70312 repo-hours, 773 releases; waiting 514 ms; commit 0 ms)
2026-11-08T09:23:35Z [load_day 2024-12-15] 2024-12-15 hour 7: 151323 events in 0 files, snapshot none (task 4936 ms: download 2386 ms overlapping gunzip 729 ms, parse 3190 ms, sort 0 ms, write 0 ms, index 431 ms: 5 candidates, 53897 repo-hours, 527 releases; waiting 226 ms; commit 0 ms)
2026-11-08T09:23:39Z [load_day 2024-12-15] 2024-12-15 hour 8: 156587 events in 0 files, snapshot none (task 4490 ms: download 2693 ms overlapping gunzip 617 ms, parse 2566 ms, sort 0 ms, write 0 ms, index 457 ms: 3 candidates, 59926 repo-hours, 631 releases; waiting 531 ms; commit 0 ms)
2026-11-08T09:23:40Z [load_day 2024-12-15] 2024-12-15 hour 9: 170533 events in 0 files, snapshot none (task 4757 ms: download 2342 ms overlapping gunzip 683 ms, parse 2816 ms, sort 0 ms, write 0 ms, index 489 ms: 1 candidates, 66710 repo-hours, 771 releases; waiting 496 ms; commit 0 ms)
2026-11-08T09:23:44Z [load_day 2024-12-15] 2024-12-15 hour 10: 164263 events in 0 files, snapshot none (task 3570 ms: download 1295 ms overlapping gunzip 549 ms, parse 2381 ms, sort 0 ms, write 0 ms, index 424 ms: 4 candidates, 62823 repo-hours, 655 releases; waiting 18 ms; commit 0 ms)
2026-11-08T09:23:44Z [load_day 2024-12-15] 2024-12-15 hour 11: 173717 events in 0 files, snapshot none (task 3663 ms: download 1433 ms overlapping gunzip 564 ms, parse 2464 ms, sort 0 ms, write 0 ms, index 427 ms: 6 candidates, 61730 repo-hours, 737 releases; waiting 19 ms; commit 0 ms)
2026-11-08T09:23:50Z [load_day 2024-12-15] 2024-12-15 hour 12: 229669 events in 0 files, snapshot none (task 5338 ms: download 1952 ms overlapping gunzip 709 ms, parse 3216 ms, sort 0 ms, write 0 ms, index 1190 ms: 4 candidates, 114683 repo-hours, 910 releases; waiting 15 ms; commit 0 ms)
2026-11-08T09:23:50Z [load_day 2024-12-15] 2024-12-15 hour 13: 209620 events in 0 files, snapshot none (task 5193 ms: download 1932 ms overlapping gunzip 654 ms, parse 3000 ms, sort 0 ms, write 0 ms, index 1295 ms: 9 candidates, 92481 repo-hours, 830 releases; waiting 27 ms; commit 0 ms)
2026-11-08T09:23:56Z [load_day 2024-12-15] 2024-12-15 hour 14: 198814 events in 0 files, snapshot none (task 5783 ms: download 3732 ms overlapping gunzip 799 ms, parse 3439 ms, sort 0 ms, write 0 ms, index 613 ms: 5 candidates, 76116 repo-hours, 1000 releases; waiting 628 ms; commit 0 ms)
2026-11-08T09:23:56Z [load_day 2024-12-15] 2024-12-15 hour 15: 223276 events in 0 files, snapshot none (task 5886 ms: download 3499 ms overlapping gunzip 985 ms, parse 3971 ms, sort 0 ms, write 0 ms, index 723 ms: 7 candidates, 89327 repo-hours, 997 releases; waiting 22 ms; commit 0 ms)
2026-11-08T09:24:04Z [load_day 2024-12-15] 2024-12-15 hour 16: 201859 events in 0 files, snapshot none (task 7010 ms: download 4381 ms overlapping gunzip 1092 ms, parse 4457 ms, sort 0 ms, write 0 ms, index 600 ms: 8 candidates, 79712 repo-hours, 924 releases; waiting 545 ms; commit 0 ms)
2026-11-08T09:24:04Z [load_day 2024-12-15] 2024-12-15 hour 17: 187713 events in 0 files, snapshot none (task 6372 ms: download 3443 ms overlapping gunzip 950 ms, parse 4288 ms, sort 0 ms, write 0 ms, index 618 ms: 4 candidates, 70175 repo-hours, 826 releases; waiting 228 ms; commit 0 ms)
2026-11-08T09:24:10Z [load_day 2024-12-15] 2024-12-15 hour 18: 204305 events in 0 files, snapshot none (task 6387 ms: download 3586 ms overlapping gunzip 938 ms, parse 3817 ms, sort 0 ms, write 0 ms, index 708 ms: 6 candidates, 87240 repo-hours, 968 releases; waiting 525 ms; commit 0 ms)
2026-11-08T09:24:10Z [load_day 2024-12-15] 2024-12-15 hour 19: 180845 events in 0 files, snapshot none (task 6300 ms: download 3640 ms overlapping gunzip 1036 ms, parse 4460 ms, sort 0 ms, write 0 ms, index 580 ms: 5 candidates, 65364 repo-hours, 894 releases; waiting 19 ms; commit 0 ms)
2026-11-08T09:24:17Z [load_day 2024-12-15] 2024-12-15 hour 20: 178768 events in 0 files, snapshot none (task 5927 ms: download 2477 ms overlapping gunzip 938 ms, parse 4148 ms, sort 0 ms, write 0 ms, index 638 ms: 6 candidates, 66340 repo-hours, 859 releases; waiting 14 ms; commit 0 ms)
2026-11-08T09:24:18Z [load_day 2024-12-15] 2024-12-15 hour 21: 180235 events in 0 files, snapshot none (task 7056 ms: download 4252 ms overlapping gunzip 1135 ms, parse 4572 ms, sort 0 ms, write 0 ms, index 569 ms: 5 candidates, 69595 repo-hours, 1246 releases; waiting 546 ms; commit 0 ms)
2026-11-08T09:24:22Z [load_day 2024-12-15] 2024-12-15 hour 22: 161368 events in 0 files, snapshot none (task 5108 ms: download 2123 ms overlapping gunzip 672 ms, parse 2946 ms, sort 0 ms, write 0 ms, index 882 ms: 2 candidates, 59369 repo-hours, 1166 releases; waiting 372 ms; commit 0 ms)
2026-11-08T09:24:23Z [load_day 2024-12-15] 2024-12-15 hour 23: 155046 events in 0 files, snapshot none (task 4487 ms: download 1751 ms overlapping gunzip 690 ms, parse 2964 ms, sort 0 ms, write 0 ms, index 603 ms: 3 candidates, 54734 repo-hours, 726 releases; waiting 8 ms; commit 0 ms)
2026-11-08T09:24:30Z [load_day 2024-12-15] 2024-12-15: repo_hour merged from 24 files to 1 (1685167 rows, 7372 ms)
2026-11-08T09:24:34Z [load_day 2024-12-15] 2024-12-15: index committed in 10570 ms (24 + 1 + 24 files)
2026-11-08T09:24:34Z [load_day 2024-12-15] 2024-12-15: 4188473 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:24:34Z [load_day 2024-12-15] attempt 1 succeeded