orcaLog in

Runs · run 1894

load_day 2023-12-25, attempt 1 succeeded

Host
73ccef5e07c2:12589
Started
2026-11-08T03:53:44Z
Ended
2026-11-08T03:54:58Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
545 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
110.6 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1894/load_day/2023-12-25/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T03:53:44Z [load_day 2023-12-25] attempt 1 started
2026-11-08T03:53:45Z [load_day 2023-12-25] 2023-12-25: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T03:53:50Z [load_day 2023-12-25] 2023-12-25 hour 0: 130234 events in 0 files, snapshot none (task 4128 ms: download 2232 ms overlapping gunzip 561 ms, parse 2294 ms, sort 0 ms, write 0 ms, index 433 ms: 6 candidates, 65082 repo-hours, 868 releases; waiting 519 ms; commit 0 ms)
2026-11-08T03:53:51Z [load_day 2023-12-25] 2023-12-25 hour 1: 142170 events in 0 files, snapshot none (task 4508 ms: download 2543 ms overlapping gunzip 643 ms, parse 2620 ms, sort 0 ms, write 0 ms, index 509 ms: 1 candidates, 74262 repo-hours, 635 releases; waiting 515 ms; commit 0 ms)
2026-11-08T03:53:55Z [load_day 2023-12-25] 2023-12-25 hour 2: 113404 events in 0 files, snapshot none (task 4595 ms: download 2451 ms overlapping gunzip 705 ms, parse 2776 ms, sort 0 ms, write 0 ms, index 329 ms: 3 candidates, 42178 repo-hours, 617 releases; waiting 523 ms; commit 0 ms)
2026-11-08T03:53:55Z [load_day 2023-12-25] 2023-12-25 hour 3: 118645 events in 0 files, snapshot none (task 4220 ms: download 2322 ms overlapping gunzip 712 ms, parse 2696 ms, sort 0 ms, write 0 ms, index 312 ms: 2 candidates, 43152 repo-hours, 716 releases; waiting 182 ms; commit 0 ms)
2026-11-08T03:54:00Z [load_day 2023-12-25] 2023-12-25 hour 4: 114454 events in 0 files, snapshot none (task 4572 ms: download 2545 ms overlapping gunzip 726 ms, parse 2847 ms, sort 0 ms, write 0 ms, index 287 ms: 0 candidates, 40068 repo-hours, 616 releases; waiting 500 ms; commit 0 ms)
2026-11-08T03:54:00Z [load_day 2023-12-25] 2023-12-25 hour 5: 119331 events in 0 files, snapshot none (task 4692 ms: download 2426 ms overlapping gunzip 694 ms, parse 2693 ms, sort 0 ms, write 0 ms, index 347 ms: 2 candidates, 44031 repo-hours, 616 releases; waiting 507 ms; commit 0 ms)
2026-11-08T03:54:07Z [load_day 2023-12-25] 2023-12-25 hour 6: 142081 events in 0 files, snapshot none (task 5672 ms: download 2935 ms overlapping gunzip 794 ms, parse 3148 ms, sort 0 ms, write 0 ms, index 970 ms: 8 candidates, 57610 repo-hours, 711 releases; waiting 473 ms; commit 0 ms)
2026-11-08T03:54:07Z [load_day 2023-12-25] 2023-12-25 hour 7: 140685 events in 0 files, snapshot none (task 6263 ms: download 3524 ms overlapping gunzip 1012 ms, parse 3907 ms, sort 0 ms, write 0 ms, index 597 ms: 1 candidates, 53107 repo-hours, 689 releases; waiting 517 ms; commit 0 ms)
2026-11-08T03:54:12Z [load_day 2023-12-25] 2023-12-25 hour 8: 148094 events in 0 files, snapshot none (task 4533 ms: download 2621 ms overlapping gunzip 605 ms, parse 2434 ms, sort 0 ms, write 0 ms, index 523 ms: 7 candidates, 55704 repo-hours, 636 releases; waiting 502 ms; commit 0 ms)
2026-11-08T03:54:12Z [load_day 2023-12-25] 2023-12-25 hour 9: 149485 events in 0 files, snapshot none (task 4791 ms: download 3753 ms overlapping gunzip 746 ms, parse 2836 ms, sort 0 ms, write 0 ms, index 409 ms: 6 candidates, 56476 repo-hours, 811 releases; waiting 563 ms; commit 0 ms)
2026-11-08T03:54:17Z [load_day 2023-12-25] 2023-12-25 hour 10: 148018 events in 0 files, snapshot none (task 4659 ms: download 2452 ms overlapping gunzip 727 ms, parse 2754 ms, sort 0 ms, write 0 ms, index 481 ms: 2 candidates, 55513 repo-hours, 637 releases; waiting 408 ms; commit 0 ms)
2026-11-08T03:54:17Z [load_day 2023-12-25] 2023-12-25 hour 11: 142676 events in 0 files, snapshot none (task 4730 ms: download 3525 ms overlapping gunzip 693 ms, parse 2706 ms, sort 0 ms, write 0 ms, index 441 ms: 2 candidates, 51252 repo-hours, 635 releases; waiting 504 ms; commit 0 ms)
2026-11-08T03:54:22Z [load_day 2023-12-25] 2023-12-25 hour 12: 206886 events in 0 files, snapshot none (task 5295 ms: download 2907 ms overlapping gunzip 710 ms, parse 3188 ms, sort 0 ms, write 0 ms, index 969 ms: 9 candidates, 85393 repo-hours, 837 releases; waiting 223 ms; commit 0 ms)
2026-11-08T03:54:23Z [load_day 2023-12-25] 2023-12-25 hour 13: 169752 events in 0 files, snapshot none (task 5174 ms: download 2528 ms overlapping gunzip 760 ms, parse 3147 ms, sort 0 ms, write 0 ms, index 556 ms: 5 candidates, 75575 repo-hours, 541 releases; waiting 496 ms; commit 0 ms)
2026-11-08T03:54:28Z [load_day 2023-12-25] 2023-12-25 hour 14: 152731 events in 0 files, snapshot none (task 5221 ms: download 3503 ms overlapping gunzip 795 ms, parse 3147 ms, sort 0 ms, write 0 ms, index 476 ms: 4 candidates, 57876 repo-hours, 627 releases; waiting 501 ms; commit 0 ms)
2026-11-08T03:54:29Z [load_day 2023-12-25] 2023-12-25 hour 15: 154349 events in 0 files, snapshot none (task 5300 ms: download 3035 ms overlapping gunzip 827 ms, parse 3234 ms, sort 0 ms, write 0 ms, index 444 ms: 6 candidates, 59522 repo-hours, 888 releases; waiting 526 ms; commit 0 ms)
2026-11-08T03:54:34Z [load_day 2023-12-25] 2023-12-25 hour 16: 147844 events in 0 files, snapshot none (task 5364 ms: download 2915 ms overlapping gunzip 783 ms, parse 3183 ms, sort 0 ms, write 0 ms, index 483 ms: 9 candidates, 55805 repo-hours, 717 releases; waiting 588 ms; commit 0 ms)
2026-11-08T03:54:34Z [load_day 2023-12-25] 2023-12-25 hour 17: 139465 events in 0 files, snapshot none (task 4674 ms: download 2659 ms overlapping gunzip 690 ms, parse 2853 ms, sort 0 ms, write 0 ms, index 372 ms: 7 candidates, 51283 repo-hours, 674 releases; waiting 500 ms; commit 0 ms)
2026-11-08T03:54:40Z [load_day 2023-12-25] 2023-12-25 hour 18: 150639 events in 0 files, snapshot none (task 5603 ms: download 3227 ms overlapping gunzip 826 ms, parse 3500 ms, sort 0 ms, write 0 ms, index 460 ms: 5 candidates, 58716 repo-hours, 1431 releases; waiting 490 ms; commit 0 ms)
2026-11-08T03:54:40Z [load_day 2023-12-25] 2023-12-25 hour 19: 132528 events in 0 files, snapshot none (task 5366 ms: download 3122 ms overlapping gunzip 849 ms, parse 3347 ms, sort 0 ms, write 0 ms, index 394 ms: 3 candidates, 46462 repo-hours, 727 releases; waiting 489 ms; commit 0 ms)
2026-11-08T03:54:45Z [load_day 2023-12-25] 2023-12-25 hour 20: 129780 events in 0 files, snapshot none (task 4865 ms: download 2654 ms overlapping gunzip 758 ms, parse 2981 ms, sort 0 ms, write 0 ms, index 358 ms: 3 candidates, 45493 repo-hours, 560 releases; waiting 513 ms; commit 0 ms)
2026-11-08T03:54:45Z [load_day 2023-12-25] 2023-12-25 hour 21: 123417 events in 0 files, snapshot none (task 5183 ms: download 2946 ms overlapping gunzip 799 ms, parse 3206 ms, sort 0 ms, write 0 ms, index 360 ms: 4 candidates, 41506 repo-hours, 674 releases; waiting 516 ms; commit 0 ms)
2026-11-08T03:54:50Z [load_day 2023-12-25] 2023-12-25 hour 22: 112277 events in 0 files, snapshot none (task 4871 ms: download 3459 ms overlapping gunzip 746 ms, parse 2834 ms, sort 0 ms, write 0 ms, index 390 ms: 6 candidates, 38068 repo-hours, 749 releases; waiting 607 ms; commit 0 ms)
2026-11-08T03:54:50Z [load_day 2023-12-25] 2023-12-25 hour 23: 105158 events in 0 files, snapshot none (task 4458 ms: download 2238 ms overlapping gunzip 701 ms, parse 2600 ms, sort 0 ms, write 0 ms, index 377 ms: 2 candidates, 37154 repo-hours, 532 releases; waiting 480 ms; commit 0 ms)
2026-11-08T03:54:56Z [load_day 2023-12-25] 2023-12-25: repo_hour merged from 24 files to 1 (1291288 rows, 5772 ms)
2026-11-08T03:54:58Z [load_day 2023-12-25] 2023-12-25: index committed in 7551 ms (23 + 1 + 24 files)
2026-11-08T03:54:58Z [load_day 2023-12-25] 2023-12-25: 3334103 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T03:54:58Z [load_day 2023-12-25] attempt 1 succeeded