orcaLog in

Runs · run 3981

load_day 2025-06-04, attempt 1 succeeded

Host
73ccef5e07c2:317025
Started
2026-11-08T12:17:29Z
Ended
2026-11-08T12:19:08Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
682 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
147.0 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3981/load_day/2025-06-04/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:17:29Z [load_day 2025-06-04] attempt 1 started
2026-11-08T12:17:30Z [load_day 2025-06-04] 2025-06-04: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:17:36Z [load_day 2025-06-04] 2025-06-04 hour 0: 145280 events in 0 files, snapshot none (task 5564 ms: download 3096 ms overlapping gunzip 763 ms, parse 3277 ms, sort 0 ms, write 0 ms, index 553 ms: 3 candidates, 71122 repo-hours, 1054 releases; waiting 641 ms; commit 0 ms)
2026-11-08T12:17:36Z [load_day 2025-06-04] 2025-06-04 hour 1: 153712 events in 0 files, snapshot none (task 5168 ms: download 2727 ms overlapping gunzip 724 ms, parse 2997 ms, sort 0 ms, write 0 ms, index 669 ms: 6 candidates, 90518 repo-hours, 665 releases; waiting 510 ms; commit 0 ms)
2026-11-08T12:17:42Z [load_day 2025-06-04] 2025-06-04 hour 2: 144957 events in 0 files, snapshot none (task 6145 ms: download 3416 ms overlapping gunzip 810 ms, parse 3296 ms, sort 0 ms, write 0 ms, index 723 ms: 11 candidates, 72257 repo-hours, 821 releases; waiting 1092 ms; commit 0 ms)
2026-11-08T12:17:42Z [load_day 2025-06-04] 2025-06-04 hour 3: 146986 events in 0 files, snapshot none (task 5632 ms: download 3122 ms overlapping gunzip 765 ms, parse 3244 ms, sort 0 ms, write 0 ms, index 746 ms: 12 candidates, 71485 repo-hours, 1869 releases; waiting 631 ms; commit 0 ms)
2026-11-08T12:17:49Z [load_day 2025-06-04] 2025-06-04 hour 4: 144122 events in 0 files, snapshot none (task 5770 ms: download 3150 ms overlapping gunzip 861 ms, parse 3472 ms, sort 0 ms, write 0 ms, index 625 ms: 17 candidates, 64165 repo-hours, 832 releases; waiting 498 ms; commit 0 ms)
2026-11-08T12:17:49Z [load_day 2025-06-04] 2025-06-04 hour 5: 146093 events in 0 files, snapshot none (task 5517 ms: download 2816 ms overlapping gunzip 822 ms, parse 3274 ms, sort 0 ms, write 0 ms, index 765 ms: 8 candidates, 66419 repo-hours, 741 releases; waiting 303 ms; commit 0 ms)
2026-11-08T12:17:56Z [load_day 2025-06-04] 2025-06-04 hour 6: 152044 events in 0 files, snapshot none (task 6698 ms: download 4220 ms overlapping gunzip 927 ms, parse 3904 ms, sort 0 ms, write 0 ms, index 822 ms: 8 candidates, 78307 repo-hours, 755 releases; waiting 830 ms; commit 0 ms)
2026-11-08T12:17:57Z [load_day 2025-06-04] 2025-06-04 hour 7: 154061 events in 0 files, snapshot none (task 7417 ms: download 4033 ms overlapping gunzip 1053 ms, parse 4512 ms, sort 0 ms, write 0 ms, index 999 ms: 2 candidates, 75741 repo-hours, 783 releases; waiting 529 ms; commit 0 ms)
2026-11-08T12:18:04Z [load_day 2025-06-04] 2025-06-04 hour 8: 153569 events in 0 files, snapshot none (task 6991 ms: download 4184 ms overlapping gunzip 1150 ms, parse 4420 ms, sort 0 ms, write 0 ms, index 721 ms: 8 candidates, 78270 repo-hours, 826 releases; waiting 337 ms; commit 0 ms)
2026-11-08T12:18:05Z [load_day 2025-06-04] 2025-06-04 hour 9: 151646 events in 0 files, snapshot none (task 6976 ms: download 3681 ms overlapping gunzip 1089 ms, parse 4332 ms, sort 0 ms, write 0 ms, index 787 ms: 6 candidates, 78616 repo-hours, 932 releases; waiting 437 ms; commit 0 ms)
2026-11-08T12:18:12Z [load_day 2025-06-04] 2025-06-04 hour 10: 144791 events in 0 files, snapshot none (task 8297 ms: download 4984 ms overlapping gunzip 1100 ms, parse 4402 ms, sort 0 ms, write 0 ms, index 620 ms: 6 candidates, 74199 repo-hours, 739 releases; waiting 1900 ms; commit 0 ms)
2026-11-08T12:18:12Z [load_day 2025-06-04] 2025-06-04 hour 11: 155659 events in 0 files, snapshot none (task 6506 ms: download 3016 ms overlapping gunzip 934 ms, parse 3760 ms, sort 0 ms, write 0 ms, index 1324 ms: 10 candidates, 75977 repo-hours, 753 releases; waiting 184 ms; commit 0 ms)
2026-11-08T12:18:20Z [load_day 2025-06-04] 2025-06-04 hour 12: 160009 events in 0 files, snapshot none (task 7232 ms: download 3291 ms overlapping gunzip 1032 ms, parse 4367 ms, sort 0 ms, write 0 ms, index 1204 ms: 11 candidates, 94197 repo-hours, 761 releases; waiting 348 ms; commit 0 ms)
2026-11-08T12:18:21Z [load_day 2025-06-04] 2025-06-04 hour 13: 156094 events in 0 files, snapshot none (task 7990 ms: download 4132 ms overlapping gunzip 1237 ms, parse 5011 ms, sort 0 ms, write 0 ms, index 909 ms: 5 candidates, 89245 repo-hours, 760 releases; waiting 502 ms; commit 0 ms)
2026-11-08T12:18:28Z [load_day 2025-06-04] 2025-06-04 hour 14: 148104 events in 0 files, snapshot none (task 7508 ms: download 3700 ms overlapping gunzip 1065 ms, parse 4579 ms, sort 0 ms, write 0 ms, index 1001 ms: 9 candidates, 80516 repo-hours, 755 releases; waiting 514 ms; commit 0 ms)
2026-11-08T12:18:29Z [load_day 2025-06-04] 2025-06-04 hour 15: 156838 events in 0 files, snapshot none (task 7650 ms: download 4633 ms overlapping gunzip 1226 ms, parse 4960 ms, sort 0 ms, write 0 ms, index 629 ms: 11 candidates, 83897 repo-hours, 794 releases; waiting 540 ms; commit 0 ms)
2026-11-08T12:18:36Z [load_day 2025-06-04] 2025-06-04 hour 16: 156526 events in 0 files, snapshot none (task 7369 ms: download 4062 ms overlapping gunzip 1089 ms, parse 4652 ms, sort 0 ms, write 0 ms, index 794 ms: 9 candidates, 80677 repo-hours, 883 releases; waiting 559 ms; commit 0 ms)
2026-11-08T12:18:37Z [load_day 2025-06-04] 2025-06-04 hour 17: 155542 events in 0 files, snapshot none (task 7235 ms: download 4624 ms overlapping gunzip 1116 ms, parse 4640 ms, sort 0 ms, write 0 ms, index 620 ms: 11 candidates, 76221 repo-hours, 721 releases; waiting 639 ms; commit 0 ms)
2026-11-08T12:18:42Z [load_day 2025-06-04] 2025-06-04 hour 18: 158290 events in 0 files, snapshot none (task 5655 ms: download 2785 ms overlapping gunzip 826 ms, parse 3407 ms, sort 0 ms, write 0 ms, index 967 ms: 7 candidates, 83154 repo-hours, 905 releases; waiting 212 ms; commit 0 ms)
2026-11-08T12:18:44Z [load_day 2025-06-04] 2025-06-04 hour 19: 149787 events in 0 files, snapshot none (task 6100 ms: download 3920 ms overlapping gunzip 841 ms, parse 3639 ms, sort 0 ms, write 0 ms, index 578 ms: 10 candidates, 69382 repo-hours, 913 releases; waiting 752 ms; commit 0 ms)
2026-11-08T12:18:49Z [load_day 2025-06-04] 2025-06-04 hour 20: 153690 events in 0 files, snapshot none (task 6301 ms: download 3324 ms overlapping gunzip 918 ms, parse 3890 ms, sort 0 ms, write 0 ms, index 618 ms: 12 candidates, 72308 repo-hours, 819 releases; waiting 588 ms; commit 0 ms)
2026-11-08T12:18:51Z [load_day 2025-06-04] 2025-06-04 hour 21: 144810 events in 0 files, snapshot none (task 5969 ms: download 3287 ms overlapping gunzip 867 ms, parse 3461 ms, sort 0 ms, write 0 ms, index 617 ms: 10 candidates, 66726 repo-hours, 838 releases; waiting 678 ms; commit 0 ms)
2026-11-08T12:18:56Z [load_day 2025-06-04] 2025-06-04 hour 22: 145475 events in 0 files, snapshot none (task 6158 ms: download 3428 ms overlapping gunzip 953 ms, parse 3923 ms, sort 0 ms, write 0 ms, index 551 ms: 8 candidates, 63085 repo-hours, 865 releases; waiting 404 ms; commit 0 ms)
2026-11-08T12:18:57Z [load_day 2025-06-04] 2025-06-04 hour 23: 140689 events in 0 files, snapshot none (task 5405 ms: download 2886 ms overlapping gunzip 856 ms, parse 3447 ms, sort 0 ms, write 0 ms, index 503 ms: 12 candidates, 61754 repo-hours, 813 releases; waiting 341 ms; commit 0 ms)
2026-11-08T12:19:05Z [load_day 2025-06-04] 2025-06-04: repo_hour merged from 24 files to 1 (1818238 rows, 8901 ms)
2026-11-08T12:19:08Z [load_day 2025-06-04] 2025-06-04: index committed in 11545 ms (24 + 1 + 24 files)
2026-11-08T12:19:08Z [load_day 2025-06-04] 2025-06-04: 3618774 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:19:08Z [load_day 2025-06-04] attempt 1 succeeded