orcaLog in

Runs · run 3509

load_day 2025-02-02, attempt 1 succeeded

Host
73ccef5e07c2:247895
Started
2026-11-08T10:07:43Z
Ended
2026-11-08T10:09:13Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
683 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
126.0 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3509/load_day/2025-02-02/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:07:43Z [load_day 2025-02-02] attempt 1 started
2026-11-08T10:07:44Z [load_day 2025-02-02] 2025-02-02: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:07:52Z [load_day 2025-02-02] 2025-02-02 hour 0: 166388 events in 0 files, snapshot none (task 6634 ms: download 3325 ms overlapping gunzip 977 ms, parse 4033 ms, sort 0 ms, write 0 ms, index 704 ms: 5 candidates, 82534 repo-hours, 1309 releases; waiting 612 ms; commit 0 ms)
2026-11-08T10:07:52Z [load_day 2025-02-02] 2025-02-02 hour 1: 178841 events in 0 files, snapshot none (task 6449 ms: download 3152 ms overlapping gunzip 904 ms, parse 4017 ms, sort 0 ms, write 0 ms, index 823 ms: 8 candidates, 101215 repo-hours, 1013 releases; waiting 492 ms; commit 0 ms)
2026-11-08T10:07:57Z [load_day 2025-02-02] 2025-02-02 hour 2: 139788 events in 0 files, snapshot none (task 5095 ms: download 2255 ms overlapping gunzip 713 ms, parse 2985 ms, sort 0 ms, write 0 ms, index 593 ms: 3 candidates, 61864 repo-hours, 859 releases; waiting 520 ms; commit 0 ms)
2026-11-08T10:07:57Z [load_day 2025-02-02] 2025-02-02 hour 3: 154864 events in 0 files, snapshot none (task 5094 ms: download 1670 ms overlapping gunzip 644 ms, parse 3085 ms, sort 0 ms, write 0 ms, index 596 ms: 4 candidates, 61972 repo-hours, 3912 releases; waiting 196 ms; commit 0 ms)
2026-11-08T10:08:02Z [load_day 2025-02-02] 2025-02-02 hour 4: 146647 events in 0 files, snapshot none (task 3993 ms: download 2479 ms overlapping gunzip 506 ms, parse 2298 ms, sort 0 ms, write 0 ms, index 436 ms: 3 candidates, 52981 repo-hours, 665 releases; waiting 508 ms; commit 0 ms)
2026-11-08T10:08:02Z [load_day 2025-02-02] 2025-02-02 hour 5: 150634 events in 0 files, snapshot none (task 3869 ms: download 1905 ms overlapping gunzip 543 ms, parse 2388 ms, sort 0 ms, write 0 ms, index 406 ms: 2 candidates, 55553 repo-hours, 778 releases; waiting 309 ms; commit 0 ms)
2026-11-08T10:08:07Z [load_day 2025-02-02] 2025-02-02 hour 6: 168708 events in 0 files, snapshot none (task 4657 ms: download 2450 ms overlapping gunzip 641 ms, parse 2623 ms, sort 0 ms, write 0 ms, index 568 ms: 3 candidates, 71470 repo-hours, 865 releases; waiting 475 ms; commit 0 ms)
2026-11-08T10:08:07Z [load_day 2025-02-02] 2025-02-02 hour 7: 156403 events in 0 files, snapshot none (task 4285 ms: download 2671 ms overlapping gunzip 571 ms, parse 2412 ms, sort 0 ms, write 0 ms, index 432 ms: 8 candidates, 57544 repo-hours, 662 releases; waiting 550 ms; commit 0 ms)
2026-11-08T10:08:12Z [load_day 2025-02-02] 2025-02-02 hour 8: 165362 events in 0 files, snapshot none (task 4490 ms: download 2897 ms overlapping gunzip 589 ms, parse 2503 ms, sort 0 ms, write 0 ms, index 524 ms: 3 candidates, 63445 repo-hours, 778 releases; waiting 518 ms; commit 0 ms)
2026-11-08T10:08:12Z [load_day 2025-02-02] 2025-02-02 hour 9: 180555 events in 0 files, snapshot none (task 4789 ms: download 2510 ms overlapping gunzip 631 ms, parse 2834 ms, sort 0 ms, write 0 ms, index 509 ms: 2 candidates, 70127 repo-hours, 969 releases; waiting 535 ms; commit 0 ms)
2026-11-08T10:08:19Z [load_day 2025-02-02] 2025-02-02 hour 10: 186528 events in 0 files, snapshot none (task 6439 ms: download 2693 ms overlapping gunzip 897 ms, parse 3990 ms, sort 0 ms, write 0 ms, index 788 ms: 1 candidates, 68356 repo-hours, 873 releases; waiting 506 ms; commit 0 ms)
2026-11-08T10:08:19Z [load_day 2025-02-02] 2025-02-02 hour 11: 183524 events in 0 files, snapshot none (task 6019 ms: download 2937 ms overlapping gunzip 851 ms, parse 3746 ms, sort 0 ms, write 0 ms, index 678 ms: 4 candidates, 66034 repo-hours, 909 releases; waiting 508 ms; commit 0 ms)
2026-11-08T10:08:26Z [load_day 2025-02-02] 2025-02-02 hour 12: 250580 events in 0 files, snapshot none (task 6631 ms: download 3547 ms overlapping gunzip 846 ms, parse 4118 ms, sort 0 ms, write 0 ms, index 822 ms: 9 candidates, 117959 repo-hours, 995 releases; waiting 572 ms; commit 0 ms)
2026-11-08T10:08:26Z [load_day 2025-02-02] 2025-02-02 hour 13: 210085 events in 0 files, snapshot none (task 6283 ms: download 3280 ms overlapping gunzip 854 ms, parse 3811 ms, sort 0 ms, write 0 ms, index 799 ms: 12 candidates, 95612 repo-hours, 1072 releases; waiting 605 ms; commit 0 ms)
2026-11-08T10:08:33Z [load_day 2025-02-02] 2025-02-02 hour 14: 202006 events in 0 files, snapshot none (task 6249 ms: download 3374 ms overlapping gunzip 838 ms, parse 3671 ms, sort 0 ms, write 0 ms, index 832 ms: 10 candidates, 80462 repo-hours, 1092 releases; waiting 557 ms; commit 0 ms)
2026-11-08T10:08:33Z [load_day 2025-02-02] 2025-02-02 hour 15: 214491 events in 0 files, snapshot none (task 6445 ms: download 2901 ms overlapping gunzip 840 ms, parse 3599 ms, sort 0 ms, write 0 ms, index 1208 ms: 7 candidates, 89470 repo-hours, 1244 releases; waiting 503 ms; commit 0 ms)
2026-11-08T10:08:40Z [load_day 2025-02-02] 2025-02-02 hour 16: 206353 events in 0 files, snapshot none (task 6359 ms: download 3682 ms overlapping gunzip 827 ms, parse 3521 ms, sort 0 ms, write 0 ms, index 720 ms: 8 candidates, 83255 repo-hours, 1113 releases; waiting 948 ms; commit 0 ms)
2026-11-08T10:08:40Z [load_day 2025-02-02] 2025-02-02 hour 17: 205118 events in 0 files, snapshot none (task 6450 ms: download 3571 ms overlapping gunzip 878 ms, parse 3815 ms, sort 0 ms, write 0 ms, index 893 ms: 4 candidates, 80425 repo-hours, 1188 releases; waiting 483 ms; commit 0 ms)
2026-11-08T10:08:48Z [load_day 2025-02-02] 2025-02-02 hour 18: 215808 events in 0 files, snapshot none (task 8218 ms: download 4772 ms overlapping gunzip 1201 ms, parse 5432 ms, sort 0 ms, write 0 ms, index 869 ms: 8 candidates, 97038 repo-hours, 1244 releases; waiting 475 ms; commit 0 ms)
2026-11-08T10:08:48Z [load_day 2025-02-02] 2025-02-02 hour 19: 191185 events in 0 files, snapshot none (task 7209 ms: download 3793 ms overlapping gunzip 1229 ms, parse 4640 ms, sort 0 ms, write 0 ms, index 828 ms: 7 candidates, 71910 repo-hours, 1030 releases; waiting 209 ms; commit 0 ms)
2026-11-08T10:08:55Z [load_day 2025-02-02] 2025-02-02 hour 20: 193022 events in 0 files, snapshot none (task 6160 ms: download 3713 ms overlapping gunzip 772 ms, parse 3311 ms, sort 0 ms, write 0 ms, index 994 ms: 2 candidates, 75122 repo-hours, 1158 releases; waiting 763 ms; commit 0 ms)
2026-11-08T10:08:55Z [load_day 2025-02-02] 2025-02-02 hour 21: 189154 events in 0 files, snapshot none (task 5594 ms: download 2823 ms overlapping gunzip 753 ms, parse 3236 ms, sort 0 ms, write 0 ms, index 840 ms: 10 candidates, 75511 repo-hours, 1196 releases; waiting 510 ms; commit 0 ms)
2026-11-08T10:09:02Z [load_day 2025-02-02] 2025-02-02 hour 22: 169261 events in 0 files, snapshot none (task 6369 ms: download 3340 ms overlapping gunzip 930 ms, parse 4020 ms, sort 0 ms, write 0 ms, index 584 ms: 4 candidates, 63718 repo-hours, 1194 releases; waiting 498 ms; commit 0 ms)
2026-11-08T10:09:02Z [load_day 2025-02-02] 2025-02-02 hour 23: 156853 events in 0 files, snapshot none (task 6231 ms: download 3152 ms overlapping gunzip 901 ms, parse 3864 ms, sort 0 ms, write 0 ms, index 657 ms: 5 candidates, 58736 repo-hours, 1017 releases; waiting 486 ms; commit 0 ms)
2026-11-08T10:09:11Z [load_day 2025-02-02] 2025-02-02: repo_hour merged from 24 files to 1 (1802313 rows, 8787 ms)
2026-11-08T10:09:13Z [load_day 2025-02-02] 2025-02-02: index committed in 11133 ms (24 + 1 + 24 files)
2026-11-08T10:09:13Z [load_day 2025-02-02] 2025-02-02: 4382158 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:09:13Z [load_day 2025-02-02] attempt 1 succeeded