orcaLog in

Runs · run 4346

load_day 2025-09-03, attempt 1 succeeded

Host
73ccef5e07c2:372309
Started
2026-11-08T13:40:27Z
Ended
2026-11-08T13:42:13Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
699 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
154.2 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4346/load_day/2025-09-03/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:40:27Z [load_day 2025-09-03] attempt 1 started
2026-11-08T13:40:28Z [load_day 2025-09-03] 2025-09-03: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:40:35Z [load_day 2025-09-03] 2025-09-03 hour 0: 148622 events in 0 files, snapshot none (task 6535 ms: download 3976 ms overlapping gunzip 1031 ms, parse 4057 ms, sort 0 ms, write 0 ms, index 629 ms: 4 candidates, 76389 repo-hours, 1056 releases; waiting 515 ms; commit 0 ms)
2026-11-08T13:40:35Z [load_day 2025-09-03] 2025-09-03 hour 1: 158995 events in 0 files, snapshot none (task 6153 ms: download 3446 ms overlapping gunzip 853 ms, parse 3803 ms, sort 0 ms, write 0 ms, index 660 ms: 2 candidates, 93345 repo-hours, 775 releases; waiting 608 ms; commit 0 ms)
2026-11-08T13:40:41Z [load_day 2025-09-03] 2025-09-03 hour 2: 146301 events in 0 files, snapshot none (task 5588 ms: download 3274 ms overlapping gunzip 857 ms, parse 3425 ms, sort 0 ms, write 0 ms, index 514 ms: 4 candidates, 72045 repo-hours, 821 releases; waiting 528 ms; commit 0 ms)
2026-11-08T13:40:41Z [load_day 2025-09-03] 2025-09-03 hour 3: 145498 events in 0 files, snapshot none (task 5201 ms: download 2957 ms overlapping gunzip 858 ms, parse 3293 ms, sort 0 ms, write 0 ms, index 502 ms: 5 candidates, 64288 repo-hours, 1823 releases; waiting 220 ms; commit 0 ms)
2026-11-08T13:40:48Z [load_day 2025-09-03] 2025-09-03 hour 4: 148992 events in 0 files, snapshot none (task 5888 ms: download 3580 ms overlapping gunzip 947 ms, parse 3630 ms, sort 0 ms, write 0 ms, index 503 ms: 6 candidates, 63021 repo-hours, 825 releases; waiting 520 ms; commit 0 ms)
2026-11-08T13:40:48Z [load_day 2025-09-03] 2025-09-03 hour 5: 153180 events in 0 files, snapshot none (task 6201 ms: download 4021 ms overlapping gunzip 1035 ms, parse 3880 ms, sort 0 ms, write 0 ms, index 465 ms: 5 candidates, 64706 repo-hours, 810 releases; waiting 548 ms; commit 0 ms)
2026-11-08T13:40:54Z [load_day 2025-09-03] 2025-09-03 hour 6: 159745 events in 0 files, snapshot none (task 5489 ms: download 2971 ms overlapping gunzip 886 ms, parse 3408 ms, sort 0 ms, write 0 ms, index 607 ms: 3 candidates, 77856 repo-hours, 770 releases; waiting 241 ms; commit 0 ms)
2026-11-08T13:40:54Z [load_day 2025-09-03] 2025-09-03 hour 7: 161799 events in 0 files, snapshot none (task 5737 ms: download 3474 ms overlapping gunzip 974 ms, parse 3761 ms, sort 0 ms, write 0 ms, index 548 ms: 2 candidates, 72715 repo-hours, 746 releases; waiting 232 ms; commit 0 ms)
2026-11-08T13:41:01Z [load_day 2025-09-03] 2025-09-03 hour 8: 162101 events in 0 files, snapshot none (task 6675 ms: download 4298 ms overlapping gunzip 975 ms, parse 3681 ms, sort 0 ms, write 0 ms, index 621 ms: 6 candidates, 79297 repo-hours, 937 releases; waiting 1117 ms; commit 0 ms)
2026-11-08T13:41:01Z [load_day 2025-09-03] 2025-09-03 hour 9: 163687 events in 0 files, snapshot none (task 6041 ms: download 3716 ms overlapping gunzip 943 ms, parse 3780 ms, sort 0 ms, write 0 ms, index 595 ms: 3 candidates, 80202 repo-hours, 1110 releases; waiting 504 ms; commit 0 ms)
2026-11-08T13:41:10Z [load_day 2025-09-03] 2025-09-03 hour 10: 163756 events in 0 files, snapshot none (task 8228 ms: download 5212 ms overlapping gunzip 1241 ms, parse 5053 ms, sort 0 ms, write 0 ms, index 1180 ms: 11 candidates, 79810 repo-hours, 972 releases; waiting 526 ms; commit 0 ms)
2026-11-08T13:41:10Z [load_day 2025-09-03] 2025-09-03 hour 11: 160472 events in 0 files, snapshot none (task 9132 ms: download 5404 ms overlapping gunzip 1374 ms, parse 5584 ms, sort 0 ms, write 0 ms, index 790 ms: 5 candidates, 76018 repo-hours, 853 releases; waiting 1097 ms; commit 0 ms)
2026-11-08T13:41:21Z [load_day 2025-09-03] 2025-09-03 hour 12: 166773 events in 0 files, snapshot none (task 10999 ms: download 8160 ms overlapping gunzip 1309 ms, parse 5571 ms, sort 0 ms, write 0 ms, index 756 ms: 7 candidates, 98390 repo-hours, 930 releases; waiting 3056 ms; commit 0 ms)
2026-11-08T13:41:21Z [load_day 2025-09-03] 2025-09-03 hour 13: 167992 events in 0 files, snapshot none (task 8676 ms: download 4995 ms overlapping gunzip 1407 ms, parse 5590 ms, sort 0 ms, write 0 ms, index 747 ms: 8 candidates, 91222 repo-hours, 876 releases; waiting 659 ms; commit 0 ms)
2026-11-08T13:41:30Z [load_day 2025-09-03] 2025-09-03 hour 14: 162524 events in 0 files, snapshot none (task 7983 ms: download 5246 ms overlapping gunzip 1286 ms, parse 5218 ms, sort 0 ms, write 0 ms, index 807 ms: 6 candidates, 83556 repo-hours, 925 releases; waiting 359 ms; commit 0 ms)
2026-11-08T13:41:30Z [load_day 2025-09-03] 2025-09-03 hour 15: 163194 events in 0 files, snapshot none (task 7359 ms: download 4633 ms overlapping gunzip 1205 ms, parse 4813 ms, sort 0 ms, write 0 ms, index 678 ms: 8 candidates, 83823 repo-hours, 885 releases; waiting 358 ms; commit 0 ms)
2026-11-08T13:41:38Z [load_day 2025-09-03] 2025-09-03 hour 16: 163051 events in 0 files, snapshot none (task 7185 ms: download 4528 ms overlapping gunzip 1135 ms, parse 4494 ms, sort 0 ms, write 0 ms, index 699 ms: 4 candidates, 82382 repo-hours, 930 releases; waiting 584 ms; commit 0 ms)
2026-11-08T13:41:38Z [load_day 2025-09-03] 2025-09-03 hour 17: 164153 events in 0 files, snapshot none (task 7490 ms: download 4913 ms overlapping gunzip 1194 ms, parse 4754 ms, sort 0 ms, write 0 ms, index 774 ms: 6 candidates, 78910 repo-hours, 894 releases; waiting 528 ms; commit 0 ms)
2026-11-08T13:41:46Z [load_day 2025-09-03] 2025-09-03 hour 18: 160385 events in 0 files, snapshot none (task 7394 ms: download 4776 ms overlapping gunzip 1157 ms, parse 4944 ms, sort 0 ms, write 0 ms, index 670 ms: 5 candidates, 81872 repo-hours, 935 releases; waiting 297 ms; commit 0 ms)
2026-11-08T13:41:46Z [load_day 2025-09-03] 2025-09-03 hour 19: 160986 events in 0 files, snapshot none (task 7113 ms: download 4598 ms overlapping gunzip 1215 ms, parse 4739 ms, sort 0 ms, write 0 ms, index 568 ms: 6 candidates, 71710 repo-hours, 807 releases; waiting 253 ms; commit 0 ms)
2026-11-08T13:41:53Z [load_day 2025-09-03] 2025-09-03 hour 20: 153080 events in 0 files, snapshot none (task 7124 ms: download 4685 ms overlapping gunzip 1148 ms, parse 4674 ms, sort 0 ms, write 0 ms, index 572 ms: 7 candidates, 70553 repo-hours, 877 releases; waiting 470 ms; commit 0 ms)
2026-11-08T13:41:53Z [load_day 2025-09-03] 2025-09-03 hour 21: 156124 events in 0 files, snapshot none (task 6776 ms: download 4168 ms overlapping gunzip 1129 ms, parse 4643 ms, sort 0 ms, write 0 ms, index 531 ms: 5 candidates, 66663 repo-hours, 1034 releases; waiting 200 ms; commit 0 ms)
2026-11-08T13:42:01Z [load_day 2025-09-03] 2025-09-03 hour 22: 148639 events in 0 files, snapshot none (task 7302 ms: download 4037 ms overlapping gunzip 1157 ms, parse 4799 ms, sort 0 ms, write 0 ms, index 516 ms: 2 candidates, 61647 repo-hours, 927 releases; waiting 573 ms; commit 0 ms)
2026-11-08T13:42:01Z [load_day 2025-09-03] 2025-09-03 hour 23: 142977 events in 0 files, snapshot none (task 7218 ms: download 4281 ms overlapping gunzip 1132 ms, parse 4743 ms, sort 0 ms, write 0 ms, index 477 ms: 7 candidates, 57811 repo-hours, 839 releases; waiting 535 ms; commit 0 ms)
2026-11-08T13:42:10Z [load_day 2025-09-03] 2025-09-03: repo_hour merged from 24 files to 1 (1828231 rows, 8648 ms)
2026-11-08T13:42:13Z [load_day 2025-09-03] 2025-09-03: index committed in 11753 ms (24 + 1 + 24 files)
2026-11-08T13:42:13Z [load_day 2025-09-03] 2025-09-03: 3783026 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:42:13Z [load_day 2025-09-03] attempt 1 succeeded