orcaLog in

Runs · run 3594

load_day 2025-02-23, attempt 1 succeeded

Host
73ccef5e07c2:259993
Started
2026-11-08T10:29:59Z
Ended
2026-11-08T10:31:37Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
725 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
139.9 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3594/load_day/2025-02-23/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:29:59Z [load_day 2025-02-23] attempt 1 started
2026-11-08T10:30:00Z [load_day 2025-02-23] 2025-02-23: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:30:08Z [load_day 2025-02-23] 2025-02-23 hour 0: 176420 events in 0 files, snapshot none (task 7595 ms: download 2803 ms overlapping gunzip 1082 ms, parse 4769 ms, sort 0 ms, write 0 ms, index 1064 ms: 9 candidates, 84683 repo-hours, 1269 releases; waiting 446 ms; commit 0 ms)
2026-11-08T10:30:08Z [load_day 2025-02-23] 2025-02-23 hour 1: 199144 events in 0 files, snapshot none (task 8106 ms: download 3880 ms overlapping gunzip 1031 ms, parse 4656 ms, sort 0 ms, write 0 ms, index 764 ms: 9 candidates, 110110 repo-hours, 999 releases; waiting 1240 ms; commit 0 ms)
2026-11-08T10:30:14Z [load_day 2025-02-23] 2025-02-23 hour 2: 162182 events in 0 files, snapshot none (task 5086 ms: download 2778 ms overlapping gunzip 723 ms, parse 3005 ms, sort 0 ms, write 0 ms, index 603 ms: 7 candidates, 70957 repo-hours, 733 releases; waiting 491 ms; commit 0 ms)
2026-11-08T10:30:14Z [load_day 2025-02-23] 2025-02-23 hour 3: 183090 events in 0 files, snapshot none (task 5301 ms: download 2347 ms overlapping gunzip 677 ms, parse 3208 ms, sort 0 ms, write 0 ms, index 584 ms: 5 candidates, 71355 repo-hours, 3883 releases; waiting 487 ms; commit 0 ms)
2026-11-08T10:30:18Z [load_day 2025-02-23] 2025-02-23 hour 4: 171023 events in 0 files, snapshot none (task 4168 ms: download 2177 ms overlapping gunzip 547 ms, parse 2505 ms, sort 0 ms, write 0 ms, index 582 ms: 3 candidates, 62321 repo-hours, 611 releases; waiting 194 ms; commit 0 ms)
2026-11-08T10:30:19Z [load_day 2025-02-23] 2025-02-23 hour 5: 178386 events in 0 files, snapshot none (task 4620 ms: download 3092 ms overlapping gunzip 610 ms, parse 2786 ms, sort 0 ms, write 0 ms, index 450 ms: 5 candidates, 64808 repo-hours, 691 releases; waiting 524 ms; commit 0 ms)
2026-11-08T10:30:24Z [load_day 2025-02-23] 2025-02-23 hour 6: 199848 events in 0 files, snapshot none (task 4819 ms: download 2642 ms overlapping gunzip 653 ms, parse 2963 ms, sort 0 ms, write 0 ms, index 591 ms: 4 candidates, 81887 repo-hours, 1090 releases; waiting 343 ms; commit 0 ms)
2026-11-08T10:30:24Z [load_day 2025-02-23] 2025-02-23 hour 7: 184909 events in 0 files, snapshot none (task 4744 ms: download 2438 ms overlapping gunzip 613 ms, parse 2804 ms, sort 0 ms, write 0 ms, index 513 ms: 4 candidates, 67771 repo-hours, 939 releases; waiting 517 ms; commit 0 ms)
2026-11-08T10:30:29Z [load_day 2025-02-23] 2025-02-23 hour 8: 194172 events in 0 files, snapshot none (task 4794 ms: download 2359 ms overlapping gunzip 664 ms, parse 2910 ms, sort 0 ms, write 0 ms, index 582 ms: 4 candidates, 74158 repo-hours, 1033 releases; waiting 374 ms; commit 0 ms)
2026-11-08T10:30:30Z [load_day 2025-02-23] 2025-02-23 hour 9: 200544 events in 0 files, snapshot none (task 5434 ms: download 2697 ms overlapping gunzip 739 ms, parse 3185 ms, sort 0 ms, write 0 ms, index 645 ms: 4 candidates, 81011 repo-hours, 1140 releases; waiting 510 ms; commit 0 ms)
2026-11-08T10:30:36Z [load_day 2025-02-23] 2025-02-23 hour 10: 204485 events in 0 files, snapshot none (task 6756 ms: download 3694 ms overlapping gunzip 972 ms, parse 4314 ms, sort 0 ms, write 0 ms, index 700 ms: 4 candidates, 78244 repo-hours, 994 releases; waiting 518 ms; commit 0 ms)
2026-11-08T10:30:37Z [load_day 2025-02-23] 2025-02-23 hour 11: 204281 events in 0 files, snapshot none (task 6098 ms: download 3460 ms overlapping gunzip 856 ms, parse 3892 ms, sort 0 ms, write 0 ms, index 627 ms: 5 candidates, 76982 repo-hours, 842 releases; waiting 485 ms; commit 0 ms)
2026-11-08T10:30:45Z [load_day 2025-02-23] 2025-02-23 hour 12: 262794 events in 0 files, snapshot none (task 8130 ms: download 4181 ms overlapping gunzip 1140 ms, parse 5118 ms, sort 0 ms, write 0 ms, index 1041 ms: 11 candidates, 127026 repo-hours, 1074 releases; waiting 592 ms; commit 0 ms)
2026-11-08T10:30:45Z [load_day 2025-02-23] 2025-02-23 hour 13: 233870 events in 0 files, snapshot none (task 7494 ms: download 4015 ms overlapping gunzip 1006 ms, parse 4720 ms, sort 0 ms, write 0 ms, index 912 ms: 6 candidates, 103823 repo-hours, 1028 releases; waiting 511 ms; commit 0 ms)
2026-11-08T10:30:53Z [load_day 2025-02-23] 2025-02-23 hour 14: 226736 events in 0 files, snapshot none (task 7463 ms: download 4118 ms overlapping gunzip 1069 ms, parse 4817 ms, sort 0 ms, write 0 ms, index 662 ms: 2 candidates, 87847 repo-hours, 1091 releases; waiting 543 ms; commit 0 ms)
2026-11-08T10:30:53Z [load_day 2025-02-23] 2025-02-23 hour 15: 236854 events in 0 files, snapshot none (task 6683 ms: download 3127 ms overlapping gunzip 948 ms, parse 4376 ms, sort 0 ms, write 0 ms, index 929 ms: 6 candidates, 96335 repo-hours, 1264 releases; waiting 205 ms; commit 0 ms)
2026-11-08T10:31:02Z [load_day 2025-02-23] 2025-02-23 hour 16: 225237 events in 0 files, snapshot none (task 8827 ms: download 4789 ms overlapping gunzip 1284 ms, parse 5851 ms, sort 0 ms, write 0 ms, index 1030 ms: 8 candidates, 89352 repo-hours, 1124 releases; waiting 414 ms; commit 0 ms)
2026-11-08T10:31:02Z [load_day 2025-02-23] 2025-02-23 hour 17: 223415 events in 0 files, snapshot none (task 8575 ms: download 4497 ms overlapping gunzip 1257 ms, parse 5395 ms, sort 0 ms, write 0 ms, index 986 ms: 9 candidates, 86123 repo-hours, 953 releases; waiting 544 ms; commit 0 ms)
2026-11-08T10:31:10Z [load_day 2025-02-23] 2025-02-23 hour 18: 232168 events in 0 files, snapshot none (task 7287 ms: download 4372 ms overlapping gunzip 1155 ms, parse 4912 ms, sort 0 ms, write 0 ms, index 731 ms: 5 candidates, 99931 repo-hours, 1070 releases; waiting 252 ms; commit 0 ms)
2026-11-08T10:31:10Z [load_day 2025-02-23] 2025-02-23 hour 19: 205449 events in 0 files, snapshot none (task 6904 ms: download 3926 ms overlapping gunzip 1031 ms, parse 4410 ms, sort 0 ms, write 0 ms, index 731 ms: 7 candidates, 78289 repo-hours, 1133 releases; waiting 499 ms; commit 0 ms)
2026-11-08T10:31:18Z [load_day 2025-02-23] 2025-02-23 hour 20: 202991 events in 0 files, snapshot none (task 7627 ms: download 4618 ms overlapping gunzip 1128 ms, parse 5101 ms, sort 0 ms, write 0 ms, index 562 ms: 4 candidates, 78647 repo-hours, 1273 releases; waiting 478 ms; commit 0 ms)
2026-11-08T10:31:18Z [load_day 2025-02-23] 2025-02-23 hour 21: 196408 events in 0 files, snapshot none (task 6977 ms: download 3516 ms overlapping gunzip 1017 ms, parse 4537 ms, sort 0 ms, write 0 ms, index 897 ms: 5 candidates, 77713 repo-hours, 1365 releases; waiting 187 ms; commit 0 ms)
2026-11-08T10:31:26Z [load_day 2025-02-23] 2025-02-23 hour 22: 185636 events in 0 files, snapshot none (task 6516 ms: download 3578 ms overlapping gunzip 973 ms, parse 3957 ms, sort 0 ms, write 0 ms, index 821 ms: 10 candidates, 68563 repo-hours, 1213 releases; waiting 481 ms; commit 0 ms)
2026-11-08T10:31:26Z [load_day 2025-02-23] 2025-02-23 hour 23: 175565 events in 0 files, snapshot none (task 6612 ms: download 3151 ms overlapping gunzip 895 ms, parse 4153 ms, sort 0 ms, write 0 ms, index 763 ms: 6 candidates, 63931 repo-hours, 1059 releases; waiting 304 ms; commit 0 ms)
2026-11-08T10:31:34Z [load_day 2025-02-23] 2025-02-23: repo_hour merged from 24 files to 1 (1981867 rows, 8628 ms)
2026-11-08T10:31:37Z [load_day 2025-02-23] 2025-02-23: index committed in 11487 ms (24 + 1 + 24 files)
2026-11-08T10:31:37Z [load_day 2025-02-23] 2025-02-23: 4865607 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:31:37Z [load_day 2025-02-23] attempt 1 succeeded