orcaLog in

Runs · run 3388

load_day 2025-01-02, attempt 1 succeeded

Host
73ccef5e07c2:231515
Started
2026-11-08T09:37:50Z
Ended
2026-11-08T09:39:32Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
726 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
153.2 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3388/load_day/2025-01-02/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:37:50Z [load_day 2025-01-02] attempt 1 started
2026-11-08T09:37:50Z [load_day 2025-01-02] 2025-01-02: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:37:56Z [load_day 2025-01-02] 2025-01-02 hour 0: 155248 events in 0 files, snapshot none (task 4933 ms: download 2312 ms overlapping gunzip 747 ms, parse 3093 ms, sort 0 ms, write 0 ms, index 643 ms: 7 candidates, 76835 repo-hours, 1132 releases; waiting 185 ms; commit 0 ms)
2026-11-08T09:37:56Z [load_day 2025-01-02] 2025-01-02 hour 1: 176796 events in 0 files, snapshot none (task 4975 ms: download 2409 ms overlapping gunzip 657 ms, parse 2906 ms, sort 0 ms, write 0 ms, index 679 ms: 5 candidates, 97855 repo-hours, 909 releases; waiting 452 ms; commit 0 ms)
2026-11-08T09:38:02Z [load_day 2025-01-02] 2025-01-02 hour 2: 156413 events in 0 files, snapshot none (task 5254 ms: download 2840 ms overlapping gunzip 739 ms, parse 3170 ms, sort 0 ms, write 0 ms, index 546 ms: 2 candidates, 69774 repo-hours, 855 releases; waiting 516 ms; commit 0 ms)
2026-11-08T09:38:02Z [load_day 2025-01-02] 2025-01-02 hour 3: 177206 events in 0 files, snapshot none (task 5409 ms: download 2965 ms overlapping gunzip 751 ms, parse 3367 ms, sort 0 ms, write 0 ms, index 524 ms: 3 candidates, 68731 repo-hours, 3969 releases; waiting 511 ms; commit 0 ms)
2026-11-08T09:38:08Z [load_day 2025-01-02] 2025-01-02 hour 4: 156034 events in 0 files, snapshot none (task 5549 ms: download 2710 ms overlapping gunzip 840 ms, parse 3441 ms, sort 0 ms, write 0 ms, index 483 ms: 6 candidates, 56557 repo-hours, 623 releases; waiting 502 ms; commit 0 ms)
2026-11-08T09:38:08Z [load_day 2025-01-02] 2025-01-02 hour 5: 163552 events in 0 files, snapshot none (task 5958 ms: download 3276 ms overlapping gunzip 943 ms, parse 3772 ms, sort 0 ms, write 0 ms, index 474 ms: 5 candidates, 61120 repo-hours, 672 releases; waiting 467 ms; commit 0 ms)
2026-11-08T09:38:15Z [load_day 2025-01-02] 2025-01-02 hour 6: 193975 events in 0 files, snapshot none (task 6873 ms: download 4040 ms overlapping gunzip 937 ms, parse 4311 ms, sort 0 ms, write 0 ms, index 606 ms: 6 candidates, 83818 repo-hours, 950 releases; waiting 586 ms; commit 0 ms)
2026-11-08T09:38:16Z [load_day 2025-01-02] 2025-01-02 hour 7: 188552 events in 0 files, snapshot none (task 7003 ms: download 4413 ms overlapping gunzip 1012 ms, parse 4607 ms, sort 0 ms, write 0 ms, index 503 ms: 3 candidates, 70963 repo-hours, 684 releases; waiting 483 ms; commit 0 ms)
2026-11-08T09:38:24Z [load_day 2025-01-02] 2025-01-02 hour 8: 199124 events in 0 files, snapshot none (task 8516 ms: download 5326 ms overlapping gunzip 1350 ms, parse 5686 ms, sort 0 ms, write 0 ms, index 712 ms: 8 candidates, 78678 repo-hours, 873 releases; waiting 484 ms; commit 0 ms)
2026-11-08T09:38:24Z [load_day 2025-01-02] 2025-01-02 hour 9: 209886 events in 0 files, snapshot none (task 8426 ms: download 5565 ms overlapping gunzip 1330 ms, parse 5573 ms, sort 0 ms, write 0 ms, index 770 ms: 6 candidates, 85689 repo-hours, 1145 releases; waiting 500 ms; commit 0 ms)
2026-11-08T09:38:32Z [load_day 2025-01-02] 2025-01-02 hour 10: 201475 events in 0 files, snapshot none (task 7782 ms: download 5147 ms overlapping gunzip 1210 ms, parse 5102 ms, sort 0 ms, write 0 ms, index 741 ms: 3 candidates, 78889 repo-hours, 933 releases; waiting 447 ms; commit 0 ms)
2026-11-08T09:38:32Z [load_day 2025-01-02] 2025-01-02 hour 11: 202766 events in 0 files, snapshot none (task 7430 ms: download 4746 ms overlapping gunzip 1148 ms, parse 4796 ms, sort 0 ms, write 0 ms, index 681 ms: 3 candidates, 76376 repo-hours, 902 releases; waiting 475 ms; commit 0 ms)
2026-11-08T09:38:40Z [load_day 2025-01-02] 2025-01-02 hour 12: 248484 events in 0 files, snapshot none (task 7097 ms: download 4175 ms overlapping gunzip 963 ms, parse 4369 ms, sort 0 ms, write 0 ms, index 915 ms: 7 candidates, 122959 repo-hours, 1141 releases; waiting 550 ms; commit 0 ms)
2026-11-08T09:38:40Z [load_day 2025-01-02] 2025-01-02 hour 13: 227599 events in 0 files, snapshot none (task 7105 ms: download 4265 ms overlapping gunzip 1056 ms, parse 4374 ms, sort 0 ms, write 0 ms, index 791 ms: 7 candidates, 104483 repo-hours, 1049 releases; waiting 482 ms; commit 0 ms)
2026-11-08T09:38:47Z [load_day 2025-01-02] 2025-01-02 hour 14: 220185 events in 0 files, snapshot none (task 6923 ms: download 4197 ms overlapping gunzip 1048 ms, parse 4318 ms, sort 0 ms, write 0 ms, index 748 ms: 10 candidates, 88632 repo-hours, 1234 releases; waiting 526 ms; commit 0 ms)
2026-11-08T09:38:47Z [load_day 2025-01-02] 2025-01-02 hour 15: 230023 events in 0 files, snapshot none (task 6910 ms: download 4353 ms overlapping gunzip 1115 ms, parse 4612 ms, sort 0 ms, write 0 ms, index 665 ms: 6 candidates, 95761 repo-hours, 1220 releases; waiting 232 ms; commit 0 ms)
2026-11-08T09:38:56Z [load_day 2025-01-02] 2025-01-02 hour 16: 219423 events in 0 files, snapshot none (task 8300 ms: download 5584 ms overlapping gunzip 1381 ms, parse 5624 ms, sort 0 ms, write 0 ms, index 670 ms: 8 candidates, 89801 repo-hours, 1027 releases; waiting 344 ms; commit 0 ms)
2026-11-08T09:38:56Z [load_day 2025-01-02] 2025-01-02 hour 17: 212786 events in 0 files, snapshot none (task 8053 ms: download 5511 ms overlapping gunzip 1198 ms, parse 5451 ms, sort 0 ms, write 0 ms, index 639 ms: 11 candidates, 82613 repo-hours, 977 releases; waiting 554 ms; commit 0 ms)
2026-11-08T09:39:05Z [load_day 2025-01-02] 2025-01-02 hour 18: 219232 events in 0 files, snapshot none (task 8586 ms: download 5565 ms overlapping gunzip 1242 ms, parse 5485 ms, sort 0 ms, write 0 ms, index 1009 ms: 4 candidates, 96681 repo-hours, 1167 releases; waiting 497 ms; commit 0 ms)
2026-11-08T09:39:05Z [load_day 2025-01-02] 2025-01-02 hour 19: 195961 events in 0 files, snapshot none (task 8154 ms: download 5184 ms overlapping gunzip 1178 ms, parse 5142 ms, sort 0 ms, write 0 ms, index 1050 ms: 2 candidates, 74123 repo-hours, 1132 releases; waiting 465 ms; commit 0 ms)
2026-11-08T09:39:12Z [load_day 2025-01-02] 2025-01-02 hour 20: 189537 events in 0 files, snapshot none (task 6611 ms: download 3478 ms overlapping gunzip 982 ms, parse 4260 ms, sort 0 ms, write 0 ms, index 810 ms: 6 candidates, 71962 repo-hours, 953 releases; waiting 298 ms; commit 0 ms)
2026-11-08T09:39:13Z [load_day 2025-01-02] 2025-01-02 hour 21: 189742 events in 0 files, snapshot none (task 7531 ms: download 4196 ms overlapping gunzip 1132 ms, parse 4949 ms, sort 0 ms, write 0 ms, index 639 ms: 16 candidates, 72881 repo-hours, 1095 releases; waiting 536 ms; commit 0 ms)
2026-11-08T09:39:19Z [load_day 2025-01-02] 2025-01-02 hour 22: 179600 events in 0 files, snapshot none (task 6734 ms: download 3354 ms overlapping gunzip 936 ms, parse 4114 ms, sort 0 ms, write 0 ms, index 873 ms: 16 candidates, 65123 repo-hours, 1097 releases; waiting 294 ms; commit 0 ms)
2026-11-08T09:39:20Z [load_day 2025-01-02] 2025-01-02 hour 23: 163657 events in 0 files, snapshot none (task 6776 ms: download 3542 ms overlapping gunzip 1022 ms, parse 4435 ms, sort 0 ms, write 0 ms, index 549 ms: 10 candidates, 60263 repo-hours, 916 releases; waiting 479 ms; commit 0 ms)
2026-11-08T09:39:29Z [load_day 2025-01-02] 2025-01-02: repo_hour merged from 24 files to 1 (1930567 rows, 8491 ms)
2026-11-08T09:39:31Z [load_day 2025-01-02] 2025-01-02: index committed in 11196 ms (24 + 1 + 24 files)
2026-11-08T09:39:31Z [load_day 2025-01-02] 2025-01-02: 4677256 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:39:31Z [load_day 2025-01-02] attempt 1 succeeded