orcaLog in

Runs · run 3852

load_day 2025-05-02, attempt 1 succeeded

Host
73ccef5e07c2:297454
Started
2026-11-08T11:43:27Z
Ended
2026-11-08T11:45:25Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
765 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
178.9 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3852/load_day/2025-05-02/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:43:27Z [load_day 2025-05-02] attempt 1 started
2026-11-08T11:43:28Z [load_day 2025-05-02] 2025-05-02: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:43:37Z [load_day 2025-05-02] 2025-05-02 hour 0: 188895 events in 0 files, snapshot none (task 8080 ms: download 5171 ms overlapping gunzip 1304 ms, parse 5243 ms, sort 0 ms, write 0 ms, index 613 ms: 9 candidates, 86107 repo-hours, 1220 releases; waiting 542 ms; commit 0 ms)
2026-11-08T11:43:37Z [load_day 2025-05-02] 2025-05-02 hour 1: 212047 events in 0 files, snapshot none (task 8288 ms: download 5161 ms overlapping gunzip 1172 ms, parse 5435 ms, sort 0 ms, write 0 ms, index 816 ms: 5 candidates, 114304 repo-hours, 980 releases; waiting 479 ms; commit 0 ms)
2026-11-08T11:43:45Z [load_day 2025-05-02] 2025-05-02 hour 2: 184054 events in 0 files, snapshot none (task 7738 ms: download 4440 ms overlapping gunzip 1146 ms, parse 5014 ms, sort 0 ms, write 0 ms, index 674 ms: 2 candidates, 75870 repo-hours, 858 releases; waiting 499 ms; commit 0 ms)
2026-11-08T11:43:46Z [load_day 2025-05-02] 2025-05-02 hour 3: 196148 events in 0 files, snapshot none (task 8515 ms: download 5106 ms overlapping gunzip 1343 ms, parse 5615 ms, sort 0 ms, write 0 ms, index 692 ms: 4 candidates, 77926 repo-hours, 2923 releases; waiting 433 ms; commit 0 ms)
2026-11-08T11:43:53Z [load_day 2025-05-02] 2025-05-02 hour 4: 185939 events in 0 files, snapshot none (task 7544 ms: download 3543 ms overlapping gunzip 1205 ms, parse 4677 ms, sort 0 ms, write 0 ms, index 846 ms: 6 candidates, 70460 repo-hours, 801 releases; waiting 483 ms; commit 0 ms)
2026-11-08T11:43:54Z [load_day 2025-05-02] 2025-05-02 hour 5: 197291 events in 0 files, snapshot none (task 7632 ms: download 4644 ms overlapping gunzip 1130 ms, parse 4949 ms, sort 0 ms, write 0 ms, index 702 ms: 4 candidates, 74640 repo-hours, 811 releases; waiting 522 ms; commit 0 ms)
2026-11-08T11:44:02Z [load_day 2025-05-02] 2025-05-02 hour 6: 213076 events in 0 files, snapshot none (task 8339 ms: download 5120 ms overlapping gunzip 1203 ms, parse 5224 ms, sort 0 ms, write 0 ms, index 1108 ms: 3 candidates, 92027 repo-hours, 1005 releases; waiting 528 ms; commit 0 ms)
2026-11-08T11:44:03Z [load_day 2025-05-02] 2025-05-02 hour 7: 209289 events in 0 files, snapshot none (task 8684 ms: download 5253 ms overlapping gunzip 1300 ms, parse 5566 ms, sort 0 ms, write 0 ms, index 1044 ms: 6 candidates, 83036 repo-hours, 860 releases; waiting 494 ms; commit 0 ms)
2026-11-08T11:44:11Z [load_day 2025-05-02] 2025-05-02 hour 8: 213000 events in 0 files, snapshot none (task 8559 ms: download 5956 ms overlapping gunzip 1317 ms, parse 5474 ms, sort 0 ms, write 0 ms, index 665 ms: 2 candidates, 87315 repo-hours, 1051 releases; waiting 740 ms; commit 0 ms)
2026-11-08T11:44:12Z [load_day 2025-05-02] 2025-05-02 hour 9: 226143 events in 0 files, snapshot none (task 8180 ms: download 5626 ms overlapping gunzip 1246 ms, parse 5431 ms, sort 0 ms, write 0 ms, index 703 ms: 3 candidates, 91899 repo-hours, 1425 releases; waiting 518 ms; commit 0 ms)
2026-11-08T11:44:20Z [load_day 2025-05-02] 2025-05-02 hour 10: 226900 events in 0 files, snapshot none (task 8160 ms: download 5574 ms overlapping gunzip 1246 ms, parse 5418 ms, sort 0 ms, write 0 ms, index 702 ms: 3 candidates, 93279 repo-hours, 930 releases; waiting 492 ms; commit 0 ms)
2026-11-08T11:44:20Z [load_day 2025-05-02] 2025-05-02 hour 11: 227337 events in 0 files, snapshot none (task 8205 ms: download 5610 ms overlapping gunzip 1263 ms, parse 5396 ms, sort 0 ms, write 0 ms, index 625 ms: 7 candidates, 88443 repo-hours, 1042 releases; waiting 540 ms; commit 0 ms)
2026-11-08T11:44:28Z [load_day 2025-05-02] 2025-05-02 hour 12: 267424 events in 0 files, snapshot none (task 7688 ms: download 4771 ms overlapping gunzip 1079 ms, parse 4839 ms, sort 0 ms, write 0 ms, index 943 ms: 6 candidates, 132388 repo-hours, 1289 releases; waiting 511 ms; commit 0 ms)
2026-11-08T11:44:29Z [load_day 2025-05-02] 2025-05-02 hour 13: 256668 events in 0 files, snapshot none (task 7827 ms: download 5053 ms overlapping gunzip 1143 ms, parse 4951 ms, sort 0 ms, write 0 ms, index 831 ms: 6 candidates, 119083 repo-hours, 1223 releases; waiting 506 ms; commit 0 ms)
2026-11-08T11:44:38Z [load_day 2025-05-02] 2025-05-02 hour 14: 244096 events in 0 files, snapshot none (task 8950 ms: download 5522 ms overlapping gunzip 1342 ms, parse 5725 ms, sort 0 ms, write 0 ms, index 923 ms: 12 candidates, 102519 repo-hours, 1359 releases; waiting 582 ms; commit 0 ms)
2026-11-08T11:44:38Z [load_day 2025-05-02] 2025-05-02 hour 15: 247471 events in 0 files, snapshot none (task 9333 ms: download 5987 ms overlapping gunzip 1459 ms, parse 6112 ms, sort 0 ms, write 0 ms, index 779 ms: 13 candidates, 103527 repo-hours, 1472 releases; waiting 562 ms; commit 0 ms)
2026-11-08T11:44:46Z [load_day 2025-05-02] 2025-05-02 hour 16: 214799 events in 0 files, snapshot none (task 8196 ms: download 5432 ms overlapping gunzip 1310 ms, parse 5561 ms, sort 0 ms, write 0 ms, index 697 ms: 11 candidates, 92708 repo-hours, 1063 releases; waiting 408 ms; commit 0 ms)
2026-11-08T11:44:47Z [load_day 2025-05-02] 2025-05-02 hour 17: 203646 events in 0 files, snapshot none (task 7886 ms: download 5248 ms overlapping gunzip 1256 ms, parse 5294 ms, sort 0 ms, write 0 ms, index 631 ms: 9 candidates, 85596 repo-hours, 928 releases; waiting 384 ms; commit 0 ms)
2026-11-08T11:44:56Z [load_day 2025-05-02] 2025-05-02 hour 18: 214339 events in 0 files, snapshot none (task 8921 ms: download 5880 ms overlapping gunzip 1392 ms, parse 5932 ms, sort 0 ms, write 0 ms, index 818 ms: 10 candidates, 94958 repo-hours, 1021 releases; waiting 452 ms; commit 0 ms)
2026-11-08T11:44:56Z [load_day 2025-05-02] 2025-05-02 hour 19: 193109 events in 0 files, snapshot none (task 7237 ms: download 4671 ms overlapping gunzip 1110 ms, parse 4664 ms, sort 0 ms, write 0 ms, index 660 ms: 11 candidates, 77526 repo-hours, 936 releases; waiting 502 ms; commit 0 ms)
2026-11-08T11:45:05Z [load_day 2025-05-02] 2025-05-02 hour 20: 205568 events in 0 files, snapshot none (task 8436 ms: download 4949 ms overlapping gunzip 1332 ms, parse 5700 ms, sort 0 ms, write 0 ms, index 634 ms: 8 candidates, 80557 repo-hours, 956 releases; waiting 461 ms; commit 0 ms)
2026-11-08T11:45:05Z [load_day 2025-05-02] 2025-05-02 hour 21: 193374 events in 0 files, snapshot none (task 8104 ms: download 4627 ms overlapping gunzip 1448 ms, parse 5511 ms, sort 0 ms, write 0 ms, index 709 ms: 5 candidates, 75374 repo-hours, 1015 releases; waiting 200 ms; commit 0 ms)
2026-11-08T11:45:12Z [load_day 2025-05-02] 2025-05-02 hour 22: 166278 events in 0 files, snapshot none (task 6339 ms: download 3608 ms overlapping gunzip 979 ms, parse 3977 ms, sort 0 ms, write 0 ms, index 636 ms: 7 candidates, 66077 repo-hours, 887 releases; waiting 533 ms; commit 0 ms)
2026-11-08T11:45:12Z [load_day 2025-05-02] 2025-05-02 hour 23: 163345 events in 0 files, snapshot none (task 6936 ms: download 4136 ms overlapping gunzip 988 ms, parse 4208 ms, sort 0 ms, write 0 ms, index 499 ms: 5 candidates, 62143 repo-hours, 992 releases; waiting 872 ms; commit 0 ms)
2026-11-08T11:45:22Z [load_day 2025-05-02] 2025-05-02: repo_hour merged from 24 files to 1 (2127762 rows, 9508 ms)
2026-11-08T11:45:25Z [load_day 2025-05-02] 2025-05-02: index committed in 12317 ms (24 + 1 + 24 files)
2026-11-08T11:45:25Z [load_day 2025-05-02] 2025-05-02: 5050236 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:45:25Z [load_day 2025-05-02] attempt 1 succeeded