orcaLog in

Runs · run 4548

load_day 2025-10-27, attempt 1 succeeded

Host
73ccef5e07c2:397861
Started
2026-11-08T14:19:20Z
Ended
2026-11-08T14:20:25Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
688 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
64.8 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4548/load_day/2025-10-27/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:19:20Z [load_day 2025-10-27] attempt 1 started
2026-11-08T14:19:21Z [load_day 2025-10-27] 2025-10-27: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:19:24Z [load_day 2025-10-27] 2025-10-27 hour 0: 145710 events in 0 files, snapshot none (task 3055 ms: download 2030 ms overlapping gunzip 388 ms, parse 1242 ms, sort 0 ms, write 0 ms, index 437 ms: 7 candidates, 64435 repo-hours, 730 releases; waiting 709 ms; commit 0 ms)
2026-11-08T14:19:25Z [load_day 2025-10-27] 2025-10-27 hour 1: 151106 events in 0 files, snapshot none (task 3817 ms: download 2773 ms overlapping gunzip 392 ms, parse 1273 ms, sort 0 ms, write 0 ms, index 591 ms: 7 candidates, 83735 repo-hours, 520 releases; waiting 1184 ms; commit 0 ms)
2026-11-08T14:19:28Z [load_day 2025-10-27] 2025-10-27 hour 2: 147071 events in 0 files, snapshot none (task 3208 ms: download 2056 ms overlapping gunzip 395 ms, parse 1222 ms, sort 0 ms, write 0 ms, index 522 ms: 6 candidates, 70018 repo-hours, 556 releases; waiting 795 ms; commit 0 ms)
2026-11-08T14:19:29Z [load_day 2025-10-27] 2025-10-27 hour 3: 149743 events in 0 files, snapshot none (task 3278 ms: download 2218 ms overlapping gunzip 427 ms, parse 1328 ms, sort 0 ms, write 0 ms, index 487 ms: 4 candidates, 65205 repo-hours, 1135 releases; waiting 721 ms; commit 0 ms)
2026-11-08T14:19:34Z [load_day 2025-10-27] 2025-10-27 hour 4: 151517 events in 0 files, snapshot none (task 3705 ms: download 2233 ms overlapping gunzip 594 ms, parse 1881 ms, sort 0 ms, write 0 ms, index 447 ms: 7 candidates, 62158 repo-hours, 937 releases; waiting 519 ms; commit 0 ms)
2026-11-08T14:19:34Z [load_day 2025-10-27] 2025-10-27 hour 5: 146374 events in 0 files, snapshot none (task 3444 ms: download 1951 ms overlapping gunzip 545 ms, parse 1726 ms, sort 0 ms, write 0 ms, index 514 ms: 7 candidates, 62214 repo-hours, 532 releases; waiting 345 ms; commit 0 ms)
2026-11-08T14:19:38Z [load_day 2025-10-27] 2025-10-27 hour 6: 150080 events in 0 files, snapshot none (task 3621 ms: download 1811 ms overlapping gunzip 612 ms, parse 1802 ms, sort 0 ms, write 0 ms, index 548 ms: 3 candidates, 69005 repo-hours, 552 releases; waiting 296 ms; commit 0 ms)
2026-11-08T14:19:38Z [load_day 2025-10-27] 2025-10-27 hour 7: 150747 events in 0 files, snapshot none (task 3629 ms: download 2231 ms overlapping gunzip 625 ms, parse 1701 ms, sort 0 ms, write 0 ms, index 474 ms: 2 candidates, 65164 repo-hours, 419 releases; waiting 535 ms; commit 0 ms)
2026-11-08T14:19:42Z [load_day 2025-10-27] 2025-10-27 hour 8: 147854 events in 0 files, snapshot none (task 3034 ms: download 1625 ms overlapping gunzip 492 ms, parse 1508 ms, sort 0 ms, write 0 ms, index 543 ms: 2 candidates, 67639 repo-hours, 482 releases; waiting 263 ms; commit 0 ms)
2026-11-08T14:19:42Z [load_day 2025-10-27] 2025-10-27 hour 9: 157533 events in 0 files, snapshot none (task 3064 ms: download 1933 ms overlapping gunzip 458 ms, parse 1478 ms, sort 0 ms, write 0 ms, index 511 ms: 5 candidates, 70518 repo-hours, 370 releases; waiting 311 ms; commit 0 ms)
2026-11-08T14:19:45Z [load_day 2025-10-27] 2025-10-27 hour 10: 149214 events in 0 files, snapshot none (task 3208 ms: download 2083 ms overlapping gunzip 510 ms, parse 1607 ms, sort 0 ms, write 0 ms, index 526 ms: 2 candidates, 69025 repo-hours, 326 releases; waiting 287 ms; commit 0 ms)
2026-11-08T14:19:45Z [load_day 2025-10-27] 2025-10-27 hour 11: 155429 events in 0 files, snapshot none (task 3182 ms: download 1525 ms overlapping gunzip 483 ms, parse 1496 ms, sort 0 ms, write 0 ms, index 553 ms: 4 candidates, 68119 repo-hours, 348 releases; waiting 288 ms; commit 0 ms)
2026-11-08T14:19:50Z [load_day 2025-10-27] 2025-10-27 hour 12: 163998 events in 0 files, snapshot none (task 4222 ms: download 1875 ms overlapping gunzip 390 ms, parse 1332 ms, sort 0 ms, write 0 ms, index 1646 ms: 5 candidates, 86043 repo-hours, 115 releases; waiting 563 ms; commit 0 ms)
2026-11-08T14:19:50Z [load_day 2025-10-27] 2025-10-27 hour 13: 159880 events in 0 files, snapshot none (task 3072 ms: download 1992 ms overlapping gunzip 395 ms, parse 1279 ms, sort 0 ms, write 0 ms, index 606 ms: 5 candidates, 82426 repo-hours, 154 releases; waiting 519 ms; commit 0 ms)
2026-11-08T14:19:59Z [load_day 2025-10-27] 2025-10-27 hour 14: 159219 events in 0 files, snapshot none (task 3272 ms: download 1832 ms overlapping gunzip 412 ms, parse 1398 ms, sort 0 ms, write 0 ms, index 528 ms: 5 candidates, 73925 repo-hours, 130 releases; waiting 562 ms; commit 0 ms)
2026-11-08T14:19:59Z [load_day 2025-10-27] 2025-10-27 hour 15: 165790 events in 0 files, snapshot none (task 3021 ms: download 1737 ms overlapping gunzip 320 ms, parse 1303 ms, sort 0 ms, write 0 ms, index 563 ms: 2 candidates, 74932 repo-hours, 139 releases; waiting 559 ms; commit 0 ms)
2026-11-08T14:20:03Z [load_day 2025-10-27] 2025-10-27 hour 16: 163682 events in 0 files, snapshot none (task 3414 ms: download 2263 ms overlapping gunzip 272 ms, parse 1021 ms, sort 0 ms, write 0 ms, index 541 ms: 2 candidates, 70539 repo-hours, 95 releases; waiting 1264 ms; commit 0 ms)
2026-11-08T14:20:03Z [load_day 2025-10-27] 2025-10-27 hour 17: 163993 events in 0 files, snapshot none (task 2891 ms: download 1315 ms overlapping gunzip 306 ms, parse 1015 ms, sort 0 ms, write 0 ms, index 844 ms: 5 candidates, 66951 repo-hours, 79 releases; waiting 372 ms; commit 0 ms)
2026-11-08T14:20:06Z [load_day 2025-10-27] 2025-10-27 hour 18: 168199 events in 0 files, snapshot none (task 2991 ms: download 1714 ms overlapping gunzip 326 ms, parse 1148 ms, sort 0 ms, write 0 ms, index 654 ms: 3 candidates, 72294 repo-hours, 97 releases; waiting 547 ms; commit 0 ms)
2026-11-08T14:20:07Z [load_day 2025-10-27] 2025-10-27 hour 19: 162511 events in 0 files, snapshot none (task 3242 ms: download 1848 ms overlapping gunzip 432 ms, parse 1449 ms, sort 0 ms, write 0 ms, index 493 ms: 3 candidates, 61405 repo-hours, 168 releases; waiting 529 ms; commit 0 ms)
2026-11-08T14:20:10Z [load_day 2025-10-27] 2025-10-27 hour 20: 163274 events in 0 files, snapshot none (task 3619 ms: download 2263 ms overlapping gunzip 439 ms, parse 1455 ms, sort 0 ms, write 0 ms, index 534 ms: 3 candidates, 62488 repo-hours, 154 releases; waiting 808 ms; commit 0 ms)
2026-11-08T14:20:10Z [load_day 2025-10-27] 2025-10-27 hour 21: 163821 events in 0 files, snapshot none (task 3357 ms: download 1872 ms overlapping gunzip 402 ms, parse 1436 ms, sort 0 ms, write 0 ms, index 492 ms: 6 candidates, 58539 repo-hours, 202 releases; waiting 539 ms; commit 0 ms)
2026-11-08T14:20:15Z [load_day 2025-10-27] 2025-10-27 hour 22: 157938 events in 0 files, snapshot none (task 3647 ms: download 2139 ms overlapping gunzip 400 ms, parse 1335 ms, sort 0 ms, write 0 ms, index 580 ms: 4 candidates, 56710 repo-hours, 388 releases; waiting 1012 ms; commit 0 ms)
2026-11-08T14:20:15Z [load_day 2025-10-27] 2025-10-27 hour 23: 159799 events in 0 files, snapshot none (task 4476 ms: download 3122 ms overlapping gunzip 368 ms, parse 1263 ms, sort 0 ms, write 0 ms, index 443 ms: 8 candidates, 55468 repo-hours, 469 releases; waiting 2026 ms; commit 0 ms)
2026-11-08T14:20:23Z [load_day 2025-10-27] 2025-10-27: repo_hour merged from 24 files to 1 (1638955 rows, 7374 ms)
2026-11-08T14:20:25Z [load_day 2025-10-27] 2025-10-27: index committed in 10105 ms (24 + 1 + 24 files)
2026-11-08T14:20:25Z [load_day 2025-10-27] 2025-10-27: 3754482 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:20:25Z [load_day 2025-10-27] attempt 1 succeeded