orcaLog in

Runs · run 3599

load_day 2025-02-24, attempt 1 succeeded

Host
73ccef5e07c2:260500
Started
2026-11-08T10:30:28Z
Ended
2026-11-08T10:32:54Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
948 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
231.5 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3599/load_day/2025-02-24/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:30:28Z [load_day 2025-02-24] attempt 1 started
2026-11-08T10:30:29Z [load_day 2025-02-24] 2025-02-24: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:30:37Z [load_day 2025-02-24] 2025-02-24 hour 0: 202835 events in 0 files, snapshot none (task 7930 ms: download 5389 ms overlapping gunzip 1246 ms, parse 5160 ms, sort 0 ms, write 0 ms, index 715 ms: 8 candidates, 93375 repo-hours, 1370 releases; waiting 567 ms; commit 0 ms)
2026-11-08T10:30:38Z [load_day 2025-02-24] 2025-02-24 hour 1: 234429 events in 0 files, snapshot none (task 8721 ms: download 5898 ms overlapping gunzip 1392 ms, parse 5471 ms, sort 0 ms, write 0 ms, index 936 ms: 3 candidates, 123256 repo-hours, 1099 releases; waiting 495 ms; commit 0 ms)
2026-11-08T10:30:46Z [load_day 2025-02-24] 2025-02-24 hour 2: 208774 events in 0 files, snapshot none (task 8192 ms: download 5308 ms overlapping gunzip 1396 ms, parse 5203 ms, sort 0 ms, write 0 ms, index 752 ms: 8 candidates, 92344 repo-hours, 1000 releases; waiting 527 ms; commit 0 ms)
2026-11-08T10:30:47Z [load_day 2025-02-24] 2025-02-24 hour 3: 228012 events in 0 files, snapshot none (task 8477 ms: download 5855 ms overlapping gunzip 1424 ms, parse 5549 ms, sort 0 ms, write 0 ms, index 776 ms: 4 candidates, 90564 repo-hours, 3913 releases; waiting 358 ms; commit 0 ms)
2026-11-08T10:30:55Z [load_day 2025-02-24] 2025-02-24 hour 4: 210900 events in 0 files, snapshot none (task 8028 ms: download 5616 ms overlapping gunzip 1371 ms, parse 5165 ms, sort 0 ms, write 0 ms, index 719 ms: 6 candidates, 76922 repo-hours, 744 releases; waiting 533 ms; commit 0 ms)
2026-11-08T10:30:57Z [load_day 2025-02-24] 2025-02-24 hour 5: 221570 events in 0 files, snapshot none (task 8904 ms: download 5685 ms overlapping gunzip 1446 ms, parse 5441 ms, sort 0 ms, write 0 ms, index 1051 ms: 7 candidates, 82929 repo-hours, 874 releases; waiting 641 ms; commit 0 ms)
2026-11-08T10:31:06Z [load_day 2025-02-24] 2025-02-24 hour 6: 242285 events in 0 files, snapshot none (task 10674 ms: download 7085 ms overlapping gunzip 1721 ms, parse 7169 ms, sort 0 ms, write 0 ms, index 1370 ms: 2 candidates, 105372 repo-hours, 1153 releases; waiting 194 ms; commit 0 ms)
2026-11-08T10:31:09Z [load_day 2025-02-24] 2025-02-24 hour 7: 241071 events in 0 files, snapshot none (task 11564 ms: download 8471 ms overlapping gunzip 1997 ms, parse 7706 ms, sort 0 ms, write 0 ms, index 1054 ms: 7 candidates, 94868 repo-hours, 972 releases; waiting 476 ms; commit 0 ms)
2026-11-08T10:31:18Z [load_day 2025-02-24] 2025-02-24 hour 8: 253253 events in 0 files, snapshot none (task 11032 ms: download 7166 ms overlapping gunzip 1905 ms, parse 7254 ms, sort 0 ms, write 0 ms, index 1144 ms: 8 candidates, 104613 repo-hours, 1056 releases; waiting 480 ms; commit 0 ms)
2026-11-08T10:31:21Z [load_day 2025-02-24] 2025-02-24 hour 9: 264821 events in 0 files, snapshot none (task 11260 ms: download 8255 ms overlapping gunzip 1770 ms, parse 6968 ms, sort 0 ms, write 0 ms, index 1277 ms: 5 candidates, 111972 repo-hours, 1350 releases; waiting 949 ms; commit 0 ms)
2026-11-08T10:31:29Z [load_day 2025-02-24] 2025-02-24 hour 10: 263561 events in 0 files, snapshot none (task 10565 ms: download 7750 ms overlapping gunzip 1713 ms, parse 7166 ms, sort 0 ms, write 0 ms, index 766 ms: 6 candidates, 107172 repo-hours, 1225 releases; waiting 608 ms; commit 0 ms)
2026-11-08T10:31:31Z [load_day 2025-02-24] 2025-02-24 hour 11: 256108 events in 0 files, snapshot none (task 9290 ms: download 6731 ms overlapping gunzip 1567 ms, parse 6114 ms, sort 0 ms, write 0 ms, index 792 ms: 6 candidates, 101105 repo-hours, 1123 releases; waiting 531 ms; commit 0 ms)
2026-11-08T10:31:38Z [load_day 2025-02-24] 2025-02-24 hour 12: 285109 events in 0 files, snapshot none (task 8914 ms: download 5989 ms overlapping gunzip 1395 ms, parse 5610 ms, sort 0 ms, write 0 ms, index 1088 ms: 5 candidates, 140703 repo-hours, 1370 releases; waiting 529 ms; commit 0 ms)
2026-11-08T10:31:40Z [load_day 2025-02-24] 2025-02-24 hour 13: 273629 events in 0 files, snapshot none (task 8501 ms: download 5931 ms overlapping gunzip 1400 ms, parse 5484 ms, sort 0 ms, write 0 ms, index 872 ms: 6 candidates, 127289 repo-hours, 1335 releases; waiting 515 ms; commit 0 ms)
2026-11-08T10:31:50Z [load_day 2025-02-24] 2025-02-24 hour 14: 260816 events in 0 files, snapshot none (task 11138 ms: download 8394 ms overlapping gunzip 1982 ms, parse 7538 ms, sort 0 ms, write 0 ms, index 805 ms: 15 candidates, 111816 repo-hours, 1295 releases; waiting 538 ms; commit 0 ms)
2026-11-08T10:31:51Z [load_day 2025-02-24] 2025-02-24 hour 15: 246139 events in 0 files, snapshot none (task 10764 ms: download 8069 ms overlapping gunzip 1878 ms, parse 7213 ms, sort 0 ms, write 0 ms, index 960 ms: 9 candidates, 111514 repo-hours, 1374 releases; waiting 489 ms; commit 0 ms)
2026-11-08T10:32:05Z [load_day 2025-02-24] 2025-02-24 hour 16: 271544 events in 0 files, snapshot none (task 14098 ms: download 9791 ms overlapping gunzip 2413 ms, parse 9653 ms, sort 0 ms, write 0 ms, index 1243 ms: 11 candidates, 114398 repo-hours, 1466 releases; waiting 514 ms; commit 0 ms)
2026-11-08T10:32:05Z [load_day 2025-02-24] 2025-02-24 hour 17: 266821 events in 0 files, snapshot none (task 13294 ms: download 9577 ms overlapping gunzip 2340 ms, parse 9572 ms, sort 0 ms, write 0 ms, index 906 ms: 12 candidates, 107343 repo-hours, 1169 releases; waiting 175 ms; commit 0 ms)
2026-11-08T10:32:17Z [load_day 2025-02-24] 2025-02-24 hour 18: 270757 events in 0 files, snapshot none (task 11743 ms: download 8732 ms overlapping gunzip 1972 ms, parse 7974 ms, sort 0 ms, write 0 ms, index 996 ms: 11 candidates, 118011 repo-hours, 1263 releases; waiting 517 ms; commit 0 ms)
2026-11-08T10:32:17Z [load_day 2025-02-24] 2025-02-24 hour 19: 254664 events in 0 files, snapshot none (task 11579 ms: download 8419 ms overlapping gunzip 1962 ms, parse 7971 ms, sort 0 ms, write 0 ms, index 859 ms: 13 candidates, 99166 repo-hours, 1111 releases; waiting 503 ms; commit 0 ms)
2026-11-08T10:32:29Z [load_day 2025-02-24] 2025-02-24 hour 20: 248505 events in 0 files, snapshot none (task 11676 ms: download 9078 ms overlapping gunzip 1982 ms, parse 8151 ms, sort 0 ms, write 0 ms, index 744 ms: 10 candidates, 97004 repo-hours, 1115 releases; waiting 515 ms; commit 0 ms)
2026-11-08T10:32:30Z [load_day 2025-02-24] 2025-02-24 hour 21: 246641 events in 0 files, snapshot none (task 11737 ms: download 9166 ms overlapping gunzip 1989 ms, parse 8238 ms, sort 0 ms, write 0 ms, index 686 ms: 9 candidates, 94994 repo-hours, 1319 releases; waiting 505 ms; commit 0 ms)
2026-11-08T10:32:41Z [load_day 2025-02-24] 2025-02-24 hour 22: 231728 events in 0 files, snapshot none (task 10651 ms: download 8153 ms overlapping gunzip 1866 ms, parse 7293 ms, sort 0 ms, write 0 ms, index 708 ms: 13 candidates, 86495 repo-hours, 1302 releases; waiting 557 ms; commit 0 ms)
2026-11-08T10:32:41Z [load_day 2025-02-24] 2025-02-24 hour 23: 220422 events in 0 files, snapshot none (task 10633 ms: download 8142 ms overlapping gunzip 1810 ms, parse 7375 ms, sort 0 ms, write 0 ms, index 683 ms: 5 candidates, 79485 repo-hours, 1067 releases; waiting 471 ms; commit 0 ms)
2026-11-08T10:32:52Z [load_day 2025-02-24] 2025-02-24: repo_hour merged from 24 files to 1 (2472710 rows, 11100 ms)
2026-11-08T10:32:54Z [load_day 2025-02-24] 2025-02-24: index committed in 13390 ms (24 + 1 + 24 files)
2026-11-08T10:32:54Z [load_day 2025-02-24] 2025-02-24: 5904394 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:32:54Z [load_day 2025-02-24] attempt 1 succeeded