orcaLog in

Runs · run 3744

load_day 2025-04-02, attempt 1 succeeded

Host
73ccef5e07c2:281537
Started
2026-11-08T11:11:13Z
Ended
2026-11-08T11:13:32Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
856 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
217.7 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3744/load_day/2025-04-02/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:11:13Z [load_day 2025-04-02] attempt 1 started
2026-11-08T11:11:14Z [load_day 2025-04-02] 2025-04-02: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:11:23Z [load_day 2025-04-02] 2025-04-02 hour 0: 210261 events in 0 files, snapshot none (task 9082 ms: download 5194 ms overlapping gunzip 1430 ms, parse 5939 ms, sort 0 ms, write 0 ms, index 1014 ms: 7 candidates, 93976 repo-hours, 1197 releases; waiting 423 ms; commit 0 ms)
2026-11-08T11:11:24Z [load_day 2025-04-02] 2025-04-02 hour 1: 238686 events in 0 files, snapshot none (task 9379 ms: download 5383 ms overlapping gunzip 1395 ms, parse 5938 ms, sort 0 ms, write 0 ms, index 1139 ms: 11 candidates, 126343 repo-hours, 1138 releases; waiting 606 ms; commit 0 ms)
2026-11-08T11:11:32Z [load_day 2025-04-02] 2025-04-02 hour 2: 203362 events in 0 files, snapshot none (task 8348 ms: download 5103 ms overlapping gunzip 1279 ms, parse 5206 ms, sort 0 ms, write 0 ms, index 940 ms: 6 candidates, 86658 repo-hours, 1045 releases; waiting 554 ms; commit 0 ms)
2026-11-08T11:11:32Z [load_day 2025-04-02] 2025-04-02 hour 3: 217277 events in 0 files, snapshot none (task 8345 ms: download 5326 ms overlapping gunzip 1319 ms, parse 5467 ms, sort 0 ms, write 0 ms, index 767 ms: 2 candidates, 86425 repo-hours, 2976 releases; waiting 499 ms; commit 0 ms)
2026-11-08T11:11:40Z [load_day 2025-04-02] 2025-04-02 hour 4: 193569 events in 0 files, snapshot none (task 7395 ms: download 4882 ms overlapping gunzip 1165 ms, parse 5051 ms, sort 0 ms, write 0 ms, index 574 ms: 5 candidates, 72493 repo-hours, 777 releases; waiting 368 ms; commit 0 ms)
2026-11-08T11:11:41Z [load_day 2025-04-02] 2025-04-02 hour 5: 203173 events in 0 files, snapshot none (task 8071 ms: download 5660 ms overlapping gunzip 1295 ms, parse 5363 ms, sort 0 ms, write 0 ms, index 590 ms: 4 candidates, 78384 repo-hours, 923 releases; waiting 521 ms; commit 0 ms)
2026-11-08T11:11:50Z [load_day 2025-04-02] 2025-04-02 hour 6: 243517 events in 0 files, snapshot none (task 8995 ms: download 6063 ms overlapping gunzip 1396 ms, parse 5747 ms, sort 0 ms, write 0 ms, index 833 ms: 9 candidates, 104650 repo-hours, 1267 releases; waiting 732 ms; commit 0 ms)
2026-11-08T11:11:50Z [load_day 2025-04-02] 2025-04-02 hour 7: 241805 events in 0 files, snapshot none (task 8579 ms: download 6048 ms overlapping gunzip 1354 ms, parse 5697 ms, sort 0 ms, write 0 ms, index 654 ms: 10 candidates, 95470 repo-hours, 1052 releases; waiting 610 ms; commit 0 ms)
2026-11-08T11:12:00Z [load_day 2025-04-02] 2025-04-02 hour 8: 255173 events in 0 files, snapshot none (task 9565 ms: download 5883 ms overlapping gunzip 1492 ms, parse 6061 ms, sort 0 ms, write 0 ms, index 1275 ms: 7 candidates, 105776 repo-hours, 1396 releases; waiting 492 ms; commit 0 ms)
2026-11-08T11:12:04Z [load_day 2025-04-02] 2025-04-02 hour 9: 261500 events in 0 files, snapshot none (task 13278 ms: download 9571 ms overlapping gunzip 1740 ms, parse 7373 ms, sort 0 ms, write 0 ms, index 1221 ms: 11 candidates, 108708 repo-hours, 1503 releases; waiting 2503 ms; commit 0 ms)
2026-11-08T11:12:11Z [load_day 2025-04-02] 2025-04-02 hour 10: 251323 events in 0 files, snapshot none (task 10783 ms: download 6694 ms overlapping gunzip 1748 ms, parse 7212 ms, sort 0 ms, write 0 ms, index 979 ms: 12 candidates, 103656 repo-hours, 1248 releases; waiting 451 ms; commit 0 ms)
2026-11-08T11:12:15Z [load_day 2025-04-02] 2025-04-02 hour 11: 252529 events in 0 files, snapshot none (task 9838 ms: download 6658 ms overlapping gunzip 1523 ms, parse 6624 ms, sort 0 ms, write 0 ms, index 729 ms: 11 candidates, 99297 repo-hours, 1291 releases; waiting 503 ms; commit 0 ms)
2026-11-08T11:12:23Z [load_day 2025-04-02] 2025-04-02 hour 12: 281781 events in 0 files, snapshot none (task 11509 ms: download 7761 ms overlapping gunzip 1823 ms, parse 7656 ms, sort 0 ms, write 0 ms, index 1253 ms: 11 candidates, 141341 repo-hours, 1521 releases; waiting 507 ms; commit 0 ms)
2026-11-08T11:12:27Z [load_day 2025-04-02] 2025-04-02 hour 13: 274023 events in 0 files, snapshot none (task 11840 ms: download 7677 ms overlapping gunzip 1885 ms, parse 7835 ms, sort 0 ms, write 0 ms, index 1599 ms: 4 candidates, 126601 repo-hours, 1377 releases; waiting 239 ms; commit 0 ms)
2026-11-08T11:12:35Z [load_day 2025-04-02] 2025-04-02 hour 14: 260283 events in 0 files, snapshot none (task 11063 ms: download 8136 ms overlapping gunzip 1823 ms, parse 7541 ms, sort 0 ms, write 0 ms, index 892 ms: 8 candidates, 114346 repo-hours, 1401 releases; waiting 502 ms; commit 0 ms)
2026-11-08T11:12:39Z [load_day 2025-04-02] 2025-04-02 hour 15: 274577 events in 0 files, snapshot none (task 11525 ms: download 7687 ms overlapping gunzip 1898 ms, parse 7546 ms, sort 0 ms, write 0 ms, index 1291 ms: 7 candidates, 121222 repo-hours, 1513 releases; waiting 496 ms; commit 0 ms)
2026-11-08T11:12:47Z [load_day 2025-04-02] 2025-04-02 hour 16: 270728 events in 0 files, snapshot none (task 11537 ms: download 8223 ms overlapping gunzip 1747 ms, parse 7628 ms, sort 0 ms, write 0 ms, index 1397 ms: 8 candidates, 112738 repo-hours, 1358 releases; waiting 504 ms; commit 0 ms)
2026-11-08T11:12:51Z [load_day 2025-04-02] 2025-04-02 hour 17: 267987 events in 0 files, snapshot none (task 10948 ms: download 7233 ms overlapping gunzip 1719 ms, parse 7332 ms, sort 0 ms, write 0 ms, index 1109 ms: 8 candidates, 105045 repo-hours, 1145 releases; waiting 450 ms; commit 0 ms)
2026-11-08T11:12:58Z [load_day 2025-04-02] 2025-04-02 hour 18: 273552 events in 0 files, snapshot none (task 10195 ms: download 6505 ms overlapping gunzip 1453 ms, parse 6212 ms, sort 0 ms, write 0 ms, index 1765 ms: 17 candidates, 119098 repo-hours, 1267 releases; waiting 480 ms; commit 0 ms)
2026-11-08T11:13:02Z [load_day 2025-04-02] 2025-04-02 hour 19: 246943 events in 0 files, snapshot none (task 10295 ms: download 6683 ms overlapping gunzip 1567 ms, parse 6668 ms, sort 0 ms, write 0 ms, index 1155 ms: 8 candidates, 97520 repo-hours, 1296 releases; waiting 537 ms; commit 0 ms)
2026-11-08T11:13:07Z [load_day 2025-04-02] 2025-04-02 hour 20: 239244 events in 0 files, snapshot none (task 8484 ms: download 5888 ms overlapping gunzip 1354 ms, parse 5745 ms, sort 0 ms, write 0 ms, index 720 ms: 5 candidates, 95024 repo-hours, 1179 releases; waiting 358 ms; commit 0 ms)
2026-11-08T11:13:11Z [load_day 2025-04-02] 2025-04-02 hour 21: 226847 events in 0 files, snapshot none (task 9073 ms: download 4985 ms overlapping gunzip 1388 ms, parse 5501 ms, sort 0 ms, write 0 ms, index 1297 ms: 18 candidates, 88550 repo-hours, 1200 releases; waiting 533 ms; commit 0 ms)
2026-11-08T11:13:16Z [load_day 2025-04-02] 2025-04-02 hour 22: 212226 events in 0 files, snapshot none (task 9214 ms: download 6128 ms overlapping gunzip 1443 ms, parse 6391 ms, sort 0 ms, write 0 ms, index 833 ms: 9 candidates, 80229 repo-hours, 1116 releases; waiting 336 ms; commit 0 ms)
2026-11-08T11:13:19Z [load_day 2025-04-02] 2025-04-02 hour 23: 197824 events in 0 files, snapshot none (task 6861 ms: download 4352 ms overlapping gunzip 1035 ms, parse 4416 ms, sort 0 ms, write 0 ms, index 534 ms: 6 candidates, 72455 repo-hours, 1109 releases; waiting 488 ms; commit 0 ms)
2026-11-08T11:13:30Z [load_day 2025-04-02] 2025-04-02: repo_hour merged from 24 files to 1 (2436005 rows, 11097 ms)
2026-11-08T11:13:32Z [load_day 2025-04-02] 2025-04-02: index committed in 13766 ms (24 + 1 + 24 files)
2026-11-08T11:13:32Z [load_day 2025-04-02] 2025-04-02: 5798190 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:13:32Z [load_day 2025-04-02] attempt 1 succeeded