orcaLog in

Runs · run 2134

load_day 2024-02-27, attempt 1 succeeded

Host
73ccef5e07c2:92359
Started
2026-11-08T04:51:47Z
Ended
2026-11-08T04:53:50Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
787 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
194.3 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2134/load_day/2024-02-27/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:51:47Z [load_day 2024-02-27] attempt 1 started
2026-11-08T04:51:48Z [load_day 2024-02-27] 2024-02-27: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:51:58Z [load_day 2024-02-27] 2024-02-27 hour 0: 273289 events in 0 files, snapshot none (task 9286 ms: download 6488 ms overlapping gunzip 1490 ms, parse 6299 ms, sort 0 ms, write 0 ms, index 741 ms: 12 candidates, 100218 repo-hours, 1059 releases; waiting 476 ms; commit 0 ms)
2026-11-08T04:51:58Z [load_day 2024-02-27] 2024-02-27 hour 1: 264313 events in 0 files, snapshot none (task 8812 ms: download 5854 ms overlapping gunzip 1307 ms, parse 6136 ms, sort 0 ms, write 0 ms, index 951 ms: 12 candidates, 99434 repo-hours, 802 releases; waiting 173 ms; commit 0 ms)
2026-11-08T04:52:06Z [load_day 2024-02-27] 2024-02-27 hour 2: 236288 events in 0 files, snapshot none (task 7619 ms: download 4810 ms overlapping gunzip 1208 ms, parse 4647 ms, sort 0 ms, write 0 ms, index 532 ms: 7 candidates, 68927 repo-hours, 688 releases; waiting 458 ms; commit 0 ms)
2026-11-08T04:52:07Z [load_day 2024-02-27] 2024-02-27 hour 3: 234910 events in 0 files, snapshot none (task 7899 ms: download 5312 ms overlapping gunzip 1195 ms, parse 5286 ms, sort 0 ms, write 0 ms, index 609 ms: 9 candidates, 66654 repo-hours, 927 releases; waiting 526 ms; commit 0 ms)
2026-11-08T04:52:14Z [load_day 2024-02-27] 2024-02-27 hour 4: 227296 events in 0 files, snapshot none (task 7140 ms: download 4517 ms overlapping gunzip 1139 ms, parse 4765 ms, sort 0 ms, write 0 ms, index 453 ms: 6 candidates, 62935 repo-hours, 628 releases; waiting 524 ms; commit 0 ms)
2026-11-08T04:52:14Z [load_day 2024-02-27] 2024-02-27 hour 5: 236504 events in 0 files, snapshot none (task 7442 ms: download 4925 ms overlapping gunzip 1222 ms, parse 4935 ms, sort 0 ms, write 0 ms, index 540 ms: 5 candidates, 68350 repo-hours, 674 releases; waiting 502 ms; commit 0 ms)
2026-11-08T04:52:21Z [load_day 2024-02-27] 2024-02-27 hour 6: 255004 events in 0 files, snapshot none (task 6100 ms: download 3627 ms overlapping gunzip 890 ms, parse 3837 ms, sort 0 ms, write 0 ms, index 603 ms: 11 candidates, 82429 repo-hours, 930 releases; waiting 481 ms; commit 0 ms)
2026-11-08T04:52:21Z [load_day 2024-02-27] 2024-02-27 hour 7: 256654 events in 0 files, snapshot none (task 6536 ms: download 4086 ms overlapping gunzip 977 ms, parse 4162 ms, sort 0 ms, write 0 ms, index 569 ms: 13 candidates, 79536 repo-hours, 822 releases; waiting 504 ms; commit 0 ms)
2026-11-08T04:52:28Z [load_day 2024-02-27] 2024-02-27 hour 8: 261330 events in 0 files, snapshot none (task 6885 ms: download 4314 ms overlapping gunzip 1041 ms, parse 4331 ms, sort 0 ms, write 0 ms, index 679 ms: 8 candidates, 87882 repo-hours, 919 releases; waiting 534 ms; commit 0 ms)
2026-11-08T04:52:29Z [load_day 2024-02-27] 2024-02-27 hour 9: 262173 events in 0 files, snapshot none (task 7323 ms: download 4911 ms overlapping gunzip 1136 ms, parse 4728 ms, sort 0 ms, write 0 ms, index 650 ms: 9 candidates, 93532 repo-hours, 1219 releases; waiting 546 ms; commit 0 ms)
2026-11-08T04:52:38Z [load_day 2024-02-27] 2024-02-27 hour 10: 229986 events in 0 files, snapshot none (task 9599 ms: download 6898 ms overlapping gunzip 1545 ms, parse 6522 ms, sort 0 ms, write 0 ms, index 769 ms: 22 candidates, 92819 repo-hours, 1101 releases; waiting 517 ms; commit 0 ms)
2026-11-08T04:52:39Z [load_day 2024-02-27] 2024-02-27 hour 11: 224909 events in 0 files, snapshot none (task 9143 ms: download 6428 ms overlapping gunzip 1450 ms, parse 6227 ms, sort 0 ms, write 0 ms, index 685 ms: 11 candidates, 88514 repo-hours, 1052 releases; waiting 532 ms; commit 0 ms)
2026-11-08T04:52:49Z [load_day 2024-02-27] 2024-02-27 hour 12: 284860 events in 0 files, snapshot none (task 10289 ms: download 7208 ms overlapping gunzip 1485 ms, parse 7072 ms, sort 0 ms, write 0 ms, index 961 ms: 10 candidates, 121505 repo-hours, 1295 releases; waiting 528 ms; commit 0 ms)
2026-11-08T04:52:50Z [load_day 2024-02-27] 2024-02-27 hour 13: 265591 events in 0 files, snapshot none (task 10733 ms: download 7651 ms overlapping gunzip 1683 ms, parse 7153 ms, sort 0 ms, write 0 ms, index 1152 ms: 14 candidates, 116787 repo-hours, 1141 releases; waiting 503 ms; commit 0 ms)
2026-11-08T04:53:00Z [load_day 2024-02-27] 2024-02-27 hour 14: 258208 events in 0 files, snapshot none (task 10015 ms: download 6156 ms overlapping gunzip 1658 ms, parse 6577 ms, sort 0 ms, write 0 ms, index 903 ms: 8 candidates, 105713 repo-hours, 1302 releases; waiting 517 ms; commit 0 ms)
2026-11-08T04:53:01Z [load_day 2024-02-27] 2024-02-27 hour 15: 257222 events in 0 files, snapshot none (task 10161 ms: download 7254 ms overlapping gunzip 1701 ms, parse 6882 ms, sort 0 ms, write 0 ms, index 777 ms: 17 candidates, 106709 repo-hours, 1441 releases; waiting 490 ms; commit 0 ms)
2026-11-08T04:53:10Z [load_day 2024-02-27] 2024-02-27 hour 16: 253741 events in 0 files, snapshot none (task 9825 ms: download 6877 ms overlapping gunzip 1643 ms, parse 6624 ms, sort 0 ms, write 0 ms, index 787 ms: 6 candidates, 104421 repo-hours, 1262 releases; waiting 519 ms; commit 0 ms)
2026-11-08T04:53:11Z [load_day 2024-02-27] 2024-02-27 hour 17: 244417 events in 0 files, snapshot none (task 9627 ms: download 7082 ms overlapping gunzip 1523 ms, parse 6683 ms, sort 0 ms, write 0 ms, index 672 ms: 17 candidates, 96289 repo-hours, 1158 releases; waiting 498 ms; commit 0 ms)
2026-11-08T04:53:19Z [load_day 2024-02-27] 2024-02-27 hour 18: 242600 events in 0 files, snapshot none (task 9138 ms: download 6307 ms overlapping gunzip 1442 ms, parse 6084 ms, sort 0 ms, write 0 ms, index 804 ms: 12 candidates, 100316 repo-hours, 1324 releases; waiting 544 ms; commit 0 ms)
2026-11-08T04:53:20Z [load_day 2024-02-27] 2024-02-27 hour 19: 228296 events in 0 files, snapshot none (task 8468 ms: download 5768 ms overlapping gunzip 1375 ms, parse 5572 ms, sort 0 ms, write 0 ms, index 796 ms: 5 candidates, 86733 repo-hours, 1086 releases; waiting 456 ms; commit 0 ms)
2026-11-08T04:53:29Z [load_day 2024-02-27] 2024-02-27 hour 20: 257048 events in 0 files, snapshot none (task 9222 ms: download 5598 ms overlapping gunzip 1419 ms, parse 6038 ms, sort 0 ms, write 0 ms, index 955 ms: 11 candidates, 96544 repo-hours, 975 releases; waiting 504 ms; commit 0 ms)
2026-11-08T04:53:29Z [load_day 2024-02-27] 2024-02-27 hour 21: 241469 events in 0 files, snapshot none (task 8546 ms: download 5764 ms overlapping gunzip 1333 ms, parse 5651 ms, sort 0 ms, write 0 ms, index 800 ms: 5 candidates, 79092 repo-hours, 1106 releases; waiting 480 ms; commit 0 ms)
2026-11-08T04:53:38Z [load_day 2024-02-27] 2024-02-27 hour 22: 227428 events in 0 files, snapshot none (task 8424 ms: download 5847 ms overlapping gunzip 1396 ms, parse 5721 ms, sort 0 ms, write 0 ms, index 537 ms: 9 candidates, 71620 repo-hours, 1052 releases; waiting 523 ms; commit 0 ms)
2026-11-08T04:53:38Z [load_day 2024-02-27] 2024-02-27 hour 23: 204330 events in 0 files, snapshot none (task 7462 ms: download 4522 ms overlapping gunzip 1140 ms, parse 5003 ms, sort 0 ms, write 0 ms, index 577 ms: 6 candidates, 63573 repo-hours, 821 releases; waiting 492 ms; commit 0 ms)
2026-11-08T04:53:47Z [load_day 2024-02-27] 2024-02-27: repo_hour merged from 24 files to 1 (2140532 rows, 9542 ms)
2026-11-08T04:53:50Z [load_day 2024-02-27] 2024-02-27: index committed in 11762 ms (24 + 1 + 24 files)
2026-11-08T04:53:50Z [load_day 2024-02-27] 2024-02-27: 5927866 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:53:50Z [load_day 2024-02-27] attempt 1 succeeded