orcaLog in

Runs · run 3486

load_day 2025-01-27, attempt 1 succeeded

Host
73ccef5e07c2:244440
Started
2026-11-08T10:01:08Z
Ended
2026-11-08T10:03:24Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
926 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
222.6 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3486/load_day/2025-01-27/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:01:08Z [load_day 2025-01-27] attempt 1 started
2026-11-08T10:01:09Z [load_day 2025-01-27] 2025-01-27: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:01:17Z [load_day 2025-01-27] 2025-01-27 hour 0: 186426 events in 0 files, snapshot none (task 7528 ms: download 4674 ms overlapping gunzip 1225 ms, parse 4925 ms, sort 0 ms, write 0 ms, index 758 ms: 9 candidates, 87116 repo-hours, 1137 releases; waiting 294 ms; commit 0 ms)
2026-11-08T10:01:18Z [load_day 2025-01-27] 2025-01-27 hour 1: 205442 events in 0 files, snapshot none (task 8377 ms: download 5073 ms overlapping gunzip 1361 ms, parse 5437 ms, sort 0 ms, write 0 ms, index 845 ms: 6 candidates, 106779 repo-hours, 820 releases; waiting 481 ms; commit 0 ms)
2026-11-08T10:01:25Z [load_day 2025-01-27] 2025-01-27 hour 2: 172773 events in 0 files, snapshot none (task 7255 ms: download 4291 ms overlapping gunzip 1144 ms, parse 4532 ms, sort 0 ms, write 0 ms, index 733 ms: 6 candidates, 73402 repo-hours, 770 releases; waiting 518 ms; commit 0 ms)
2026-11-08T10:01:26Z [load_day 2025-01-27] 2025-01-27 hour 3: 190641 events in 0 files, snapshot none (task 7284 ms: download 4340 ms overlapping gunzip 1181 ms, parse 4892 ms, sort 0 ms, write 0 ms, index 693 ms: 2 candidates, 72247 repo-hours, 3816 releases; waiting 211 ms; commit 0 ms)
2026-11-08T10:01:34Z [load_day 2025-01-27] 2025-01-27 hour 4: 184204 events in 0 files, snapshot none (task 7924 ms: download 5549 ms overlapping gunzip 1284 ms, parse 4878 ms, sort 0 ms, write 0 ms, index 477 ms: 4 candidates, 65493 repo-hours, 649 releases; waiting 961 ms; commit 0 ms)
2026-11-08T10:01:34Z [load_day 2025-01-27] 2025-01-27 hour 5: 196226 events in 0 files, snapshot none (task 8087 ms: download 5620 ms overlapping gunzip 1347 ms, parse 5019 ms, sort 0 ms, write 0 ms, index 545 ms: 5 candidates, 70447 repo-hours, 843 releases; waiting 834 ms; commit 0 ms)
2026-11-08T10:01:42Z [load_day 2025-01-27] 2025-01-27 hour 6: 212692 events in 0 files, snapshot none (task 8218 ms: download 5685 ms overlapping gunzip 1418 ms, parse 5488 ms, sort 0 ms, write 0 ms, index 621 ms: 2 candidates, 89909 repo-hours, 911 releases; waiting 414 ms; commit 0 ms)
2026-11-08T10:01:43Z [load_day 2025-01-27] 2025-01-27 hour 7: 207069 events in 0 files, snapshot none (task 8472 ms: download 6176 ms overlapping gunzip 1441 ms, parse 5725 ms, sort 0 ms, write 0 ms, index 541 ms: 11 candidates, 75915 repo-hours, 893 releases; waiting 500 ms; commit 0 ms)
2026-11-08T10:01:54Z [load_day 2025-01-27] 2025-01-27 hour 8: 223992 events in 0 files, snapshot none (task 11200 ms: download 7574 ms overlapping gunzip 1886 ms, parse 7155 ms, sort 0 ms, write 0 ms, index 1320 ms: 6 candidates, 87476 repo-hours, 1008 releases; waiting 533 ms; commit 0 ms)
2026-11-08T10:01:54Z [load_day 2025-01-27] 2025-01-27 hour 9: 243963 events in 0 files, snapshot none (task 10475 ms: download 7348 ms overlapping gunzip 1727 ms, parse 6929 ms, sort 0 ms, write 0 ms, index 1002 ms: 4 candidates, 99199 repo-hours, 1211 releases; waiting 557 ms; commit 0 ms)
2026-11-08T10:02:05Z [load_day 2025-01-27] 2025-01-27 hour 10: 240569 events in 0 files, snapshot none (task 10683 ms: download 7671 ms overlapping gunzip 1929 ms, parse 7267 ms, sort 0 ms, write 0 ms, index 748 ms: 8 candidates, 96075 repo-hours, 1273 releases; waiting 504 ms; commit 0 ms)
2026-11-08T10:02:06Z [load_day 2025-01-27] 2025-01-27 hour 11: 236292 events in 0 files, snapshot none (task 11607 ms: download 8820 ms overlapping gunzip 1845 ms, parse 7189 ms, sort 0 ms, write 0 ms, index 996 ms: 7 candidates, 91688 repo-hours, 1155 releases; waiting 1307 ms; commit 0 ms)
2026-11-08T10:02:17Z [load_day 2025-01-27] 2025-01-27 hour 12: 278074 events in 0 files, snapshot none (task 10420 ms: download 7597 ms overlapping gunzip 1740 ms, parse 6900 ms, sort 0 ms, write 0 ms, index 948 ms: 10 candidates, 137162 repo-hours, 1337 releases; waiting 525 ms; commit 0 ms)
2026-11-08T10:02:18Z [load_day 2025-01-27] 2025-01-27 hour 13: 270476 events in 0 files, snapshot none (task 10709 ms: download 7916 ms overlapping gunzip 1759 ms, parse 7078 ms, sort 0 ms, write 0 ms, index 789 ms: 13 candidates, 120163 repo-hours, 1257 releases; waiting 527 ms; commit 0 ms)
2026-11-08T10:02:26Z [load_day 2025-01-27] 2025-01-27 hour 14: 262076 events in 0 files, snapshot none (task 8638 ms: download 6088 ms overlapping gunzip 1433 ms, parse 5622 ms, sort 0 ms, write 0 ms, index 801 ms: 7 candidates, 107861 repo-hours, 1345 releases; waiting 528 ms; commit 0 ms)
2026-11-08T10:02:27Z [load_day 2025-01-27] 2025-01-27 hour 15: 267221 events in 0 files, snapshot none (task 9072 ms: download 6333 ms overlapping gunzip 1485 ms, parse 5861 ms, sort 0 ms, write 0 ms, index 932 ms: 15 candidates, 114830 repo-hours, 1330 releases; waiting 524 ms; commit 0 ms)
2026-11-08T10:02:38Z [load_day 2025-01-27] 2025-01-27 hour 16: 262826 events in 0 files, snapshot none (task 11289 ms: download 8049 ms overlapping gunzip 1874 ms, parse 7463 ms, sort 0 ms, write 0 ms, index 1102 ms: 12 candidates, 111674 repo-hours, 1328 releases; waiting 522 ms; commit 0 ms)
2026-11-08T10:02:40Z [load_day 2025-01-27] 2025-01-27 hour 17: 260664 events in 0 files, snapshot none (task 12055 ms: download 8426 ms overlapping gunzip 1957 ms, parse 8238 ms, sort 0 ms, write 0 ms, index 1058 ms: 13 candidates, 106301 repo-hours, 1082 releases; waiting 508 ms; commit 0 ms)
2026-11-08T10:02:49Z [load_day 2025-01-27] 2025-01-27 hour 18: 261932 events in 0 files, snapshot none (task 10779 ms: download 7461 ms overlapping gunzip 1893 ms, parse 7312 ms, sort 0 ms, write 0 ms, index 976 ms: 9 candidates, 116408 repo-hours, 1230 releases; waiting 345 ms; commit 0 ms)
2026-11-08T10:02:50Z [load_day 2025-01-27] 2025-01-27 hour 19: 237624 events in 0 files, snapshot none (task 9678 ms: download 6936 ms overlapping gunzip 1673 ms, parse 6680 ms, sort 0 ms, write 0 ms, index 735 ms: 10 candidates, 93842 repo-hours, 1124 releases; waiting 298 ms; commit 0 ms)
2026-11-08T10:03:01Z [load_day 2025-01-27] 2025-01-27 hour 20: 233234 events in 0 files, snapshot none (task 11157 ms: download 8379 ms overlapping gunzip 1855 ms, parse 7778 ms, sort 0 ms, write 0 ms, index 778 ms: 7 candidates, 93677 repo-hours, 1052 releases; waiting 501 ms; commit 0 ms)
2026-11-08T10:03:01Z [load_day 2025-01-27] 2025-01-27 hour 21: 228891 events in 0 files, snapshot none (task 10539 ms: download 7458 ms overlapping gunzip 1804 ms, parse 7219 ms, sort 0 ms, write 0 ms, index 992 ms: 4 candidates, 92693 repo-hours, 1249 releases; waiting 197 ms; commit 0 ms)
2026-11-08T10:03:11Z [load_day 2025-01-27] 2025-01-27 hour 22: 211002 events in 0 files, snapshot none (task 9271 ms: download 6191 ms overlapping gunzip 1597 ms, parse 6066 ms, sort 0 ms, write 0 ms, index 731 ms: 10 candidates, 81064 repo-hours, 1271 releases; waiting 562 ms; commit 0 ms)
2026-11-08T10:03:11Z [load_day 2025-01-27] 2025-01-27 hour 23: 197110 events in 0 files, snapshot none (task 9505 ms: download 7029 ms overlapping gunzip 1634 ms, parse 6062 ms, sort 0 ms, write 0 ms, index 570 ms: 8 candidates, 73822 repo-hours, 1000 releases; waiting 957 ms; commit 0 ms)
2026-11-08T10:03:21Z [load_day 2025-01-27] 2025-01-27: repo_hour merged from 24 files to 1 (2265243 rows, 10055 ms)
2026-11-08T10:03:24Z [load_day 2025-01-27] 2025-01-27: index committed in 12758 ms (24 + 1 + 24 files)
2026-11-08T10:03:24Z [load_day 2025-01-27] 2025-01-27: 5471419 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:03:24Z [load_day 2025-01-27] attempt 1 succeeded