orcaLog in

Runs · run 4515

load_day 2025-10-18, attempt 1 succeeded

Host
73ccef5e07c2:394172
Started
2026-11-08T14:14:25Z
Ended
2026-11-08T14:15:22Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
620 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
61.1 s, up to 2.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4515/load_day/2025-10-18/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:14:25Z [load_day 2025-10-18] attempt 1 started
2026-11-08T14:14:27Z [load_day 2025-10-18] 2025-10-18: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:14:31Z [load_day 2025-10-18] 2025-10-18 hour 0: 141858 events in 0 files, snapshot none (task 3962 ms: download 2020 ms overlapping gunzip 488 ms, parse 1509 ms, sort 0 ms, write 0 ms, index 1127 ms: 3 candidates, 69628 repo-hours, 716 releases; waiting 546 ms; commit 0 ms)
2026-11-08T14:14:31Z [load_day 2025-10-18] 2025-10-18 hour 1: 144547 events in 0 files, snapshot none (task 4050 ms: download 1809 ms overlapping gunzip 442 ms, parse 1458 ms, sort 0 ms, write 0 ms, index 1249 ms: 8 candidates, 83540 repo-hours, 586 releases; waiting 686 ms; commit 0 ms)
2026-11-08T14:14:35Z [load_day 2025-10-18] 2025-10-18 hour 2: 137310 events in 0 files, snapshot none (task 3651 ms: download 1886 ms overlapping gunzip 494 ms, parse 1575 ms, sort 0 ms, write 0 ms, index 660 ms: 6 candidates, 63417 repo-hours, 542 releases; waiting 608 ms; commit 0 ms)
2026-11-08T14:14:36Z [load_day 2025-10-18] 2025-10-18 hour 3: 144003 events in 0 files, snapshot none (task 3794 ms: download 1812 ms overlapping gunzip 509 ms, parse 1784 ms, sort 0 ms, write 0 ms, index 632 ms: 7 candidates, 59045 repo-hours, 1513 releases; waiting 571 ms; commit 0 ms)
2026-11-08T14:14:39Z [load_day 2025-10-18] 2025-10-18 hour 4: 138706 events in 0 files, snapshot none (task 3323 ms: download 1936 ms overlapping gunzip 444 ms, parse 1377 ms, sort 0 ms, write 0 ms, index 598 ms: 1 candidates, 53920 repo-hours, 379 releases; waiting 573 ms; commit 0 ms)
2026-11-08T14:14:39Z [load_day 2025-10-18] 2025-10-18 hour 5: 139790 events in 0 files, snapshot none (task 3426 ms: download 1907 ms overlapping gunzip 384 ms, parse 1320 ms, sort 0 ms, write 0 ms, index 786 ms: 4 candidates, 54466 repo-hours, 511 releases; waiting 712 ms; commit 0 ms)
2026-11-08T14:14:43Z [load_day 2025-10-18] 2025-10-18 hour 6: 140193 events in 0 files, snapshot none (task 2618 ms: download 1553 ms overlapping gunzip 305 ms, parse 979 ms, sort 0 ms, write 0 ms, index 525 ms: 7 candidates, 64597 repo-hours, 578 releases; waiting 585 ms; commit 0 ms)
2026-11-08T14:14:43Z [load_day 2025-10-18] 2025-10-18 hour 7: 140840 events in 0 files, snapshot none (task 2933 ms: download 1752 ms overlapping gunzip 346 ms, parse 1041 ms, sort 0 ms, write 0 ms, index 482 ms: 6 candidates, 57123 repo-hours, 483 releases; waiting 748 ms; commit 0 ms)
2026-11-08T14:14:46Z [load_day 2025-10-18] 2025-10-18 hour 8: 142666 events in 0 files, snapshot none (task 2604 ms: download 1709 ms overlapping gunzip 381 ms, parse 1091 ms, sort 0 ms, write 0 ms, index 479 ms: 3 candidates, 59280 repo-hours, 543 releases; waiting 437 ms; commit 0 ms)
2026-11-08T14:14:47Z [load_day 2025-10-18] 2025-10-18 hour 9: 145624 events in 0 files, snapshot none (task 3977 ms: download 2968 ms overlapping gunzip 318 ms, parse 1089 ms, sort 0 ms, write 0 ms, index 582 ms: 4 candidates, 61378 repo-hours, 617 releases; waiting 1667 ms; commit 0 ms)
2026-11-08T14:14:49Z [load_day 2025-10-18] 2025-10-18 hour 10: 145594 events in 0 files, snapshot none (task 3035 ms: download 1954 ms overlapping gunzip 443 ms, parse 1265 ms, sort 0 ms, write 0 ms, index 451 ms: 6 candidates, 61957 repo-hours, 523 releases; waiting 552 ms; commit 0 ms)
2026-11-08T14:14:51Z [load_day 2025-10-18] 2025-10-18 hour 11: 141398 events in 0 files, snapshot none (task 2521 ms: download 1744 ms overlapping gunzip 276 ms, parse 887 ms, sort 0 ms, write 0 ms, index 464 ms: 0 candidates, 58106 repo-hours, 464 releases; waiting 640 ms; commit 0 ms)
2026-11-08T14:14:53Z [load_day 2025-10-18] 2025-10-18 hour 12: 154714 events in 0 files, snapshot none (task 3213 ms: download 2099 ms overlapping gunzip 288 ms, parse 986 ms, sort 0 ms, write 0 ms, index 688 ms: 1 candidates, 87013 repo-hours, 522 releases; waiting 960 ms; commit 0 ms)
2026-11-08T14:14:54Z [load_day 2025-10-18] 2025-10-18 hour 13: 151068 events in 0 files, snapshot none (task 3000 ms: download 1434 ms overlapping gunzip 332 ms, parse 1113 ms, sort 0 ms, write 0 ms, index 582 ms: 3 candidates, 75602 repo-hours, 432 releases; waiting 554 ms; commit 0 ms)
2026-11-08T14:14:57Z [load_day 2025-10-18] 2025-10-18 hour 14: 147168 events in 0 files, snapshot none (task 3052 ms: download 1780 ms overlapping gunzip 346 ms, parse 1117 ms, sort 0 ms, write 0 ms, index 688 ms: 5 candidates, 66232 repo-hours, 674 releases; waiting 589 ms; commit 0 ms)
2026-11-08T14:14:58Z [load_day 2025-10-18] 2025-10-18 hour 15: 147728 events in 0 files, snapshot none (task 2969 ms: download 1668 ms overlapping gunzip 379 ms, parse 1150 ms, sort 0 ms, write 0 ms, index 570 ms: 3 candidates, 67502 repo-hours, 650 releases; waiting 543 ms; commit 0 ms)
2026-11-08T14:15:00Z [load_day 2025-10-18] 2025-10-18 hour 16: 147264 events in 0 files, snapshot none (task 2531 ms: download 1390 ms overlapping gunzip 307 ms, parse 984 ms, sort 0 ms, write 0 ms, index 708 ms: 5 candidates, 65060 repo-hours, 534 releases; waiting 316 ms; commit 0 ms)
2026-11-08T14:15:02Z [load_day 2025-10-18] 2025-10-18 hour 17: 149068 events in 0 files, snapshot none (task 3727 ms: download 2720 ms overlapping gunzip 359 ms, parse 1150 ms, sort 0 ms, write 0 ms, index 486 ms: 7 candidates, 63374 repo-hours, 495 releases; waiting 1412 ms; commit 0 ms)
2026-11-08T14:15:04Z [load_day 2025-10-18] 2025-10-18 hour 18: 149055 events in 0 files, snapshot none (task 4199 ms: download 2425 ms overlapping gunzip 329 ms, parse 1091 ms, sort 0 ms, write 0 ms, index 666 ms: 6 candidates, 70120 repo-hours, 566 releases; waiting 1751 ms; commit 0 ms)
2026-11-08T14:15:05Z [load_day 2025-10-18] 2025-10-18 hour 19: 144068 events in 0 files, snapshot none (task 2773 ms: download 1546 ms overlapping gunzip 326 ms, parse 988 ms, sort 0 ms, write 0 ms, index 450 ms: 4 candidates, 58350 repo-hours, 476 releases; waiting 623 ms; commit 0 ms)
2026-11-08T14:15:08Z [load_day 2025-10-18] 2025-10-18 hour 20: 143402 events in 0 files, snapshot none (task 2865 ms: download 1676 ms overlapping gunzip 318 ms, parse 1009 ms, sort 0 ms, write 0 ms, index 529 ms: 3 candidates, 57473 repo-hours, 566 releases; waiting 702 ms; commit 0 ms)
2026-11-08T14:15:09Z [load_day 2025-10-18] 2025-10-18 hour 21: 141394 events in 0 files, snapshot none (task 3014 ms: download 2107 ms overlapping gunzip 308 ms, parse 990 ms, sort 0 ms, write 0 ms, index 419 ms: 3 candidates, 55254 repo-hours, 615 releases; waiting 1057 ms; commit 0 ms)
2026-11-08T14:15:11Z [load_day 2025-10-18] 2025-10-18 hour 22: 139722 events in 0 files, snapshot none (task 2947 ms: download 1971 ms overlapping gunzip 306 ms, parse 1009 ms, sort 0 ms, write 0 ms, index 464 ms: 10 candidates, 53225 repo-hours, 670 releases; waiting 932 ms; commit 0 ms)
2026-11-08T14:15:12Z [load_day 2025-10-18] 2025-10-18 hour 23: 133934 events in 0 files, snapshot none (task 2523 ms: download 1625 ms overlapping gunzip 269 ms, parse 967 ms, sort 0 ms, write 0 ms, index 375 ms: 2 candidates, 50324 repo-hours, 617 releases; waiting 598 ms; commit 0 ms)
2026-11-08T14:15:19Z [load_day 2025-10-18] 2025-10-18: repo_hour merged from 24 files to 1 (1515986 rows, 6824 ms)
2026-11-08T14:15:22Z [load_day 2025-10-18] 2025-10-18: index committed in 9496 ms (23 + 1 + 24 files)
2026-11-08T14:15:22Z [load_day 2025-10-18] 2025-10-18: 3451114 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:15:22Z [load_day 2025-10-18] attempt 1 succeeded