orcaLog in

Runs · run 4626

load_day 2025-11-17, attempt 1 succeeded

Host
73ccef5e07c2:405837
Started
2026-11-08T14:29:55Z
Ended
2026-11-08T14:31:08Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
711 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
75.6 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4626/load_day/2025-11-17/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:29:55Z [load_day 2025-11-17] attempt 1 started
2026-11-08T14:29:56Z [load_day 2025-11-17] 2025-11-17: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:30:00Z [load_day 2025-11-17] 2025-11-17 hour 0: 142087 events in 0 files, snapshot none (task 3332 ms: download 2215 ms overlapping gunzip 407 ms, parse 1285 ms, sort 0 ms, write 0 ms, index 567 ms: 4 candidates, 69862 repo-hours, 894 releases; waiting 796 ms; commit 0 ms)
2026-11-08T14:30:00Z [load_day 2025-11-17] 2025-11-17 hour 1: 150913 events in 0 files, snapshot none (task 3425 ms: download 2209 ms overlapping gunzip 421 ms, parse 1290 ms, sort 0 ms, write 0 ms, index 663 ms: 5 candidates, 90154 repo-hours, 697 releases; waiting 676 ms; commit 0 ms)
2026-11-08T14:30:04Z [load_day 2025-11-17] 2025-11-17 hour 2: 144819 events in 0 files, snapshot none (task 3948 ms: download 2379 ms overlapping gunzip 498 ms, parse 1376 ms, sort 0 ms, write 0 ms, index 672 ms: 4 candidates, 73322 repo-hours, 546 releases; waiting 972 ms; commit 0 ms)
2026-11-08T14:30:04Z [load_day 2025-11-17] 2025-11-17 hour 3: 146072 events in 0 files, snapshot none (task 3968 ms: download 2522 ms overlapping gunzip 487 ms, parse 1455 ms, sort 0 ms, write 0 ms, index 570 ms: 8 candidates, 73009 repo-hours, 1423 releases; waiting 1028 ms; commit 0 ms)
2026-11-08T14:30:10Z [load_day 2025-11-17] 2025-11-17 hour 4: 142171 events in 0 files, snapshot none (task 4258 ms: download 2720 ms overlapping gunzip 410 ms, parse 1244 ms, sort 0 ms, write 0 ms, index 555 ms: 5 candidates, 67981 repo-hours, 534 releases; waiting 1712 ms; commit 0 ms)
2026-11-08T14:30:10Z [load_day 2025-11-17] 2025-11-17 hour 5: 143413 events in 0 files, snapshot none (task 2987 ms: download 1622 ms overlapping gunzip 375 ms, parse 1207 ms, sort 0 ms, write 0 ms, index 821 ms: 1 candidates, 67244 repo-hours, 475 releases; waiting 284 ms; commit 0 ms)
2026-11-08T14:30:13Z [load_day 2025-11-17] 2025-11-17 hour 6: 146758 events in 0 files, snapshot none (task 3141 ms: download 2189 ms overlapping gunzip 416 ms, parse 1331 ms, sort 0 ms, write 0 ms, index 580 ms: 6 candidates, 77057 repo-hours, 561 releases; waiting 533 ms; commit 0 ms)
2026-11-08T14:30:14Z [load_day 2025-11-17] 2025-11-17 hour 7: 144728 events in 0 files, snapshot none (task 3567 ms: download 2352 ms overlapping gunzip 449 ms, parse 1330 ms, sort 0 ms, write 0 ms, index 556 ms: 2 candidates, 72220 repo-hours, 513 releases; waiting 971 ms; commit 0 ms)
2026-11-08T14:30:25Z [load_day 2025-11-17] 2025-11-17 hour 8: 144646 events in 0 files, snapshot none (task 11048 ms: download 10117 ms overlapping gunzip 536 ms, parse 1549 ms, sort 0 ms, write 0 ms, index 576 ms: 7 candidates, 76526 repo-hours, 697 releases; waiting 8044 ms; commit 0 ms)
2026-11-08T14:30:25Z [load_day 2025-11-17] 2025-11-17 hour 9: 149360 events in 0 files, snapshot none (task 3555 ms: download 2236 ms overlapping gunzip 531 ms, parse 1575 ms, sort 0 ms, write 0 ms, index 587 ms: 6 candidates, 77031 repo-hours, 628 releases; waiting 553 ms; commit 0 ms)
2026-11-08T14:30:29Z [load_day 2025-11-17] 2025-11-17 hour 10: 145368 events in 0 files, snapshot none (task 3892 ms: download 2715 ms overlapping gunzip 546 ms, parse 1592 ms, sort 0 ms, write 0 ms, index 652 ms: 8 candidates, 76095 repo-hours, 542 releases; waiting 791 ms; commit 0 ms)
2026-11-08T14:30:29Z [load_day 2025-11-17] 2025-11-17 hour 11: 144175 events in 0 files, snapshot none (task 3892 ms: download 2687 ms overlapping gunzip 541 ms, parse 1656 ms, sort 0 ms, write 0 ms, index 555 ms: 2 candidates, 74115 repo-hours, 518 releases; waiting 778 ms; commit 0 ms)
2026-11-08T14:30:33Z [load_day 2025-11-17] 2025-11-17 hour 12: 160003 events in 0 files, snapshot none (task 3825 ms: download 1837 ms overlapping gunzip 491 ms, parse 1697 ms, sort 0 ms, write 0 ms, index 780 ms: 6 candidates, 99571 repo-hours, 419 releases; waiting 530 ms; commit 0 ms)
2026-11-08T14:30:33Z [load_day 2025-11-17] 2025-11-17 hour 13: 154931 events in 0 files, snapshot none (task 3462 ms: download 2232 ms overlapping gunzip 499 ms, parse 1479 ms, sort 0 ms, write 0 ms, index 673 ms: 7 candidates, 92245 repo-hours, 411 releases; waiting 601 ms; commit 0 ms)
2026-11-08T14:30:38Z [load_day 2025-11-17] 2025-11-17 hour 14: 148479 events in 0 files, snapshot none (task 4048 ms: download 2388 ms overlapping gunzip 572 ms, parse 1669 ms, sort 0 ms, write 0 ms, index 758 ms: 5 candidates, 79722 repo-hours, 598 releases; waiting 733 ms; commit 0 ms)
2026-11-08T14:30:38Z [load_day 2025-11-17] 2025-11-17 hour 15: 143264 events in 0 files, snapshot none (task 4032 ms: download 2743 ms overlapping gunzip 604 ms, parse 1794 ms, sort 0 ms, write 0 ms, index 682 ms: 4 candidates, 80332 repo-hours, 585 releases; waiting 589 ms; commit 0 ms)
2026-11-08T14:30:43Z [load_day 2025-11-17] 2025-11-17 hour 16: 143663 events in 0 files, snapshot none (task 4035 ms: download 2435 ms overlapping gunzip 595 ms, parse 1868 ms, sort 0 ms, write 0 ms, index 750 ms: 7 candidates, 80868 repo-hours, 450 releases; waiting 545 ms; commit 0 ms)
2026-11-08T14:30:43Z [load_day 2025-11-17] 2025-11-17 hour 17: 145256 events in 0 files, snapshot none (task 4361 ms: download 2343 ms overlapping gunzip 593 ms, parse 1752 ms, sort 0 ms, write 0 ms, index 837 ms: 6 candidates, 78553 repo-hours, 432 releases; waiting 616 ms; commit 0 ms)
2026-11-08T14:30:47Z [load_day 2025-11-17] 2025-11-17 hour 18: 151550 events in 0 files, snapshot none (task 3444 ms: download 2377 ms overlapping gunzip 407 ms, parse 1254 ms, sort 0 ms, write 0 ms, index 612 ms: 1 candidates, 82549 repo-hours, 491 releases; waiting 884 ms; commit 0 ms)
2026-11-08T14:30:47Z [load_day 2025-11-17] 2025-11-17 hour 19: 149542 events in 0 files, snapshot none (task 3388 ms: download 2342 ms overlapping gunzip 417 ms, parse 1297 ms, sort 0 ms, write 0 ms, index 588 ms: 5 candidates, 72572 repo-hours, 522 releases; waiting 659 ms; commit 0 ms)
2026-11-08T14:30:51Z [load_day 2025-11-17] 2025-11-17 hour 20: 146090 events in 0 files, snapshot none (task 3497 ms: download 2428 ms overlapping gunzip 463 ms, parse 1332 ms, sort 0 ms, write 0 ms, index 602 ms: 6 candidates, 72377 repo-hours, 535 releases; waiting 818 ms; commit 0 ms)
2026-11-08T14:30:51Z [load_day 2025-11-17] 2025-11-17 hour 21: 147613 events in 0 files, snapshot none (task 3761 ms: download 2628 ms overlapping gunzip 465 ms, parse 1373 ms, sort 0 ms, write 0 ms, index 559 ms: 6 candidates, 70480 repo-hours, 545 releases; waiting 1025 ms; commit 0 ms)
2026-11-08T14:30:55Z [load_day 2025-11-17] 2025-11-17 hour 22: 149713 events in 0 files, snapshot none (task 3551 ms: download 2441 ms overlapping gunzip 460 ms, parse 1439 ms, sort 0 ms, write 0 ms, index 536 ms: 3 candidates, 69765 repo-hours, 659 releases; waiting 809 ms; commit 0 ms)
2026-11-08T14:30:56Z [load_day 2025-11-17] 2025-11-17 hour 23: 147768 events in 0 files, snapshot none (task 4038 ms: download 2739 ms overlapping gunzip 476 ms, parse 1362 ms, sort 0 ms, write 0 ms, index 588 ms: 4 candidates, 66460 repo-hours, 618 releases; waiting 1249 ms; commit 0 ms)
2026-11-08T14:31:05Z [load_day 2025-11-17] 2025-11-17: repo_hour merged from 24 files to 1 (1840110 rows, 8751 ms)
2026-11-08T14:31:08Z [load_day 2025-11-17] 2025-11-17: index committed in 11751 ms (24 + 1 + 24 files)
2026-11-08T14:31:08Z [load_day 2025-11-17] 2025-11-17: 3532382 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:31:08Z [load_day 2025-11-17] attempt 1 succeeded