orcaLog in

Runs · run 4609

load_day 2025-11-12, attempt 1 succeeded

Host
73ccef5e07c2:404257
Started
2026-11-08T14:27:40Z
Ended
2026-11-08T14:28:43Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
677 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
72.8 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4609/load_day/2025-11-12/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:27:40Z [load_day 2025-11-12] attempt 1 started
2026-11-08T14:27:41Z [load_day 2025-11-12] 2025-11-12: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:27:45Z [load_day 2025-11-12] 2025-11-12 hour 0: 147356 events in 0 files, snapshot none (task 3113 ms: download 2120 ms overlapping gunzip 384 ms, parse 1174 ms, sort 0 ms, write 0 ms, index 517 ms: 3 candidates, 71329 repo-hours, 739 releases; waiting 709 ms; commit 0 ms)
2026-11-08T14:27:45Z [load_day 2025-11-12] 2025-11-12 hour 1: 155049 events in 0 files, snapshot none (task 3359 ms: download 2243 ms overlapping gunzip 387 ms, parse 1268 ms, sort 0 ms, write 0 ms, index 738 ms: 6 candidates, 87249 repo-hours, 580 releases; waiting 666 ms; commit 0 ms)
2026-11-08T14:27:48Z [load_day 2025-11-12] 2025-11-12 hour 2: 148440 events in 0 files, snapshot none (task 2874 ms: download 1843 ms overlapping gunzip 327 ms, parse 1079 ms, sort 0 ms, write 0 ms, index 550 ms: 5 candidates, 66762 repo-hours, 569 releases; waiting 610 ms; commit 0 ms)
2026-11-08T14:27:48Z [load_day 2025-11-12] 2025-11-12 hour 3: 147787 events in 0 files, snapshot none (task 2769 ms: download 1602 ms overlapping gunzip 334 ms, parse 1121 ms, sort 0 ms, write 0 ms, index 537 ms: 5 candidates, 68005 repo-hours, 1557 releases; waiting 394 ms; commit 0 ms)
2026-11-08T14:27:52Z [load_day 2025-11-12] 2025-11-12 hour 4: 148222 events in 0 files, snapshot none (task 3679 ms: download 2625 ms overlapping gunzip 363 ms, parse 1167 ms, sort 0 ms, write 0 ms, index 552 ms: 7 candidates, 66766 repo-hours, 580 releases; waiting 1185 ms; commit 0 ms)
2026-11-08T14:27:52Z [load_day 2025-11-12] 2025-11-12 hour 5: 144228 events in 0 files, snapshot none (task 3078 ms: download 2066 ms overlapping gunzip 355 ms, parse 1091 ms, sort 0 ms, write 0 ms, index 525 ms: 1 candidates, 66557 repo-hours, 569 releases; waiting 795 ms; commit 0 ms)
2026-11-08T14:27:56Z [load_day 2025-11-12] 2025-11-12 hour 6: 144672 events in 0 files, snapshot none (task 3353 ms: download 2217 ms overlapping gunzip 389 ms, parse 1156 ms, sort 0 ms, write 0 ms, index 571 ms: 5 candidates, 74373 repo-hours, 686 releases; waiting 878 ms; commit 0 ms)
2026-11-08T14:27:56Z [load_day 2025-11-12] 2025-11-12 hour 7: 145524 events in 0 files, snapshot none (task 3501 ms: download 2402 ms overlapping gunzip 400 ms, parse 1207 ms, sort 0 ms, write 0 ms, index 558 ms: 2 candidates, 70517 repo-hours, 603 releases; waiting 950 ms; commit 0 ms)
2026-11-08T14:28:00Z [load_day 2025-11-12] 2025-11-12 hour 8: 143534 events in 0 files, snapshot none (task 3685 ms: download 2251 ms overlapping gunzip 442 ms, parse 1330 ms, sort 0 ms, write 0 ms, index 825 ms: 3 candidates, 74680 repo-hours, 707 releases; waiting 707 ms; commit 0 ms)
2026-11-08T14:28:00Z [load_day 2025-11-12] 2025-11-12 hour 9: 145812 events in 0 files, snapshot none (task 3938 ms: download 2536 ms overlapping gunzip 512 ms, parse 1469 ms, sort 0 ms, write 0 ms, index 673 ms: 2 candidates, 76123 repo-hours, 696 releases; waiting 987 ms; commit 0 ms)
2026-11-08T14:28:04Z [load_day 2025-11-12] 2025-11-12 hour 10: 145248 events in 0 files, snapshot none (task 3744 ms: download 2475 ms overlapping gunzip 458 ms, parse 1352 ms, sort 0 ms, write 0 ms, index 769 ms: 2 candidates, 77592 repo-hours, 707 releases; waiting 884 ms; commit 0 ms)
2026-11-08T14:28:05Z [load_day 2025-11-12] 2025-11-12 hour 11: 148973 events in 0 files, snapshot none (task 3864 ms: download 2317 ms overlapping gunzip 466 ms, parse 1412 ms, sort 0 ms, write 0 ms, index 628 ms: 6 candidates, 75777 repo-hours, 623 releases; waiting 1050 ms; commit 0 ms)
2026-11-08T14:28:08Z [load_day 2025-11-12] 2025-11-12 hour 12: 157955 events in 0 files, snapshot none (task 3467 ms: download 2038 ms overlapping gunzip 374 ms, parse 1227 ms, sort 0 ms, write 0 ms, index 713 ms: 4 candidates, 96327 repo-hours, 411 releases; waiting 794 ms; commit 0 ms)
2026-11-08T14:28:09Z [load_day 2025-11-12] 2025-11-12 hour 13: 153188 events in 0 files, snapshot none (task 3637 ms: download 2105 ms overlapping gunzip 379 ms, parse 1261 ms, sort 0 ms, write 0 ms, index 974 ms: 4 candidates, 89837 repo-hours, 414 releases; waiting 710 ms; commit 0 ms)
2026-11-08T14:28:13Z [load_day 2025-11-12] 2025-11-12 hour 14: 148543 events in 0 files, snapshot none (task 4038 ms: download 2514 ms overlapping gunzip 471 ms, parse 1519 ms, sort 0 ms, write 0 ms, index 897 ms: 3 candidates, 81134 repo-hours, 563 releases; waiting 840 ms; commit 0 ms)
2026-11-08T14:28:13Z [load_day 2025-11-12] 2025-11-12 hour 15: 145023 events in 0 files, snapshot none (task 3146 ms: download 1516 ms overlapping gunzip 408 ms, parse 1264 ms, sort 0 ms, write 0 ms, index 785 ms: 5 candidates, 79439 repo-hours, 559 releases; waiting 442 ms; commit 0 ms)
2026-11-08T14:28:18Z [load_day 2025-11-12] 2025-11-12 hour 16: 146060 events in 0 files, snapshot none (task 4018 ms: download 2206 ms overlapping gunzip 631 ms, parse 1705 ms, sort 0 ms, write 0 ms, index 805 ms: 5 candidates, 80101 repo-hours, 541 releases; waiting 601 ms; commit 0 ms)
2026-11-08T14:28:18Z [load_day 2025-11-12] 2025-11-12 hour 17: 144757 events in 0 files, snapshot none (task 3926 ms: download 2766 ms overlapping gunzip 547 ms, parse 1695 ms, sort 0 ms, write 0 ms, index 660 ms: 14 candidates, 77125 repo-hours, 572 releases; waiting 741 ms; commit 0 ms)
2026-11-08T14:28:22Z [load_day 2025-11-12] 2025-11-12 hour 18: 144565 events in 0 files, snapshot none (task 3640 ms: download 2047 ms overlapping gunzip 466 ms, parse 1414 ms, sort 0 ms, write 0 ms, index 871 ms: 4 candidates, 78651 repo-hours, 682 releases; waiting 579 ms; commit 0 ms)
2026-11-08T14:28:22Z [load_day 2025-11-12] 2025-11-12 hour 19: 145354 events in 0 files, snapshot none (task 3819 ms: download 2242 ms overlapping gunzip 642 ms, parse 1831 ms, sort 0 ms, write 0 ms, index 561 ms: 2 candidates, 71609 repo-hours, 713 releases; waiting 499 ms; commit 0 ms)
2026-11-08T14:28:26Z [load_day 2025-11-12] 2025-11-12 hour 20: 144166 events in 0 files, snapshot none (task 3954 ms: download 2018 ms overlapping gunzip 579 ms, parse 1800 ms, sort 0 ms, write 0 ms, index 603 ms: 5 candidates, 70715 repo-hours, 624 releases; waiting 562 ms; commit 0 ms)
2026-11-08T14:28:26Z [load_day 2025-11-12] 2025-11-12 hour 21: 145348 events in 0 files, snapshot none (task 3740 ms: download 2576 ms overlapping gunzip 584 ms, parse 1733 ms, sort 0 ms, write 0 ms, index 597 ms: 6 candidates, 69285 repo-hours, 660 releases; waiting 553 ms; commit 0 ms)
2026-11-08T14:28:31Z [load_day 2025-11-12] 2025-11-12 hour 22: 142297 events in 0 files, snapshot none (task 4167 ms: download 2669 ms overlapping gunzip 551 ms, parse 1693 ms, sort 0 ms, write 0 ms, index 550 ms: 6 candidates, 67296 repo-hours, 712 releases; waiting 897 ms; commit 0 ms)
2026-11-08T14:28:31Z [load_day 2025-11-12] 2025-11-12 hour 23: 139005 events in 0 files, snapshot none (task 3802 ms: download 2167 ms overlapping gunzip 528 ms, parse 1750 ms, sort 0 ms, write 0 ms, index 593 ms: 6 candidates, 63886 repo-hours, 630 releases; waiting 638 ms; commit 0 ms)
2026-11-08T14:28:40Z [load_day 2025-11-12] 2025-11-12: repo_hour merged from 24 files to 1 (1801135 rows, 8952 ms)
2026-11-08T14:28:43Z [load_day 2025-11-12] 2025-11-12: index committed in 11982 ms (24 + 1 + 24 files)
2026-11-08T14:28:43Z [load_day 2025-11-12] 2025-11-12: 3521106 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:28:43Z [load_day 2025-11-12] attempt 1 succeeded