orcaLog in

Runs · run 4297

load_day 2025-08-21, attempt 1 succeeded

Host
73ccef5e07c2:364674
Started
2026-11-08T13:28:46Z
Ended
2026-11-08T13:30:40Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
721 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
164.9 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4297/load_day/2025-08-21/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:28:46Z [load_day 2025-08-21] attempt 1 started
2026-11-08T13:28:47Z [load_day 2025-08-21] 2025-08-21: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:28:53Z [load_day 2025-08-21] 2025-08-21 hour 0: 147336 events in 0 files, snapshot none (task 5959 ms: download 3436 ms overlapping gunzip 922 ms, parse 3667 ms, sort 0 ms, write 0 ms, index 559 ms: 7 candidates, 74319 repo-hours, 1036 releases; waiting 520 ms; commit 0 ms)
2026-11-08T13:28:54Z [load_day 2025-08-21] 2025-08-21 hour 1: 159868 events in 0 files, snapshot none (task 6493 ms: download 3901 ms overlapping gunzip 1010 ms, parse 4062 ms, sort 0 ms, write 0 ms, index 680 ms: 4 candidates, 94487 repo-hours, 793 releases; waiting 491 ms; commit 0 ms)
2026-11-08T13:29:03Z [load_day 2025-08-21] 2025-08-21 hour 2: 146164 events in 0 files, snapshot none (task 8978 ms: download 6536 ms overlapping gunzip 934 ms, parse 3901 ms, sort 0 ms, write 0 ms, index 621 ms: 7 candidates, 68264 repo-hours, 803 releases; waiting 3282 ms; commit 0 ms)
2026-11-08T13:29:03Z [load_day 2025-08-21] 2025-08-21 hour 3: 147931 events in 0 files, snapshot none (task 6709 ms: download 3482 ms overlapping gunzip 1055 ms, parse 4203 ms, sort 0 ms, write 0 ms, index 752 ms: 3 candidates, 67769 repo-hours, 1979 releases; waiting 485 ms; commit 0 ms)
2026-11-08T13:29:10Z [load_day 2025-08-21] 2025-08-21 hour 4: 147766 events in 0 files, snapshot none (task 6469 ms: download 3739 ms overlapping gunzip 1009 ms, parse 4174 ms, sort 0 ms, write 0 ms, index 485 ms: 10 candidates, 63747 repo-hours, 704 releases; waiting 482 ms; commit 0 ms)
2026-11-08T13:29:10Z [load_day 2025-08-21] 2025-08-21 hour 5: 149928 events in 0 files, snapshot none (task 6799 ms: download 4224 ms overlapping gunzip 1101 ms, parse 4359 ms, sort 0 ms, write 0 ms, index 599 ms: 8 candidates, 65860 repo-hours, 662 releases; waiting 519 ms; commit 0 ms)
2026-11-08T13:29:18Z [load_day 2025-08-21] 2025-08-21 hour 6: 157864 events in 0 files, snapshot none (task 7856 ms: download 4761 ms overlapping gunzip 1215 ms, parse 4856 ms, sort 0 ms, write 0 ms, index 727 ms: 2 candidates, 79440 repo-hours, 855 releases; waiting 491 ms; commit 0 ms)
2026-11-08T13:29:19Z [load_day 2025-08-21] 2025-08-21 hour 7: 156804 events in 0 files, snapshot none (task 7992 ms: download 4978 ms overlapping gunzip 1317 ms, parse 5101 ms, sort 0 ms, write 0 ms, index 659 ms: 6 candidates, 73375 repo-hours, 696 releases; waiting 505 ms; commit 0 ms)
2026-11-08T13:29:27Z [load_day 2025-08-21] 2025-08-21 hour 8: 164278 events in 0 files, snapshot none (task 8527 ms: download 5717 ms overlapping gunzip 1392 ms, parse 5606 ms, sort 0 ms, write 0 ms, index 621 ms: 5 candidates, 80064 repo-hours, 828 releases; waiting 534 ms; commit 0 ms)
2026-11-08T13:29:27Z [load_day 2025-08-21] 2025-08-21 hour 9: 162772 events in 0 files, snapshot none (task 7738 ms: download 5139 ms overlapping gunzip 1308 ms, parse 5133 ms, sort 0 ms, write 0 ms, index 683 ms: 6 candidates, 78643 repo-hours, 945 releases; waiting 377 ms; commit 0 ms)
2026-11-08T13:29:35Z [load_day 2025-08-21] 2025-08-21 hour 10: 156787 events in 0 files, snapshot none (task 7655 ms: download 4790 ms overlapping gunzip 1190 ms, parse 5005 ms, sort 0 ms, write 0 ms, index 606 ms: 3 candidates, 75197 repo-hours, 765 releases; waiting 542 ms; commit 0 ms)
2026-11-08T13:29:36Z [load_day 2025-08-21] 2025-08-21 hour 11: 162942 events in 0 files, snapshot none (task 8126 ms: download 5404 ms overlapping gunzip 1248 ms, parse 5409 ms, sort 0 ms, write 0 ms, index 664 ms: 4 candidates, 75815 repo-hours, 755 releases; waiting 530 ms; commit 0 ms)
2026-11-08T13:29:43Z [load_day 2025-08-21] 2025-08-21 hour 12: 160719 events in 0 files, snapshot none (task 7716 ms: download 4748 ms overlapping gunzip 1096 ms, parse 4482 ms, sort 0 ms, write 0 ms, index 822 ms: 4 candidates, 94447 repo-hours, 833 releases; waiting 1040 ms; commit 0 ms)
2026-11-08T13:29:44Z [load_day 2025-08-21] 2025-08-21 hour 13: 162608 events in 0 files, snapshot none (task 7513 ms: download 5048 ms overlapping gunzip 1172 ms, parse 4781 ms, sort 0 ms, write 0 ms, index 727 ms: 6 candidates, 89460 repo-hours, 809 releases; waiting 584 ms; commit 0 ms)
2026-11-08T13:29:52Z [load_day 2025-08-21] 2025-08-21 hour 14: 167864 events in 0 files, snapshot none (task 8428 ms: download 5936 ms overlapping gunzip 1382 ms, parse 5530 ms, sort 0 ms, write 0 ms, index 653 ms: 5 candidates, 83706 repo-hours, 884 releases; waiting 542 ms; commit 0 ms)
2026-11-08T13:29:53Z [load_day 2025-08-21] 2025-08-21 hour 15: 165082 events in 0 files, snapshot none (task 8656 ms: download 6215 ms overlapping gunzip 1468 ms, parse 5737 ms, sort 0 ms, write 0 ms, index 699 ms: 3 candidates, 85740 repo-hours, 814 releases; waiting 462 ms; commit 0 ms)
2026-11-08T13:30:01Z [load_day 2025-08-21] 2025-08-21 hour 16: 165363 events in 0 files, snapshot none (task 7545 ms: download 5044 ms overlapping gunzip 1245 ms, parse 4791 ms, sort 0 ms, write 0 ms, index 715 ms: 11 candidates, 87349 repo-hours, 647 releases; waiting 504 ms; commit 0 ms)
2026-11-08T13:30:01Z [load_day 2025-08-21] 2025-08-21 hour 17: 164401 events in 0 files, snapshot none (task 6542 ms: download 4097 ms overlapping gunzip 1107 ms, parse 4305 ms, sort 0 ms, write 0 ms, index 629 ms: 13 candidates, 82514 repo-hours, 623 releases; waiting 281 ms; commit 0 ms)
2026-11-08T13:30:10Z [load_day 2025-08-21] 2025-08-21 hour 18: 164344 events in 0 files, snapshot none (task 7972 ms: download 5307 ms overlapping gunzip 1073 ms, parse 4068 ms, sort 0 ms, write 0 ms, index 697 ms: 6 candidates, 86947 repo-hours, 757 releases; waiting 1835 ms; commit 0 ms)
2026-11-08T13:30:10Z [load_day 2025-08-21] 2025-08-21 hour 19: 162069 events in 0 files, snapshot none (task 7287 ms: download 4566 ms overlapping gunzip 1038 ms, parse 3937 ms, sort 0 ms, write 0 ms, index 873 ms: 13 candidates, 76836 repo-hours, 771 releases; waiting 1141 ms; commit 0 ms)
2026-11-08T13:30:18Z [load_day 2025-08-21] 2025-08-21 hour 20: 162665 events in 0 files, snapshot none (task 7803 ms: download 5032 ms overlapping gunzip 1289 ms, parse 4920 ms, sort 0 ms, write 0 ms, index 846 ms: 6 candidates, 78103 repo-hours, 821 releases; waiting 483 ms; commit 0 ms)
2026-11-08T13:30:19Z [load_day 2025-08-21] 2025-08-21 hour 21: 160799 events in 0 files, snapshot none (task 8700 ms: download 5704 ms overlapping gunzip 1363 ms, parse 5627 ms, sort 0 ms, write 0 ms, index 885 ms: 7 candidates, 76512 repo-hours, 769 releases; waiting 508 ms; commit 0 ms)
2026-11-08T13:30:27Z [load_day 2025-08-21] 2025-08-21 hour 22: 154808 events in 0 files, snapshot none (task 7929 ms: download 5026 ms overlapping gunzip 1298 ms, parse 4962 ms, sort 0 ms, write 0 ms, index 861 ms: 8 candidates, 73470 repo-hours, 795 releases; waiting 514 ms; commit 0 ms)
2026-11-08T13:30:28Z [load_day 2025-08-21] 2025-08-21 hour 23: 153858 events in 0 files, snapshot none (task 8911 ms: download 6663 ms overlapping gunzip 1249 ms, parse 4933 ms, sort 0 ms, write 0 ms, index 558 ms: 13 candidates, 70092 repo-hours, 762 releases; waiting 1938 ms; commit 0 ms)
2026-11-08T13:30:37Z [load_day 2025-08-21] 2025-08-21: repo_hour merged from 24 files to 1 (1882156 rows, 8587 ms)
2026-11-08T13:30:40Z [load_day 2025-08-21] 2025-08-21: index committed in 11686 ms (24 + 1 + 24 files)
2026-11-08T13:30:40Z [load_day 2025-08-21] 2025-08-21: 3805020 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:30:40Z [load_day 2025-08-21] attempt 1 succeeded