orcaLog in

Runs · run 3426

load_day 2025-01-12, attempt 1 succeeded

Host
73ccef5e07c2:236590
Started
2026-11-08T09:47:10Z
Ended
2026-11-08T09:48:39Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
662 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
126.6 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3426/load_day/2025-01-12/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:47:10Z [load_day 2025-01-12] attempt 1 started
2026-11-08T09:47:11Z [load_day 2025-01-12] 2025-01-12: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:47:18Z [load_day 2025-01-12] 2025-01-12 hour 0: 242532 events in 0 files, snapshot none (task 6795 ms: download 3624 ms overlapping gunzip 948 ms, parse 4458 ms, sort 0 ms, write 0 ms, index 610 ms: 6 candidates, 71318 repo-hours, 1088 releases; waiting 502 ms; commit 0 ms)
2026-11-08T09:47:19Z [load_day 2025-01-12] 2025-01-12 hour 1: 257508 events in 0 files, snapshot none (task 7235 ms: download 3923 ms overlapping gunzip 994 ms, parse 4739 ms, sort 0 ms, write 0 ms, index 695 ms: 7 candidates, 98435 repo-hours, 931 releases; waiting 382 ms; commit 0 ms)
2026-11-08T09:47:24Z [load_day 2025-01-12] 2025-01-12 hour 2: 217006 events in 0 files, snapshot none (task 5836 ms: download 3148 ms overlapping gunzip 808 ms, parse 3717 ms, sort 0 ms, write 0 ms, index 437 ms: 4 candidates, 57179 repo-hours, 692 releases; waiting 543 ms; commit 0 ms)
2026-11-08T09:47:25Z [load_day 2025-01-12] 2025-01-12 hour 3: 231244 events in 0 files, snapshot none (task 5776 ms: download 3087 ms overlapping gunzip 802 ms, parse 3822 ms, sort 0 ms, write 0 ms, index 452 ms: 4 candidates, 59307 repo-hours, 3806 releases; waiting 468 ms; commit 0 ms)
2026-11-08T09:47:29Z [load_day 2025-01-12] 2025-01-12 hour 4: 198583 events in 0 files, snapshot none (task 4419 ms: download 2745 ms overlapping gunzip 590 ms, parse 2636 ms, sort 0 ms, write 0 ms, index 421 ms: 6 candidates, 49485 repo-hours, 597 releases; waiting 512 ms; commit 0 ms)
2026-11-08T09:47:30Z [load_day 2025-01-12] 2025-01-12 hour 5: 159113 events in 0 files, snapshot none (task 4513 ms: download 2095 ms overlapping gunzip 596 ms, parse 2687 ms, sort 0 ms, write 0 ms, index 486 ms: 5 candidates, 52926 repo-hours, 664 releases; waiting 521 ms; commit 0 ms)
2026-11-08T09:47:34Z [load_day 2025-01-12] 2025-01-12 hour 6: 162582 events in 0 files, snapshot none (task 4074 ms: download 2096 ms overlapping gunzip 540 ms, parse 2257 ms, sort 0 ms, write 0 ms, index 513 ms: 2 candidates, 70087 repo-hours, 922 releases; waiting 502 ms; commit 0 ms)
2026-11-08T09:47:34Z [load_day 2025-01-12] 2025-01-12 hour 7: 151857 events in 0 files, snapshot none (task 3777 ms: download 2037 ms overlapping gunzip 534 ms, parse 2250 ms, sort 0 ms, write 0 ms, index 417 ms: 4 candidates, 55256 repo-hours, 712 releases; waiting 270 ms; commit 0 ms)
2026-11-08T09:47:39Z [load_day 2025-01-12] 2025-01-12 hour 8: 157021 events in 0 files, snapshot none (task 4214 ms: download 2012 ms overlapping gunzip 538 ms, parse 2349 ms, sort 0 ms, write 0 ms, index 609 ms: 7 candidates, 61513 repo-hours, 783 releases; waiting 513 ms; commit 0 ms)
2026-11-08T09:47:42Z [load_day 2025-01-12] 2025-01-12 hour 9: 173729 events in 0 files, snapshot none (task 7419 ms: download 4150 ms overlapping gunzip 787 ms, parse 3506 ms, sort 0 ms, write 0 ms, index 838 ms: 4 candidates, 69165 repo-hours, 948 releases; waiting 1962 ms; commit 0 ms)
2026-11-08T09:47:45Z [load_day 2025-01-12] 2025-01-12 hour 10: 170255 events in 0 files, snapshot none (task 5480 ms: download 2652 ms overlapping gunzip 742 ms, parse 3220 ms, sort 0 ms, write 0 ms, index 735 ms: 2 candidates, 66581 repo-hours, 850 releases; waiting 515 ms; commit 0 ms)
2026-11-08T09:47:48Z [load_day 2025-01-12] 2025-01-12 hour 11: 174881 events in 0 files, snapshot none (task 5255 ms: download 2415 ms overlapping gunzip 705 ms, parse 3051 ms, sort 0 ms, write 0 ms, index 887 ms: 7 candidates, 65904 repo-hours, 943 releases; waiting 330 ms; commit 0 ms)
2026-11-08T09:47:53Z [load_day 2025-01-12] 2025-01-12 hour 12: 240144 events in 0 files, snapshot none (task 7942 ms: download 4263 ms overlapping gunzip 1071 ms, parse 5234 ms, sort 0 ms, write 0 ms, index 809 ms: 7 candidates, 118877 repo-hours, 1003 releases; waiting 493 ms; commit 0 ms)
2026-11-08T09:47:54Z [load_day 2025-01-12] 2025-01-12 hour 13: 212189 events in 0 files, snapshot none (task 6032 ms: download 3529 ms overlapping gunzip 868 ms, parse 3813 ms, sort 0 ms, write 0 ms, index 670 ms: 8 candidates, 98546 repo-hours, 923 releases; waiting 460 ms; commit 0 ms)
2026-11-08T09:48:01Z [load_day 2025-01-12] 2025-01-12 hour 14: 202038 events in 0 files, snapshot none (task 7306 ms: download 4412 ms overlapping gunzip 1108 ms, parse 4759 ms, sort 0 ms, write 0 ms, index 633 ms: 5 candidates, 80536 repo-hours, 1121 releases; waiting 526 ms; commit 0 ms)
2026-11-08T09:48:02Z [load_day 2025-01-12] 2025-01-12 hour 15: 210406 events in 0 files, snapshot none (task 7113 ms: download 4232 ms overlapping gunzip 1039 ms, parse 4715 ms, sort 0 ms, write 0 ms, index 644 ms: 10 candidates, 87716 repo-hours, 1097 releases; waiting 501 ms; commit 0 ms)
2026-11-08T09:48:09Z [load_day 2025-01-12] 2025-01-12 hour 16: 203530 events in 0 files, snapshot none (task 7145 ms: download 3936 ms overlapping gunzip 993 ms, parse 4433 ms, sort 0 ms, write 0 ms, index 731 ms: 9 candidates, 81840 repo-hours, 988 releases; waiting 708 ms; commit 0 ms)
2026-11-08T09:48:09Z [load_day 2025-01-12] 2025-01-12 hour 17: 211856 events in 0 files, snapshot none (task 6873 ms: download 3666 ms overlapping gunzip 979 ms, parse 4441 ms, sort 0 ms, write 0 ms, index 689 ms: 5 candidates, 74738 repo-hours, 899 releases; waiting 510 ms; commit 0 ms)
2026-11-08T09:48:16Z [load_day 2025-01-12] 2025-01-12 hour 18: 218719 events in 0 files, snapshot none (task 6585 ms: download 2893 ms overlapping gunzip 904 ms, parse 3915 ms, sort 0 ms, write 0 ms, index 1162 ms: 7 candidates, 88023 repo-hours, 1134 releases; waiting 268 ms; commit 0 ms)
2026-11-08T09:48:16Z [load_day 2025-01-12] 2025-01-12 hour 19: 191015 events in 0 files, snapshot none (task 6144 ms: download 2958 ms overlapping gunzip 921 ms, parse 3947 ms, sort 0 ms, write 0 ms, index 476 ms: 8 candidates, 64622 repo-hours, 929 releases; waiting 488 ms; commit 0 ms)
2026-11-08T09:48:23Z [load_day 2025-01-12] 2025-01-12 hour 20: 193457 events in 0 files, snapshot none (task 6450 ms: download 3887 ms overlapping gunzip 957 ms, parse 4241 ms, sort 0 ms, write 0 ms, index 512 ms: 10 candidates, 66827 repo-hours, 1091 releases; waiting 504 ms; commit 0 ms)
2026-11-08T09:48:23Z [load_day 2025-01-12] 2025-01-12 hour 21: 193352 events in 0 files, snapshot none (task 6054 ms: download 3255 ms overlapping gunzip 900 ms, parse 3814 ms, sort 0 ms, write 0 ms, index 569 ms: 9 candidates, 68106 repo-hours, 1071 releases; waiting 440 ms; commit 0 ms)
2026-11-08T09:48:29Z [load_day 2025-01-12] 2025-01-12 hour 22: 174772 events in 0 files, snapshot none (task 6070 ms: download 3250 ms overlapping gunzip 938 ms, parse 3849 ms, sort 0 ms, write 0 ms, index 505 ms: 13 candidates, 56848 repo-hours, 1231 releases; waiting 514 ms; commit 0 ms)
2026-11-08T09:48:29Z [load_day 2025-01-12] 2025-01-12 hour 23: 155296 events in 0 files, snapshot none (task 5942 ms: download 2709 ms overlapping gunzip 894 ms, parse 3817 ms, sort 0 ms, write 0 ms, index 587 ms: 12 candidates, 55312 repo-hours, 894 releases; waiting 294 ms; commit 0 ms)
2026-11-08T09:48:37Z [load_day 2025-01-12] 2025-01-12: repo_hour merged from 24 files to 1 (1719147 rows, 7594 ms)
2026-11-08T09:48:39Z [load_day 2025-01-12] 2025-01-12: index committed in 10244 ms (24 + 1 + 24 files)
2026-11-08T09:48:39Z [load_day 2025-01-12] 2025-01-12: 4703085 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:48:39Z [load_day 2025-01-12] attempt 1 succeeded