orcaLog in

Runs · run 3075

load_day 2024-10-13, attempt 1 succeeded

Host
73ccef5e07c2:191433
Started
2026-11-08T08:19:56Z
Ended
2026-11-08T08:21:20Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
675 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
112.2 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3075/load_day/2024-10-13/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:19:56Z [load_day 2024-10-13] attempt 1 started
2026-11-08T08:19:57Z [load_day 2024-10-13] 2024-10-13: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:20:01Z [load_day 2024-10-13] 2024-10-13 hour 0: 138146 events in 0 files, snapshot none (task 3876 ms: download 2478 ms overlapping gunzip 420 ms, parse 1755 ms, sort 0 ms, write 0 ms, index 559 ms: 7 candidates, 68091 repo-hours, 1089 releases; waiting 676 ms; commit 0 ms)
2026-11-08T08:20:02Z [load_day 2024-10-13] 2024-10-13 hour 1: 163041 events in 0 files, snapshot none (task 4097 ms: download 1861 ms overlapping gunzip 487 ms, parse 2021 ms, sort 0 ms, write 0 ms, index 678 ms: 6 candidates, 91640 repo-hours, 788 releases; waiting 516 ms; commit 0 ms)
2026-11-08T08:20:05Z [load_day 2024-10-13] 2024-10-13 hour 2: 129233 events in 0 files, snapshot none (task 3148 ms: download 1569 ms overlapping gunzip 433 ms, parse 1695 ms, sort 0 ms, write 0 ms, index 397 ms: 11 candidates, 58617 repo-hours, 590 releases; waiting 391 ms; commit 0 ms)
2026-11-08T08:20:06Z [load_day 2024-10-13] 2024-10-13 hour 3: 158409 events in 0 files, snapshot none (task 3971 ms: download 1919 ms overlapping gunzip 496 ms, parse 2168 ms, sort 0 ms, write 0 ms, index 492 ms: 4 candidates, 59100 repo-hours, 3846 releases; waiting 494 ms; commit 0 ms)
2026-11-08T08:20:10Z [load_day 2024-10-13] 2024-10-13 hour 4: 139153 events in 0 files, snapshot none (task 4496 ms: download 2621 ms overlapping gunzip 627 ms, parse 2485 ms, sort 0 ms, write 0 ms, index 598 ms: 4 candidates, 49331 repo-hours, 542 releases; waiting 579 ms; commit 0 ms)
2026-11-08T08:20:12Z [load_day 2024-10-13] 2024-10-13 hour 5: 152478 events in 0 files, snapshot none (task 5149 ms: download 2790 ms overlapping gunzip 842 ms, parse 3309 ms, sort 0 ms, write 0 ms, index 409 ms: 9 candidates, 52640 repo-hours, 712 releases; waiting 332 ms; commit 0 ms)
2026-11-08T08:20:16Z [load_day 2024-10-13] 2024-10-13 hour 6: 170707 events in 0 files, snapshot none (task 5137 ms: download 2180 ms overlapping gunzip 610 ms, parse 2623 ms, sort 0 ms, write 0 ms, index 1122 ms: 5 candidates, 71161 repo-hours, 713 releases; waiting 503 ms; commit 0 ms)
2026-11-08T08:20:18Z [load_day 2024-10-13] 2024-10-13 hour 7: 168277 events in 0 files, snapshot none (task 5664 ms: download 2836 ms overlapping gunzip 788 ms, parse 3079 ms, sort 0 ms, write 0 ms, index 893 ms: 6 candidates, 57466 repo-hours, 595 releases; waiting 553 ms; commit 0 ms)
2026-11-08T08:20:21Z [load_day 2024-10-13] 2024-10-13 hour 8: 169493 events in 0 files, snapshot none (task 4333 ms: download 2211 ms overlapping gunzip 640 ms, parse 2619 ms, sort 0 ms, write 0 ms, index 458 ms: 6 candidates, 62574 repo-hours, 708 releases; waiting 347 ms; commit 0 ms)
2026-11-08T08:20:24Z [load_day 2024-10-13] 2024-10-13 hour 9: 182436 events in 0 files, snapshot none (task 5597 ms: download 2472 ms overlapping gunzip 701 ms, parse 2852 ms, sort 0 ms, write 0 ms, index 1204 ms: 3 candidates, 68790 repo-hours, 879 releases; waiting 604 ms; commit 0 ms)
2026-11-08T08:20:26Z [load_day 2024-10-13] 2024-10-13 hour 10: 173958 events in 0 files, snapshot none (task 5192 ms: download 2745 ms overlapping gunzip 778 ms, parse 3094 ms, sort 0 ms, write 0 ms, index 511 ms: 12 candidates, 64849 repo-hours, 786 releases; waiting 484 ms; commit 0 ms)
2026-11-08T08:20:30Z [load_day 2024-10-13] 2024-10-13 hour 11: 179003 events in 0 files, snapshot none (task 5272 ms: download 2248 ms overlapping gunzip 704 ms, parse 2845 ms, sort 0 ms, write 0 ms, index 895 ms: 8 candidates, 62484 repo-hours, 696 releases; waiting 518 ms; commit 0 ms)
2026-11-08T08:20:33Z [load_day 2024-10-13] 2024-10-13 hour 12: 226738 events in 0 files, snapshot none (task 6014 ms: download 2703 ms overlapping gunzip 827 ms, parse 3469 ms, sort 0 ms, write 0 ms, index 942 ms: 14 candidates, 113180 repo-hours, 957 releases; waiting 552 ms; commit 0 ms)
2026-11-08T08:20:36Z [load_day 2024-10-13] 2024-10-13 hour 13: 219229 events in 0 files, snapshot none (task 5601 ms: download 3082 ms overlapping gunzip 822 ms, parse 3594 ms, sort 0 ms, write 0 ms, index 731 ms: 10 candidates, 92727 repo-hours, 878 releases; waiting 192 ms; commit 0 ms)
2026-11-08T08:20:39Z [load_day 2024-10-13] 2024-10-13 hour 14: 209194 events in 0 files, snapshot none (task 5789 ms: download 2531 ms overlapping gunzip 771 ms, parse 3142 ms, sort 0 ms, write 0 ms, index 1105 ms: 8 candidates, 81135 repo-hours, 855 releases; waiting 535 ms; commit 0 ms)
2026-11-08T08:20:43Z [load_day 2024-10-13] 2024-10-13 hour 15: 215318 events in 0 files, snapshot none (task 6496 ms: download 3347 ms overlapping gunzip 998 ms, parse 3819 ms, sort 0 ms, write 0 ms, index 864 ms: 8 candidates, 85265 repo-hours, 1158 releases; waiting 548 ms; commit 0 ms)
2026-11-08T08:20:45Z [load_day 2024-10-13] 2024-10-13 hour 16: 202896 events in 0 files, snapshot none (task 5094 ms: download 2725 ms overlapping gunzip 714 ms, parse 2984 ms, sort 0 ms, write 0 ms, index 587 ms: 11 candidates, 77631 repo-hours, 1032 releases; waiting 517 ms; commit 0 ms)
2026-11-08T08:20:51Z [load_day 2024-10-13] 2024-10-13 hour 17: 201120 events in 0 files, snapshot none (task 7908 ms: download 4472 ms overlapping gunzip 1080 ms, parse 4249 ms, sort 0 ms, write 0 ms, index 906 ms: 3 candidates, 75243 repo-hours, 864 releases; waiting 1430 ms; commit 0 ms)
2026-11-08T08:20:52Z [load_day 2024-10-13] 2024-10-13 hour 18: 209173 events in 0 files, snapshot none (task 6927 ms: download 3750 ms overlapping gunzip 1000 ms, parse 4333 ms, sort 0 ms, write 0 ms, index 675 ms: 16 candidates, 89068 repo-hours, 1045 releases; waiting 509 ms; commit 0 ms)
2026-11-08T08:20:57Z [load_day 2024-10-13] 2024-10-13 hour 19: 185135 events in 0 files, snapshot none (task 5793 ms: download 2915 ms overlapping gunzip 867 ms, parse 3469 ms, sort 0 ms, write 0 ms, index 661 ms: 8 candidates, 64695 repo-hours, 835 releases; waiting 532 ms; commit 0 ms)
2026-11-08T08:20:58Z [load_day 2024-10-13] 2024-10-13 hour 20: 176001 events in 0 files, snapshot none (task 5358 ms: download 2407 ms overlapping gunzip 816 ms, parse 3326 ms, sort 0 ms, write 0 ms, index 479 ms: 4 candidates, 64387 repo-hours, 866 releases; waiting 515 ms; commit 0 ms)
2026-11-08T08:21:04Z [load_day 2024-10-13] 2024-10-13 hour 21: 174332 events in 0 files, snapshot none (task 6411 ms: download 2187 ms overlapping gunzip 816 ms, parse 3373 ms, sort 0 ms, write 0 ms, index 1716 ms: 11 candidates, 62065 repo-hours, 956 releases; waiting 194 ms; commit 0 ms)
2026-11-08T08:21:04Z [load_day 2024-10-13] 2024-10-13 hour 22: 155540 events in 0 files, snapshot none (task 5819 ms: download 2194 ms overlapping gunzip 684 ms, parse 2845 ms, sort 0 ms, write 0 ms, index 1469 ms: 7 candidates, 53661 repo-hours, 995 releases; waiting 487 ms; commit 0 ms)
2026-11-08T08:21:10Z [load_day 2024-10-13] 2024-10-13 hour 23: 143311 events in 0 files, snapshot none (task 4866 ms: download 2159 ms overlapping gunzip 740 ms, parse 2943 ms, sort 0 ms, write 0 ms, index 394 ms: 3 candidates, 48589 repo-hours, 1034 releases; waiting 520 ms; commit 0 ms)
2026-11-08T08:21:17Z [load_day 2024-10-13] 2024-10-13: repo_hour merged from 24 files to 1 (1674389 rows, 7515 ms)
2026-11-08T08:21:20Z [load_day 2024-10-13] 2024-10-13: index committed in 9996 ms (24 + 1 + 24 files)
2026-11-08T08:21:20Z [load_day 2024-10-13] 2024-10-13: 4242321 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:21:20Z [load_day 2024-10-13] attempt 1 succeeded