orcaLog in

Runs · run 2094

load_day 2024-02-17, attempt 1 succeeded

Host
73ccef5e07c2:87682
Started
2026-11-08T04:41:42Z
Ended
2026-11-08T04:44:18Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
653 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
132.9 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2094/load_day/2024-02-17/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:41:42Z [load_day 2024-02-17] attempt 1 started
2026-11-08T04:41:43Z [load_day 2024-02-17] 2024-02-17: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:41:53Z [load_day 2024-02-17] 2024-02-17 hour 0: 232450 events in 0 files, snapshot none (task 9389 ms: download 6190 ms overlapping gunzip 1529 ms, parse 6266 ms, sort 0 ms, write 0 ms, index 764 ms: 13 candidates, 86920 repo-hours, 1048 releases; waiting 560 ms; commit 0 ms)
2026-11-08T04:41:53Z [load_day 2024-02-17] 2024-02-17 hour 1: 216348 events in 0 files, snapshot none (task 7688 ms: download 4027 ms overlapping gunzip 1192 ms, parse 5029 ms, sort 0 ms, write 0 ms, index 715 ms: 4 candidates, 80269 repo-hours, 706 releases; waiting 497 ms; commit 0 ms)
2026-11-08T04:42:00Z [load_day 2024-02-17] 2024-02-17 hour 2: 179542 events in 0 files, snapshot none (task 5640 ms: download 3227 ms overlapping gunzip 778 ms, parse 3357 ms, sort 0 ms, write 0 ms, index 654 ms: 5 candidates, 46923 repo-hours, 589 releases; waiting 529 ms; commit 0 ms)
2026-11-08T04:42:00Z [load_day 2024-02-17] 2024-02-17 hour 3: 182215 events in 0 files, snapshot none (task 5348 ms: download 2353 ms overlapping gunzip 684 ms, parse 3179 ms, sort 0 ms, write 0 ms, index 698 ms: 4 candidates, 46578 repo-hours, 688 releases; waiting 524 ms; commit 0 ms)
2026-11-08T04:42:06Z [load_day 2024-02-17] 2024-02-17 hour 4: 181744 events in 0 files, snapshot none (task 5352 ms: download 2627 ms overlapping gunzip 837 ms, parse 3597 ms, sort 0 ms, write 0 ms, index 360 ms: 5 candidates, 46820 repo-hours, 473 releases; waiting 309 ms; commit 0 ms)
2026-11-08T04:42:06Z [load_day 2024-02-17] 2024-02-17 hour 5: 186236 events in 0 files, snapshot none (task 5096 ms: download 2490 ms overlapping gunzip 709 ms, parse 3223 ms, sort 0 ms, write 0 ms, index 365 ms: 8 candidates, 49086 repo-hours, 533 releases; waiting 499 ms; commit 0 ms)
2026-11-08T04:42:11Z [load_day 2024-02-17] 2024-02-17 hour 6: 201878 events in 0 files, snapshot none (task 5279 ms: download 2901 ms overlapping gunzip 714 ms, parse 3252 ms, sort 0 ms, write 0 ms, index 482 ms: 7 candidates, 57285 repo-hours, 907 releases; waiting 560 ms; commit 0 ms)
2026-11-08T04:42:12Z [load_day 2024-02-17] 2024-02-17 hour 7: 201121 events in 0 files, snapshot none (task 5677 ms: download 2725 ms overlapping gunzip 826 ms, parse 3613 ms, sort 0 ms, write 0 ms, index 488 ms: 6 candidates, 52010 repo-hours, 728 releases; waiting 498 ms; commit 0 ms)
2026-11-08T04:42:17Z [load_day 2024-02-17] 2024-02-17 hour 8: 200435 events in 0 files, snapshot none (task 5144 ms: download 2695 ms overlapping gunzip 700 ms, parse 3202 ms, sort 0 ms, write 0 ms, index 546 ms: 7 candidates, 56046 repo-hours, 829 releases; waiting 470 ms; commit 0 ms)
2026-11-08T04:42:17Z [load_day 2024-02-17] 2024-02-17 hour 9: 205622 events in 0 files, snapshot none (task 5223 ms: download 2522 ms overlapping gunzip 677 ms, parse 3022 ms, sort 0 ms, write 0 ms, index 799 ms: 5 candidates, 56669 repo-hours, 847 releases; waiting 460 ms; commit 0 ms)
2026-11-08T04:42:24Z [load_day 2024-02-17] 2024-02-17 hour 10: 214345 events in 0 files, snapshot none (task 6059 ms: download 3459 ms overlapping gunzip 910 ms, parse 3916 ms, sort 0 ms, write 0 ms, index 454 ms: 12 candidates, 59896 repo-hours, 738 releases; waiting 449 ms; commit 0 ms)
2026-11-08T04:42:24Z [load_day 2024-02-17] 2024-02-17 hour 11: 210050 events in 0 files, snapshot none (task 5399 ms: download 2865 ms overlapping gunzip 832 ms, parse 3653 ms, sort 0 ms, write 0 ms, index 443 ms: 5 candidates, 57631 repo-hours, 674 releases; waiting 177 ms; commit 0 ms)
2026-11-08T04:42:30Z [load_day 2024-02-17] 2024-02-17 hour 12: 286057 events in 0 files, snapshot none (task 5970 ms: download 3191 ms overlapping gunzip 786 ms, parse 3770 ms, sort 0 ms, write 0 ms, index 668 ms: 8 candidates, 92404 repo-hours, 779 releases; waiting 503 ms; commit 0 ms)
2026-11-08T04:42:30Z [load_day 2024-02-17] 2024-02-17 hour 13: 239145 events in 0 files, snapshot none (task 5358 ms: download 2919 ms overlapping gunzip 729 ms, parse 3301 ms, sort 0 ms, write 0 ms, index 595 ms: 11 candidates, 83009 repo-hours, 689 releases; waiting 499 ms; commit 0 ms)
2026-11-08T04:43:41Z [load_day 2024-02-17] 2024-02-17 hour 14: 230485 events in 0 files, snapshot none (task 69980 ms: download 69171 ms overlapping gunzip 1090 ms, parse 4830 ms, sort 0 ms, write 0 ms, index 523 ms: 7 candidates, 69617 repo-hours, 1432 releases; waiting 63266 ms; commit 0 ms)
2026-11-08T04:43:41Z [load_day 2024-02-17] 2024-02-17 hour 15: 233631 events in 0 files, snapshot none (task 5192 ms: download 2755 ms overlapping gunzip 725 ms, parse 3126 ms, sort 0 ms, write 0 ms, index 568 ms: 12 candidates, 72016 repo-hours, 850 releases; waiting 524 ms; commit 0 ms)
2026-11-08T04:43:47Z [load_day 2024-02-17] 2024-02-17 hour 16: 237269 events in 0 files, snapshot none (task 5752 ms: download 3362 ms overlapping gunzip 887 ms, parse 3619 ms, sort 0 ms, write 0 ms, index 531 ms: 13 candidates, 70554 repo-hours, 731 releases; waiting 482 ms; commit 0 ms)
2026-11-08T04:43:47Z [load_day 2024-02-17] 2024-02-17 hour 17: 226370 events in 0 files, snapshot none (task 5826 ms: download 3227 ms overlapping gunzip 815 ms, parse 3593 ms, sort 0 ms, write 0 ms, index 532 ms: 9 candidates, 67446 repo-hours, 737 releases; waiting 536 ms; commit 0 ms)
2026-11-08T04:43:55Z [load_day 2024-02-17] 2024-02-17 hour 18: 265605 events in 0 files, snapshot none (task 8095 ms: download 4177 ms overlapping gunzip 997 ms, parse 5422 ms, sort 0 ms, write 0 ms, index 936 ms: 5 candidates, 125507 repo-hours, 803 releases; waiting 469 ms; commit 0 ms)
2026-11-08T04:43:55Z [load_day 2024-02-17] 2024-02-17 hour 19: 215816 events in 0 files, snapshot none (task 5140 ms: download 2484 ms overlapping gunzip 699 ms, parse 3059 ms, sort 0 ms, write 0 ms, index 557 ms: 4 candidates, 59742 repo-hours, 806 releases; waiting 514 ms; commit 0 ms)
2026-11-08T04:44:02Z [load_day 2024-02-17] 2024-02-17 hour 20: 209266 events in 0 files, snapshot none (task 6648 ms: download 3309 ms overlapping gunzip 973 ms, parse 4357 ms, sort 0 ms, write 0 ms, index 623 ms: 5 candidates, 58123 repo-hours, 700 releases; waiting 485 ms; commit 0 ms)
2026-11-08T04:44:02Z [load_day 2024-02-17] 2024-02-17 hour 21: 201073 events in 0 files, snapshot none (task 5531 ms: download 2497 ms overlapping gunzip 760 ms, parse 3480 ms, sort 0 ms, write 0 ms, index 501 ms: 10 candidates, 53890 repo-hours, 805 releases; waiting 523 ms; commit 0 ms)
2026-11-08T04:44:08Z [load_day 2024-02-17] 2024-02-17 hour 22: 189817 events in 0 files, snapshot none (task 5234 ms: download 2434 ms overlapping gunzip 721 ms, parse 3309 ms, sort 0 ms, write 0 ms, index 480 ms: 5 candidates, 48721 repo-hours, 729 releases; waiting 498 ms; commit 0 ms)
2026-11-08T04:44:08Z [load_day 2024-02-17] 2024-02-17 hour 23: 181144 events in 0 files, snapshot none (task 5171 ms: download 2461 ms overlapping gunzip 647 ms, parse 3042 ms, sort 0 ms, write 0 ms, index 776 ms: 7 candidates, 46307 repo-hours, 584 releases; waiting 477 ms; commit 0 ms)
2026-11-08T04:44:15Z [load_day 2024-02-17] 2024-02-17: repo_hour merged from 24 files to 1 (1543469 rows, 7226 ms)
2026-11-08T04:44:18Z [load_day 2024-02-17] 2024-02-17: index committed in 9771 ms (24 + 1 + 24 files)
2026-11-08T04:44:18Z [load_day 2024-02-17] 2024-02-17: 5127664 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:44:18Z [load_day 2024-02-17] attempt 1 succeeded