orcaLog in

Runs · run 1968

load_day 2024-01-14, attempt 1 succeeded

Host
73ccef5e07c2:23738
Started
2026-11-08T04:09:04Z
Ended
2026-11-08T04:10:34Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
594 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
106.9 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1968/load_day/2024-01-14/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:09:04Z [load_day 2024-01-14] attempt 1 started
2026-11-08T04:09:05Z [load_day 2024-01-14] 2024-01-14: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:09:10Z [load_day 2024-01-14] 2024-01-14 hour 0: 154358 events in 0 files, snapshot none (task 4425 ms: download 2323 ms overlapping gunzip 549 ms, parse 2477 ms, sort 0 ms, write 0 ms, index 514 ms: 5 candidates, 67816 repo-hours, 990 releases; waiting 547 ms; commit 0 ms)
2026-11-08T04:09:10Z [load_day 2024-01-14] 2024-01-14 hour 1: 164601 events in 0 files, snapshot none (task 4118 ms: download 2099 ms overlapping gunzip 473 ms, parse 2324 ms, sort 0 ms, write 0 ms, index 510 ms: 4 candidates, 76068 repo-hours, 890 releases; waiting 526 ms; commit 0 ms)
2026-11-08T04:09:16Z [load_day 2024-01-14] 2024-01-14 hour 2: 131735 events in 0 files, snapshot none (task 5478 ms: download 2607 ms overlapping gunzip 802 ms, parse 3518 ms, sort 0 ms, write 0 ms, index 470 ms: 2 candidates, 43532 repo-hours, 604 releases; waiting 460 ms; commit 0 ms)
2026-11-08T04:09:16Z [load_day 2024-01-14] 2024-01-14 hour 3: 134760 events in 0 files, snapshot none (task 5480 ms: download 2115 ms overlapping gunzip 727 ms, parse 3484 ms, sort 0 ms, write 0 ms, index 538 ms: 3 candidates, 43599 repo-hours, 643 releases; waiting 477 ms; commit 0 ms)
2026-11-08T04:09:21Z [load_day 2024-01-14] 2024-01-14 hour 4: 136413 events in 0 files, snapshot none (task 4868 ms: download 2012 ms overlapping gunzip 650 ms, parse 2829 ms, sort 0 ms, write 0 ms, index 624 ms: 4 candidates, 43488 repo-hours, 463 releases; waiting 457 ms; commit 0 ms)
2026-11-08T04:09:21Z [load_day 2024-01-14] 2024-01-14 hour 5: 141093 events in 0 files, snapshot none (task 4847 ms: download 2137 ms overlapping gunzip 637 ms, parse 2805 ms, sort 0 ms, write 0 ms, index 629 ms: 0 candidates, 45410 repo-hours, 543 releases; waiting 481 ms; commit 0 ms)
2026-11-08T04:09:27Z [load_day 2024-01-14] 2024-01-14 hour 6: 152228 events in 0 files, snapshot none (task 5026 ms: download 2516 ms overlapping gunzip 654 ms, parse 3052 ms, sort 0 ms, write 0 ms, index 393 ms: 0 candidates, 52609 repo-hours, 586 releases; waiting 479 ms; commit 0 ms)
2026-11-08T04:09:27Z [load_day 2024-01-14] 2024-01-14 hour 7: 153512 events in 0 files, snapshot none (task 5015 ms: download 2116 ms overlapping gunzip 700 ms, parse 3098 ms, sort 0 ms, write 0 ms, index 449 ms: 2 candidates, 47975 repo-hours, 551 releases; waiting 475 ms; commit 0 ms)
2026-11-08T04:09:33Z [load_day 2024-01-14] 2024-01-14 hour 8: 156465 events in 0 files, snapshot none (task 5359 ms: download 2409 ms overlapping gunzip 761 ms, parse 3366 ms, sort 0 ms, write 0 ms, index 444 ms: 5 candidates, 50891 repo-hours, 835 releases; waiting 487 ms; commit 0 ms)
2026-11-08T04:09:33Z [load_day 2024-01-14] 2024-01-14 hour 9: 161781 events in 0 files, snapshot none (task 5428 ms: download 2698 ms overlapping gunzip 828 ms, parse 3599 ms, sort 0 ms, write 0 ms, index 417 ms: 0 candidates, 53376 repo-hours, 729 releases; waiting 348 ms; commit 0 ms)
2026-11-08T04:09:39Z [load_day 2024-01-14] 2024-01-14 hour 10: 166324 events in 0 files, snapshot none (task 6467 ms: download 2581 ms overlapping gunzip 911 ms, parse 4159 ms, sort 0 ms, write 0 ms, index 622 ms: 2 candidates, 58074 repo-hours, 563 releases; waiting 534 ms; commit 0 ms)
2026-11-08T04:09:39Z [load_day 2024-01-14] 2024-01-14 hour 11: 168658 events in 0 files, snapshot none (task 5957 ms: download 2453 ms overlapping gunzip 797 ms, parse 3584 ms, sort 0 ms, write 0 ms, index 882 ms: 5 candidates, 57221 repo-hours, 722 releases; waiting 480 ms; commit 0 ms)
2026-11-08T04:09:48Z [load_day 2024-01-14] 2024-01-14 hour 12: 240180 events in 0 files, snapshot none (task 7974 ms: download 3826 ms overlapping gunzip 1069 ms, parse 5253 ms, sort 0 ms, write 0 ms, index 978 ms: 6 candidates, 91412 repo-hours, 748 releases; waiting 486 ms; commit 0 ms)
2026-11-08T04:09:48Z [load_day 2024-01-14] 2024-01-14 hour 13: 214057 events in 0 files, snapshot none (task 7938 ms: download 3433 ms overlapping gunzip 1040 ms, parse 4667 ms, sort 0 ms, write 0 ms, index 1438 ms: 10 candidates, 82098 repo-hours, 733 releases; waiting 490 ms; commit 0 ms)
2026-11-08T04:09:55Z [load_day 2024-01-14] 2024-01-14 hour 14: 203835 events in 0 files, snapshot none (task 6671 ms: download 3398 ms overlapping gunzip 948 ms, parse 4127 ms, sort 0 ms, write 0 ms, index 667 ms: 14 candidates, 68041 repo-hours, 835 releases; waiting 538 ms; commit 0 ms)
2026-11-08T04:09:56Z [load_day 2024-01-14] 2024-01-14 hour 15: 211288 events in 0 files, snapshot none (task 7236 ms: download 3875 ms overlapping gunzip 1043 ms, parse 4529 ms, sort 0 ms, write 0 ms, index 828 ms: 5 candidates, 70272 repo-hours, 1000 releases; waiting 497 ms; commit 0 ms)
2026-11-08T04:10:03Z [load_day 2024-01-14] 2024-01-14 hour 16: 217917 events in 0 files, snapshot none (task 7461 ms: download 4013 ms overlapping gunzip 1068 ms, parse 4903 ms, sort 0 ms, write 0 ms, index 651 ms: 7 candidates, 67441 repo-hours, 814 releases; waiting 543 ms; commit 0 ms)
2026-11-08T04:10:03Z [load_day 2024-01-14] 2024-01-14 hour 17: 204387 events in 0 files, snapshot none (task 6678 ms: download 3386 ms overlapping gunzip 919 ms, parse 4325 ms, sort 0 ms, write 0 ms, index 647 ms: 8 candidates, 64441 repo-hours, 872 releases; waiting 569 ms; commit 0 ms)
2026-11-08T04:10:10Z [load_day 2024-01-14] 2024-01-14 hour 18: 208150 events in 0 files, snapshot none (task 6526 ms: download 3305 ms overlapping gunzip 937 ms, parse 4187 ms, sort 0 ms, write 0 ms, index 622 ms: 5 candidates, 70163 repo-hours, 840 releases; waiting 490 ms; commit 0 ms)
2026-11-08T04:10:10Z [load_day 2024-01-14] 2024-01-14 hour 19: 194789 events in 0 files, snapshot none (task 6189 ms: download 3033 ms overlapping gunzip 873 ms, parse 3913 ms, sort 0 ms, write 0 ms, index 619 ms: 11 candidates, 58110 repo-hours, 752 releases; waiting 501 ms; commit 0 ms)
2026-11-08T04:10:17Z [load_day 2024-01-14] 2024-01-14 hour 20: 191613 events in 0 files, snapshot none (task 6569 ms: download 3209 ms overlapping gunzip 952 ms, parse 4259 ms, sort 0 ms, write 0 ms, index 539 ms: 3 candidates, 58735 repo-hours, 746 releases; waiting 462 ms; commit 0 ms)
2026-11-08T04:10:17Z [load_day 2024-01-14] 2024-01-14 hour 21: 181726 events in 0 files, snapshot none (task 5532 ms: download 2389 ms overlapping gunzip 759 ms, parse 3453 ms, sort 0 ms, write 0 ms, index 515 ms: 9 candidates, 52891 repo-hours, 839 releases; waiting 497 ms; commit 0 ms)
2026-11-08T04:10:24Z [load_day 2024-01-14] 2024-01-14 hour 22: 172184 events in 0 files, snapshot none (task 5887 ms: download 2954 ms overlapping gunzip 922 ms, parse 3772 ms, sort 0 ms, write 0 ms, index 393 ms: 5 candidates, 48753 repo-hours, 795 releases; waiting 490 ms; commit 0 ms)
2026-11-08T04:10:24Z [load_day 2024-01-14] 2024-01-14 hour 23: 165646 events in 0 files, snapshot none (task 6093 ms: download 2980 ms overlapping gunzip 905 ms, parse 4042 ms, sort 0 ms, write 0 ms, index 423 ms: 6 candidates, 46543 repo-hours, 665 releases; waiting 509 ms; commit 0 ms)
2026-11-08T04:10:31Z [load_day 2024-01-14] 2024-01-14: repo_hour merged from 24 files to 1 (1418959 rows, 7232 ms)
2026-11-08T04:10:34Z [load_day 2024-01-14] 2024-01-14: index committed in 9974 ms (21 + 1 + 24 files)
2026-11-08T04:10:34Z [load_day 2024-01-14] 2024-01-14: 4227700 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:10:34Z [load_day 2024-01-14] attempt 1 succeeded