orcaLog in

Runs · run 4274

load_day 2025-08-14, attempt 1 succeeded

Host
73ccef5e07c2:361033
Started
2026-11-08T13:22:51Z
Ended
2026-11-08T13:24:39Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
671 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
153.9 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4274/load_day/2025-08-14/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:22:51Z [load_day 2025-08-14] attempt 1 started
2026-11-08T13:22:52Z [load_day 2025-08-14] 2025-08-14: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:22:59Z [load_day 2025-08-14] 2025-08-14 hour 0: 147483 events in 0 files, snapshot none (task 6964 ms: download 3895 ms overlapping gunzip 1112 ms, parse 4500 ms, sort 0 ms, write 0 ms, index 629 ms: 6 candidates, 69604 repo-hours, 954 releases; waiting 405 ms; commit 0 ms)
2026-11-08T13:22:59Z [load_day 2025-08-14] 2025-08-14 hour 1: 154130 events in 0 files, snapshot none (task 7168 ms: download 3963 ms overlapping gunzip 946 ms, parse 4191 ms, sort 0 ms, write 0 ms, index 1015 ms: 3 candidates, 88576 repo-hours, 731 releases; waiting 707 ms; commit 0 ms)
2026-11-08T13:23:06Z [load_day 2025-08-14] 2025-08-14 hour 2: 146869 events in 0 files, snapshot none (task 5967 ms: download 3184 ms overlapping gunzip 869 ms, parse 3499 ms, sort 0 ms, write 0 ms, index 806 ms: 5 candidates, 72412 repo-hours, 738 releases; waiting 496 ms; commit 0 ms)
2026-11-08T13:23:06Z [load_day 2025-08-14] 2025-08-14 hour 3: 139334 events in 0 files, snapshot none (task 6313 ms: download 3256 ms overlapping gunzip 968 ms, parse 3900 ms, sort 0 ms, write 0 ms, index 598 ms: 7 candidates, 65511 repo-hours, 1484 releases; waiting 502 ms; commit 0 ms)
2026-11-08T13:23:11Z [load_day 2025-08-14] 2025-08-14 hour 4: 131900 events in 0 files, snapshot none (task 4958 ms: download 2472 ms overlapping gunzip 732 ms, parse 2936 ms, sort 0 ms, write 0 ms, index 640 ms: 3 candidates, 61289 repo-hours, 931 releases; waiting 329 ms; commit 0 ms)
2026-11-08T13:23:13Z [load_day 2025-08-14] 2025-08-14 hour 5: 142939 events in 0 files, snapshot none (task 6810 ms: download 3974 ms overlapping gunzip 952 ms, parse 3642 ms, sort 0 ms, write 0 ms, index 657 ms: 6 candidates, 64113 repo-hours, 631 releases; waiting 1222 ms; commit 0 ms)
2026-11-08T13:23:18Z [load_day 2025-08-14] 2025-08-14 hour 6: 153749 events in 0 files, snapshot none (task 6435 ms: download 3970 ms overlapping gunzip 1038 ms, parse 3980 ms, sort 0 ms, write 0 ms, index 594 ms: 5 candidates, 77955 repo-hours, 773 releases; waiting 510 ms; commit 0 ms)
2026-11-08T13:23:20Z [load_day 2025-08-14] 2025-08-14 hour 7: 157075 events in 0 files, snapshot none (task 6530 ms: download 3780 ms overlapping gunzip 1014 ms, parse 3888 ms, sort 0 ms, write 0 ms, index 769 ms: 9 candidates, 73713 repo-hours, 772 releases; waiting 515 ms; commit 0 ms)
2026-11-08T13:23:27Z [load_day 2025-08-14] 2025-08-14 hour 8: 158541 events in 0 files, snapshot none (task 8787 ms: download 6031 ms overlapping gunzip 1234 ms, parse 4955 ms, sort 0 ms, write 0 ms, index 692 ms: 5 candidates, 78532 repo-hours, 844 releases; waiting 1457 ms; commit 0 ms)
2026-11-08T13:23:28Z [load_day 2025-08-14] 2025-08-14 hour 9: 160915 events in 0 files, snapshot none (task 6867 ms: download 4437 ms overlapping gunzip 1069 ms, parse 4414 ms, sort 0 ms, write 0 ms, index 630 ms: 3 candidates, 77815 repo-hours, 962 releases; waiting 475 ms; commit 0 ms)
2026-11-08T13:23:39Z [load_day 2025-08-14] 2025-08-14 hour 10: 162499 events in 0 files, snapshot none (task 6537 ms: download 3775 ms overlapping gunzip 971 ms, parse 3733 ms, sort 0 ms, write 0 ms, index 631 ms: 5 candidates, 77593 repo-hours, 872 releases; waiting 684 ms; commit 0 ms)
2026-11-08T13:23:40Z [load_day 2025-08-14] 2025-08-14 hour 11: 161980 events in 0 files, snapshot none (task 6831 ms: download 4702 ms overlapping gunzip 1096 ms, parse 3975 ms, sort 0 ms, write 0 ms, index 556 ms: 5 candidates, 75303 repo-hours, 776 releases; waiting 949 ms; commit 0 ms)
2026-11-08T13:23:46Z [load_day 2025-08-14] 2025-08-14 hour 12: 165370 events in 0 files, snapshot none (task 5948 ms: download 3522 ms overlapping gunzip 863 ms, parse 3463 ms, sort 0 ms, write 0 ms, index 631 ms: 1 candidates, 96008 repo-hours, 835 releases; waiting 690 ms; commit 0 ms)
2026-11-08T13:23:46Z [load_day 2025-08-14] 2025-08-14 hour 13: 162415 events in 0 files, snapshot none (task 6090 ms: download 3771 ms overlapping gunzip 932 ms, parse 3684 ms, sort 0 ms, write 0 ms, index 603 ms: 7 candidates, 89452 repo-hours, 936 releases; waiting 603 ms; commit 0 ms)
2026-11-08T13:23:55Z [load_day 2025-08-14] 2025-08-14 hour 14: 162136 events in 0 files, snapshot none (task 8538 ms: download 6115 ms overlapping gunzip 1339 ms, parse 5288 ms, sort 0 ms, write 0 ms, index 639 ms: 6 candidates, 82562 repo-hours, 878 releases; waiting 972 ms; commit 0 ms)
2026-11-08T13:23:55Z [load_day 2025-08-14] 2025-08-14 hour 15: 161887 events in 0 files, snapshot none (task 7616 ms: download 5091 ms overlapping gunzip 1236 ms, parse 5135 ms, sort 0 ms, write 0 ms, index 591 ms: 4 candidates, 81911 repo-hours, 923 releases; waiting 384 ms; commit 0 ms)
2026-11-08T13:24:04Z [load_day 2025-08-14] 2025-08-14 hour 16: 163485 events in 0 files, snapshot none (task 8552 ms: download 6029 ms overlapping gunzip 1428 ms, parse 5643 ms, sort 0 ms, write 0 ms, index 643 ms: 6 candidates, 79263 repo-hours, 774 releases; waiting 555 ms; commit 0 ms)
2026-11-08T13:24:04Z [load_day 2025-08-14] 2025-08-14 hour 17: 158834 events in 0 files, snapshot none (task 7632 ms: download 5302 ms overlapping gunzip 1337 ms, parse 4871 ms, sort 0 ms, write 0 ms, index 635 ms: 8 candidates, 73900 repo-hours, 705 releases; waiting 525 ms; commit 0 ms)
2026-11-08T13:24:12Z [load_day 2025-08-14] 2025-08-14 hour 18: 161506 events in 0 files, snapshot none (task 7177 ms: download 4483 ms overlapping gunzip 1227 ms, parse 4491 ms, sort 0 ms, write 0 ms, index 730 ms: 9 candidates, 80855 repo-hours, 866 releases; waiting 415 ms; commit 0 ms)
2026-11-08T13:24:12Z [load_day 2025-08-14] 2025-08-14 hour 19: 157564 events in 0 files, snapshot none (task 6694 ms: download 4047 ms overlapping gunzip 1102 ms, parse 4416 ms, sort 0 ms, write 0 ms, index 639 ms: 7 candidates, 68693 repo-hours, 739 releases; waiting 219 ms; commit 0 ms)
2026-11-08T13:24:19Z [load_day 2025-08-14] 2025-08-14 hour 20: 153830 events in 0 files, snapshot none (task 6949 ms: download 4107 ms overlapping gunzip 1060 ms, parse 4138 ms, sort 0 ms, write 0 ms, index 716 ms: 4 candidates, 69006 repo-hours, 806 releases; waiting 772 ms; commit 0 ms)
2026-11-08T13:24:19Z [load_day 2025-08-14] 2025-08-14 hour 21: 152407 events in 0 files, snapshot none (task 6716 ms: download 3495 ms overlapping gunzip 1034 ms, parse 4203 ms, sort 0 ms, write 0 ms, index 731 ms: 6 candidates, 66596 repo-hours, 876 releases; waiting 516 ms; commit 0 ms)
2026-11-08T13:24:27Z [load_day 2025-08-14] 2025-08-14 hour 22: 146297 events in 0 files, snapshot none (task 7372 ms: download 4518 ms overlapping gunzip 1172 ms, parse 4551 ms, sort 0 ms, write 0 ms, index 495 ms: 5 candidates, 63144 repo-hours, 808 releases; waiting 704 ms; commit 0 ms)
2026-11-08T13:24:27Z [load_day 2025-08-14] 2025-08-14 hour 23: 141272 events in 0 files, snapshot none (task 7059 ms: download 4543 ms overlapping gunzip 1126 ms, parse 4247 ms, sort 0 ms, write 0 ms, index 594 ms: 4 candidates, 57859 repo-hours, 835 releases; waiting 786 ms; commit 0 ms)
2026-11-08T13:24:36Z [load_day 2025-08-14] 2025-08-14: repo_hour merged from 24 files to 1 (1791665 rows, 8290 ms)
2026-11-08T13:24:39Z [load_day 2025-08-14] 2025-08-14: index committed in 11573 ms (24 + 1 + 24 files)
2026-11-08T13:24:39Z [load_day 2025-08-14] 2025-08-14: 3704417 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:24:39Z [load_day 2025-08-14] attempt 1 succeeded