orcaLog in

Runs · run 2518

load_day 2024-05-29, attempt 1 succeeded

Host
73ccef5e07c2:128783
Started
2026-11-08T06:18:23Z
Ended
2026-11-08T06:20:19Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
819 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
182.0 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2518/load_day/2024-05-29/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:18:23Z [load_day 2024-05-29] attempt 1 started
2026-11-08T06:18:24Z [load_day 2024-05-29] 2024-05-29: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:18:32Z [load_day 2024-05-29] 2024-05-29 hour 0: 190541 events in 0 files, snapshot none (task 7486 ms: download 4283 ms overlapping gunzip 1078 ms, parse 4627 ms, sort 0 ms, write 0 ms, index 916 ms: 9 candidates, 91716 repo-hours, 1816 releases; waiting 522 ms; commit 0 ms)
2026-11-08T06:18:32Z [load_day 2024-05-29] 2024-05-29 hour 1: 205953 events in 0 files, snapshot none (task 7439 ms: download 4117 ms overlapping gunzip 995 ms, parse 4604 ms, sort 0 ms, write 0 ms, index 1004 ms: 12 candidates, 107679 repo-hours, 876 releases; waiting 505 ms; commit 0 ms)
2026-11-08T06:18:40Z [load_day 2024-05-29] 2024-05-29 hour 2: 173636 events in 0 files, snapshot none (task 6981 ms: download 4119 ms overlapping gunzip 1083 ms, parse 4433 ms, sort 0 ms, write 0 ms, index 727 ms: 9 candidates, 70233 repo-hours, 774 releases; waiting 476 ms; commit 0 ms)
2026-11-08T06:18:40Z [load_day 2024-05-29] 2024-05-29 hour 3: 189616 events in 0 files, snapshot none (task 6811 ms: download 4227 ms overlapping gunzip 1054 ms, parse 4323 ms, sort 0 ms, write 0 ms, index 647 ms: 7 candidates, 76781 repo-hours, 4428 releases; waiting 512 ms; commit 0 ms)
2026-11-08T06:18:47Z [load_day 2024-05-29] 2024-05-29 hour 4: 171262 events in 0 files, snapshot none (task 6182 ms: download 3789 ms overlapping gunzip 920 ms, parse 3998 ms, sort 0 ms, write 0 ms, index 446 ms: 9 candidates, 63293 repo-hours, 664 releases; waiting 540 ms; commit 0 ms)
2026-11-08T06:18:47Z [load_day 2024-05-29] 2024-05-29 hour 5: 190013 events in 0 files, snapshot none (task 6651 ms: download 4158 ms overlapping gunzip 1087 ms, parse 4129 ms, sort 0 ms, write 0 ms, index 594 ms: 11 candidates, 71977 repo-hours, 860 releases; waiting 528 ms; commit 0 ms)
2026-11-08T06:18:53Z [load_day 2024-05-29] 2024-05-29 hour 6: 227657 events in 0 files, snapshot none (task 6346 ms: download 3672 ms overlapping gunzip 915 ms, parse 4030 ms, sort 0 ms, write 0 ms, index 643 ms: 11 candidates, 94990 repo-hours, 993 releases; waiting 517 ms; commit 0 ms)
2026-11-08T06:18:55Z [load_day 2024-05-29] 2024-05-29 hour 7: 225903 events in 0 files, snapshot none (task 6821 ms: download 4338 ms overlapping gunzip 1052 ms, parse 4296 ms, sort 0 ms, write 0 ms, index 632 ms: 10 candidates, 93604 repo-hours, 1161 releases; waiting 520 ms; commit 0 ms)
2026-11-08T06:19:02Z [load_day 2024-05-29] 2024-05-29 hour 8: 236070 events in 0 files, snapshot none (task 8164 ms: download 5435 ms overlapping gunzip 1209 ms, parse 5091 ms, sort 0 ms, write 0 ms, index 878 ms: 13 candidates, 97288 repo-hours, 1407 releases; waiting 759 ms; commit 0 ms)
2026-11-08T06:19:02Z [load_day 2024-05-29] 2024-05-29 hour 9: 235907 events in 0 files, snapshot none (task 7018 ms: download 4421 ms overlapping gunzip 1075 ms, parse 4473 ms, sort 0 ms, write 0 ms, index 853 ms: 8 candidates, 101656 repo-hours, 1376 releases; waiting 397 ms; commit 0 ms)
2026-11-08T06:19:11Z [load_day 2024-05-29] 2024-05-29 hour 10: 227049 events in 0 files, snapshot none (task 8159 ms: download 5130 ms overlapping gunzip 1237 ms, parse 5186 ms, sort 0 ms, write 0 ms, index 892 ms: 8 candidates, 91522 repo-hours, 1153 releases; waiting 560 ms; commit 0 ms)
2026-11-08T06:19:11Z [load_day 2024-05-29] 2024-05-29 hour 11: 222711 events in 0 files, snapshot none (task 8369 ms: download 4767 ms overlapping gunzip 1221 ms, parse 5165 ms, sort 0 ms, write 0 ms, index 1185 ms: 12 candidates, 89910 repo-hours, 1083 releases; waiting 486 ms; commit 0 ms)
2026-11-08T06:19:22Z [load_day 2024-05-29] 2024-05-29 hour 12: 284230 events in 0 files, snapshot none (task 10535 ms: download 7076 ms overlapping gunzip 1660 ms, parse 7087 ms, sort 0 ms, write 0 ms, index 949 ms: 20 candidates, 133103 repo-hours, 1375 releases; waiting 515 ms; commit 0 ms)
2026-11-08T06:19:22Z [load_day 2024-05-29] 2024-05-29 hour 13: 270267 events in 0 files, snapshot none (task 10603 ms: download 7409 ms overlapping gunzip 1648 ms, parse 7244 ms, sort 0 ms, write 0 ms, index 963 ms: 19 candidates, 118660 repo-hours, 1350 releases; waiting 501 ms; commit 0 ms)
2026-11-08T06:19:33Z [load_day 2024-05-29] 2024-05-29 hour 14: 258064 events in 0 files, snapshot none (task 10561 ms: download 7449 ms overlapping gunzip 1859 ms, parse 7245 ms, sort 0 ms, write 0 ms, index 972 ms: 10 candidates, 102701 repo-hours, 1291 releases; waiting 222 ms; commit 0 ms)
2026-11-08T06:19:34Z [load_day 2024-05-29] 2024-05-29 hour 15: 256362 events in 0 files, snapshot none (task 11013 ms: download 7503 ms overlapping gunzip 1643 ms, parse 7032 ms, sort 0 ms, write 0 ms, index 1427 ms: 23 candidates, 110942 repo-hours, 1505 releases; waiting 552 ms; commit 0 ms)
2026-11-08T06:19:43Z [load_day 2024-05-29] 2024-05-29 hour 16: 238541 events in 0 files, snapshot none (task 9310 ms: download 6380 ms overlapping gunzip 1442 ms, parse 6017 ms, sort 0 ms, write 0 ms, index 1069 ms: 12 candidates, 99800 repo-hours, 1246 releases; waiting 503 ms; commit 0 ms)
2026-11-08T06:19:43Z [load_day 2024-05-29] 2024-05-29 hour 17: 221602 events in 0 files, snapshot none (task 8641 ms: download 5644 ms overlapping gunzip 1433 ms, parse 5884 ms, sort 0 ms, write 0 ms, index 900 ms: 19 candidates, 91565 repo-hours, 1082 releases; waiting 170 ms; commit 0 ms)
2026-11-08T06:19:52Z [load_day 2024-05-29] 2024-05-29 hour 18: 247248 events in 0 files, snapshot none (task 8580 ms: download 5690 ms overlapping gunzip 1347 ms, parse 5785 ms, sort 0 ms, write 0 ms, index 719 ms: 13 candidates, 101456 repo-hours, 1114 releases; waiting 494 ms; commit 0 ms)
2026-11-08T06:19:52Z [load_day 2024-05-29] 2024-05-29 hour 19: 218142 events in 0 files, snapshot none (task 8142 ms: download 4902 ms overlapping gunzip 1279 ms, parse 5430 ms, sort 0 ms, write 0 ms, index 618 ms: 11 candidates, 83650 repo-hours, 1035 releases; waiting 517 ms; commit 0 ms)
2026-11-08T06:20:01Z [load_day 2024-05-29] 2024-05-29 hour 20: 212993 events in 0 files, snapshot none (task 8215 ms: download 5230 ms overlapping gunzip 1212 ms, parse 5349 ms, sort 0 ms, write 0 ms, index 809 ms: 14 candidates, 81748 repo-hours, 1065 releases; waiting 554 ms; commit 0 ms)
2026-11-08T06:20:01Z [load_day 2024-05-29] 2024-05-29 hour 21: 180742 events in 0 files, snapshot none (task 6506 ms: download 3712 ms overlapping gunzip 947 ms, parse 3956 ms, sort 0 ms, write 0 ms, index 798 ms: 15 candidates, 69968 repo-hours, 909 releases; waiting 535 ms; commit 0 ms)
2026-11-08T06:20:07Z [load_day 2024-05-29] 2024-05-29 hour 22: 171784 events in 0 files, snapshot none (task 6094 ms: download 3708 ms overlapping gunzip 919 ms, parse 3853 ms, sort 0 ms, write 0 ms, index 475 ms: 16 candidates, 62679 repo-hours, 901 releases; waiting 526 ms; commit 0 ms)
2026-11-08T06:20:07Z [load_day 2024-05-29] 2024-05-29 hour 23: 152520 events in 0 files, snapshot none (task 6086 ms: download 3601 ms overlapping gunzip 866 ms, parse 3747 ms, sort 0 ms, write 0 ms, index 468 ms: 7 candidates, 57792 repo-hours, 906 releases; waiting 739 ms; commit 0 ms)
2026-11-08T06:20:17Z [load_day 2024-05-29] 2024-05-29: repo_hour merged from 24 files to 1 (2164713 rows, 9353 ms)
2026-11-08T06:20:19Z [load_day 2024-05-29] 2024-05-29: index committed in 11353 ms (24 + 1 + 24 files)
2026-11-08T06:20:19Z [load_day 2024-05-29] 2024-05-29: 5208813 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:20:19Z [load_day 2024-05-29] attempt 1 succeeded