orcaLog in

Runs · run 2925

load_day 2024-09-05, attempt 1 succeeded

Host
73ccef5e07c2:173299
Started
2026-11-08T07:46:00Z
Ended
2026-11-08T07:48:08Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
738 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
188.0 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2925/load_day/2024-09-05/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:46:00Z [load_day 2024-09-05] attempt 1 started
2026-11-08T07:46:03Z [load_day 2024-09-05] 2024-09-05: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:46:14Z [load_day 2024-09-05] 2024-09-05 hour 0: 194975 events in 0 files, snapshot none (task 7487 ms: download 4096 ms overlapping gunzip 1107 ms, parse 4563 ms, sort 0 ms, write 0 ms, index 1004 ms: 7 candidates, 94502 repo-hours, 1095 releases; waiting 517 ms; commit 0 ms)
2026-11-08T07:46:14Z [load_day 2024-09-05] 2024-09-05 hour 1: 205416 events in 0 files, snapshot none (task 7481 ms: download 4076 ms overlapping gunzip 1055 ms, parse 4387 ms, sort 0 ms, write 0 ms, index 1171 ms: 5 candidates, 108649 repo-hours, 966 releases; waiting 478 ms; commit 0 ms)
2026-11-08T07:46:20Z [load_day 2024-09-05] 2024-09-05 hour 2: 175953 events in 0 files, snapshot none (task 6389 ms: download 3500 ms overlapping gunzip 951 ms, parse 3970 ms, sort 0 ms, write 0 ms, index 678 ms: 6 candidates, 77078 repo-hours, 960 releases; waiting 504 ms; commit 0 ms)
2026-11-08T07:46:21Z [load_day 2024-09-05] 2024-09-05 hour 3: 184618 events in 0 files, snapshot none (task 6660 ms: download 3431 ms overlapping gunzip 979 ms, parse 4040 ms, sort 0 ms, write 0 ms, index 823 ms: 3 candidates, 75864 repo-hours, 4124 releases; waiting 495 ms; commit 0 ms)
2026-11-08T07:46:27Z [load_day 2024-09-05] 2024-09-05 hour 4: 161862 events in 0 files, snapshot none (task 6036 ms: download 3542 ms overlapping gunzip 887 ms, parse 3716 ms, sort 0 ms, write 0 ms, index 533 ms: 3 candidates, 63037 repo-hours, 716 releases; waiting 586 ms; commit 0 ms)
2026-11-08T07:46:27Z [load_day 2024-09-05] 2024-09-05 hour 5: 178427 events in 0 files, snapshot none (task 6185 ms: download 3484 ms overlapping gunzip 988 ms, parse 3978 ms, sort 0 ms, write 0 ms, index 530 ms: 14 candidates, 71338 repo-hours, 967 releases; waiting 445 ms; commit 0 ms)
2026-11-08T07:46:35Z [load_day 2024-09-05] 2024-09-05 hour 6: 207640 events in 0 files, snapshot none (task 8114 ms: download 5326 ms overlapping gunzip 1228 ms, parse 5443 ms, sort 0 ms, write 0 ms, index 665 ms: 9 candidates, 93856 repo-hours, 1145 releases; waiting 505 ms; commit 0 ms)
2026-11-08T07:46:37Z [load_day 2024-09-05] 2024-09-05 hour 7: 215698 events in 0 files, snapshot none (task 8787 ms: download 6244 ms overlapping gunzip 1339 ms, parse 5716 ms, sort 0 ms, write 0 ms, index 618 ms: 6 candidates, 85773 repo-hours, 1031 releases; waiting 766 ms; commit 0 ms)
2026-11-08T07:46:46Z [load_day 2024-09-05] 2024-09-05 hour 8: 225252 events in 0 files, snapshot none (task 9863 ms: download 7136 ms overlapping gunzip 1534 ms, parse 6727 ms, sort 0 ms, write 0 ms, index 777 ms: 10 candidates, 93150 repo-hours, 1237 releases; waiting 554 ms; commit 0 ms)
2026-11-08T07:46:47Z [load_day 2024-09-05] 2024-09-05 hour 9: 228477 events in 0 files, snapshot none (task 9212 ms: download 6246 ms overlapping gunzip 1423 ms, parse 5999 ms, sort 0 ms, write 0 ms, index 767 ms: 5 candidates, 97991 repo-hours, 1461 releases; waiting 539 ms; commit 0 ms)
2026-11-08T07:46:55Z [load_day 2024-09-05] 2024-09-05 hour 10: 216322 events in 0 files, snapshot none (task 9072 ms: download 6305 ms overlapping gunzip 1409 ms, parse 6291 ms, sort 0 ms, write 0 ms, index 710 ms: 11 candidates, 88665 repo-hours, 1195 releases; waiting 323 ms; commit 0 ms)
2026-11-08T07:46:56Z [load_day 2024-09-05] 2024-09-05 hour 11: 217520 events in 0 files, snapshot none (task 8755 ms: download 6161 ms overlapping gunzip 1292 ms, parse 5990 ms, sort 0 ms, write 0 ms, index 704 ms: 8 candidates, 85966 repo-hours, 1260 releases; waiting 523 ms; commit 0 ms)
2026-11-08T07:47:06Z [load_day 2024-09-05] 2024-09-05 hour 12: 249653 events in 0 files, snapshot none (task 10033 ms: download 6739 ms overlapping gunzip 1607 ms, parse 6558 ms, sort 0 ms, write 0 ms, index 1113 ms: 10 candidates, 125858 repo-hours, 1254 releases; waiting 510 ms; commit 0 ms)
2026-11-08T07:47:07Z [load_day 2024-09-05] 2024-09-05 hour 13: 247853 events in 0 files, snapshot none (task 10300 ms: download 7504 ms overlapping gunzip 1680 ms, parse 7014 ms, sort 0 ms, write 0 ms, index 784 ms: 5 candidates, 114855 repo-hours, 1372 releases; waiting 495 ms; commit 0 ms)
2026-11-08T07:47:17Z [load_day 2024-09-05] 2024-09-05 hour 14: 246080 events in 0 files, snapshot none (task 10249 ms: download 7538 ms overlapping gunzip 1624 ms, parse 7064 ms, sort 0 ms, write 0 ms, index 719 ms: 10 candidates, 103702 repo-hours, 1413 releases; waiting 521 ms; commit 0 ms)
2026-11-08T07:47:18Z [load_day 2024-09-05] 2024-09-05 hour 15: 247907 events in 0 files, snapshot none (task 10405 ms: download 7760 ms overlapping gunzip 1715 ms, parse 7117 ms, sort 0 ms, write 0 ms, index 737 ms: 6 candidates, 107744 repo-hours, 1476 releases; waiting 488 ms; commit 0 ms)
2026-11-08T07:47:27Z [load_day 2024-09-05] 2024-09-05 hour 16: 232139 events in 0 files, snapshot none (task 10025 ms: download 7130 ms overlapping gunzip 1515 ms, parse 6766 ms, sort 0 ms, write 0 ms, index 747 ms: 6 candidates, 98650 repo-hours, 1205 releases; waiting 526 ms; commit 0 ms)
2026-11-08T07:47:28Z [load_day 2024-09-05] 2024-09-05 hour 17: 228228 events in 0 files, snapshot none (task 9423 ms: download 6833 ms overlapping gunzip 1511 ms, parse 6445 ms, sort 0 ms, write 0 ms, index 698 ms: 12 candidates, 92418 repo-hours, 1147 releases; waiting 484 ms; commit 0 ms)
2026-11-08T07:47:37Z [load_day 2024-09-05] 2024-09-05 hour 18: 232267 events in 0 files, snapshot none (task 9607 ms: download 6876 ms overlapping gunzip 1488 ms, parse 6444 ms, sort 0 ms, write 0 ms, index 826 ms: 14 candidates, 102144 repo-hours, 1237 releases; waiting 556 ms; commit 0 ms)
2026-11-08T07:47:38Z [load_day 2024-09-05] 2024-09-05 hour 19: 208723 events in 0 files, snapshot none (task 9661 ms: download 6774 ms overlapping gunzip 1556 ms, parse 6446 ms, sort 0 ms, write 0 ms, index 696 ms: 18 candidates, 80078 repo-hours, 1122 releases; waiting 517 ms; commit 0 ms)
2026-11-08T07:47:46Z [load_day 2024-09-05] 2024-09-05 hour 20: 201545 events in 0 files, snapshot none (task 8000 ms: download 5446 ms overlapping gunzip 1274 ms, parse 5253 ms, sort 0 ms, write 0 ms, index 614 ms: 7 candidates, 79093 repo-hours, 1093 releases; waiting 532 ms; commit 0 ms)
2026-11-08T07:47:46Z [load_day 2024-09-05] 2024-09-05 hour 21: 189013 events in 0 files, snapshot none (task 7343 ms: download 6359 ms overlapping gunzip 1127 ms, parse 4724 ms, sort 0 ms, write 0 ms, index 602 ms: 7 candidates, 75293 repo-hours, 1287 releases; waiting 648 ms; commit 0 ms)
2026-11-08T07:47:52Z [load_day 2024-09-05] 2024-09-05 hour 22: 169802 events in 0 files, snapshot none (task 6318 ms: download 3926 ms overlapping gunzip 958 ms, parse 4025 ms, sort 0 ms, write 0 ms, index 440 ms: 6 candidates, 63606 repo-hours, 1142 releases; waiting 525 ms; commit 0 ms)
2026-11-08T07:47:52Z [load_day 2024-09-05] 2024-09-05 hour 23: 159587 events in 0 files, snapshot none (task 5523 ms: download 3107 ms overlapping gunzip 864 ms, parse 3658 ms, sort 0 ms, write 0 ms, index 451 ms: 3 candidates, 59596 repo-hours, 892 releases; waiting 187 ms; commit 0 ms)
2026-11-08T07:48:02Z [load_day 2024-09-05] 2024-09-05: repo_hour merged from 24 files to 1 (2138906 rows, 9077 ms)
2026-11-08T07:48:08Z [load_day 2024-09-05] 2024-09-05: index committed in 15241 ms (24 + 1 + 24 files)
2026-11-08T07:48:08Z [load_day 2024-09-05] 2024-09-05: 5024957 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:48:08Z [load_day 2024-09-05] attempt 1 succeeded