orcaLog in

Runs · run 2634

load_day 2024-06-24, attempt 1 succeeded

Host
73ccef5e07c2:140890
Started
2026-11-08T06:40:50Z
Ended
2026-11-08T06:42:53Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
830 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
200.1 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2634/load_day/2024-06-24/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:40:50Z [load_day 2024-06-24] attempt 1 started
2026-11-08T06:40:51Z [load_day 2024-06-24] 2024-06-24: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:40:59Z [load_day 2024-06-24] 2024-06-24 hour 0: 168663 events in 0 files, snapshot none (task 6915 ms: download 5241 ms overlapping gunzip 994 ms, parse 4380 ms, sort 0 ms, write 0 ms, index 733 ms: 7 candidates, 85683 repo-hours, 3404 releases; waiting 555 ms; commit 0 ms)
2026-11-08T06:40:59Z [load_day 2024-06-24] 2024-06-24 hour 1: 191001 events in 0 files, snapshot none (task 7616 ms: download 5108 ms overlapping gunzip 1190 ms, parse 4966 ms, sort 0 ms, write 0 ms, index 698 ms: 6 candidates, 101170 repo-hours, 3283 releases; waiting 489 ms; commit 0 ms)
2026-11-08T06:41:06Z [load_day 2024-06-24] 2024-06-24 hour 2: 163858 events in 0 files, snapshot none (task 6564 ms: download 3822 ms overlapping gunzip 1085 ms, parse 4379 ms, sort 0 ms, write 0 ms, index 603 ms: 4 candidates, 65855 repo-hours, 3143 releases; waiting 197 ms; commit 0 ms)
2026-11-08T06:41:07Z [load_day 2024-06-24] 2024-06-24 hour 3: 188592 events in 0 files, snapshot none (task 7424 ms: download 4587 ms overlapping gunzip 1194 ms, parse 4872 ms, sort 0 ms, write 0 ms, index 655 ms: 5 candidates, 76090 repo-hours, 7844 releases; waiting 389 ms; commit 0 ms)
2026-11-08T06:41:13Z [load_day 2024-06-24] 2024-06-24 hour 4: 163057 events in 0 files, snapshot none (task 6894 ms: download 3820 ms overlapping gunzip 1046 ms, parse 4259 ms, sort 0 ms, write 0 ms, index 720 ms: 2 candidates, 60235 repo-hours, 3138 releases; waiting 532 ms; commit 0 ms)
2026-11-08T06:41:15Z [load_day 2024-06-24] 2024-06-24 hour 5: 176014 events in 0 files, snapshot none (task 7074 ms: download 4478 ms overlapping gunzip 1148 ms, parse 4469 ms, sort 0 ms, write 0 ms, index 618 ms: 4 candidates, 66784 repo-hours, 2287 releases; waiting 492 ms; commit 0 ms)
2026-11-08T06:41:21Z [load_day 2024-06-24] 2024-06-24 hour 6: 210087 events in 0 files, snapshot none (task 7769 ms: download 4904 ms overlapping gunzip 1261 ms, parse 5045 ms, sort 0 ms, write 0 ms, index 726 ms: 7 candidates, 93418 repo-hours, 2752 releases; waiting 495 ms; commit 0 ms)
2026-11-08T06:41:24Z [load_day 2024-06-24] 2024-06-24 hour 7: 216975 events in 0 files, snapshot none (task 8160 ms: download 5662 ms overlapping gunzip 1314 ms, parse 5360 ms, sort 0 ms, write 0 ms, index 697 ms: 1 candidates, 86874 repo-hours, 2658 releases; waiting 517 ms; commit 0 ms)
2026-11-08T06:41:30Z [load_day 2024-06-24] 2024-06-24 hour 8: 233544 events in 0 files, snapshot none (task 7799 ms: download 5350 ms overlapping gunzip 1259 ms, parse 5040 ms, sort 0 ms, write 0 ms, index 660 ms: 7 candidates, 100063 repo-hours, 3064 releases; waiting 552 ms; commit 0 ms)
2026-11-08T06:41:32Z [load_day 2024-06-24] 2024-06-24 hour 9: 235687 events in 0 files, snapshot none (task 7731 ms: download 5227 ms overlapping gunzip 1234 ms, parse 4951 ms, sort 0 ms, write 0 ms, index 679 ms: 4 candidates, 100014 repo-hours, 3128 releases; waiting 608 ms; commit 0 ms)
2026-11-08T06:41:40Z [load_day 2024-06-24] 2024-06-24 hour 10: 220159 events in 0 files, snapshot none (task 9939 ms: download 6971 ms overlapping gunzip 1709 ms, parse 6668 ms, sort 0 ms, write 0 ms, index 814 ms: 9 candidates, 88860 repo-hours, 3146 releases; waiting 525 ms; commit 0 ms)
2026-11-08T06:41:42Z [load_day 2024-06-24] 2024-06-24 hour 11: 218569 events in 0 files, snapshot none (task 9193 ms: download 6726 ms overlapping gunzip 1478 ms, parse 6262 ms, sort 0 ms, write 0 ms, index 642 ms: 4 candidates, 86067 repo-hours, 3133 releases; waiting 513 ms; commit 0 ms)
2026-11-08T06:41:53Z [load_day 2024-06-24] 2024-06-24 hour 12: 281063 events in 0 files, snapshot none (task 12629 ms: download 8821 ms overlapping gunzip 1959 ms, parse 8496 ms, sort 0 ms, write 0 ms, index 1372 ms: 5 candidates, 133688 repo-hours, 3087 releases; waiting 499 ms; commit 0 ms)
2026-11-08T06:41:55Z [load_day 2024-06-24] 2024-06-24 hour 13: 256738 events in 0 files, snapshot none (task 12586 ms: download 9608 ms overlapping gunzip 2117 ms, parse 9015 ms, sort 0 ms, write 0 ms, index 916 ms: 13 candidates, 114927 repo-hours, 3036 releases; waiting 210 ms; commit 0 ms)
2026-11-08T06:42:04Z [load_day 2024-06-24] 2024-06-24 hour 14: 249274 events in 0 files, snapshot none (task 10770 ms: download 7537 ms overlapping gunzip 1763 ms, parse 7358 ms, sort 0 ms, write 0 ms, index 872 ms: 12 candidates, 101761 repo-hours, 3288 releases; waiting 516 ms; commit 0 ms)
2026-11-08T06:42:06Z [load_day 2024-06-24] 2024-06-24 hour 15: 255724 events in 0 files, snapshot none (task 10758 ms: download 7735 ms overlapping gunzip 1813 ms, parse 7246 ms, sort 0 ms, write 0 ms, index 894 ms: 6 candidates, 109111 repo-hours, 3356 releases; waiting 483 ms; commit 0 ms)
2026-11-08T06:42:14Z [load_day 2024-06-24] 2024-06-24 hour 16: 234186 events in 0 files, snapshot none (task 9344 ms: download 6240 ms overlapping gunzip 1455 ms, parse 6180 ms, sort 0 ms, write 0 ms, index 922 ms: 8 candidates, 93912 repo-hours, 3192 releases; waiting 520 ms; commit 0 ms)
2026-11-08T06:42:15Z [load_day 2024-06-24] 2024-06-24 hour 17: 218023 events in 0 files, snapshot none (task 8874 ms: download 6350 ms overlapping gunzip 1522 ms, parse 6024 ms, sort 0 ms, write 0 ms, index 624 ms: 8 candidates, 86439 repo-hours, 2698 releases; waiting 431 ms; commit 0 ms)
2026-11-08T06:42:24Z [load_day 2024-06-24] 2024-06-24 hour 18: 228274 events in 0 files, snapshot none (task 9305 ms: download 6093 ms overlapping gunzip 1456 ms, parse 6122 ms, sort 0 ms, write 0 ms, index 812 ms: 10 candidates, 101821 repo-hours, 1377 releases; waiting 552 ms; commit 0 ms)
2026-11-08T06:42:24Z [load_day 2024-06-24] 2024-06-24 hour 19: 205091 events in 0 files, snapshot none (task 8149 ms: download 5413 ms overlapping gunzip 1302 ms, parse 5415 ms, sort 0 ms, write 0 ms, index 667 ms: 7 candidates, 79326 repo-hours, 1060 releases; waiting 535 ms; commit 0 ms)
2026-11-08T06:42:33Z [load_day 2024-06-24] 2024-06-24 hour 20: 199690 events in 0 files, snapshot none (task 8760 ms: download 5613 ms overlapping gunzip 1475 ms, parse 5873 ms, sort 0 ms, write 0 ms, index 645 ms: 10 candidates, 78028 repo-hours, 1027 releases; waiting 479 ms; commit 0 ms)
2026-11-08T06:42:33Z [load_day 2024-06-24] 2024-06-24 hour 21: 195160 events in 0 files, snapshot none (task 8052 ms: download 5089 ms overlapping gunzip 1261 ms, parse 5285 ms, sort 0 ms, write 0 ms, index 762 ms: 6 candidates, 77791 repo-hours, 1478 releases; waiting 483 ms; commit 0 ms)
2026-11-08T06:42:41Z [load_day 2024-06-24] 2024-06-24 hour 22: 167983 events in 0 files, snapshot none (task 7302 ms: download 4537 ms overlapping gunzip 1165 ms, parse 4768 ms, sort 0 ms, write 0 ms, index 511 ms: 5 candidates, 63548 repo-hours, 1121 releases; waiting 489 ms; commit 0 ms)
2026-11-08T06:42:41Z [load_day 2024-06-24] 2024-06-24 hour 23: 163304 events in 0 files, snapshot none (task 6552 ms: download 3979 ms overlapping gunzip 1034 ms, parse 4018 ms, sort 0 ms, write 0 ms, index 720 ms: 6 candidates, 60015 repo-hours, 1300 releases; waiting 515 ms; commit 0 ms)
2026-11-08T06:42:50Z [load_day 2024-06-24] 2024-06-24: repo_hour merged from 24 files to 1 (2111480 rows, 9400 ms)
2026-11-08T06:42:53Z [load_day 2024-06-24] 2024-06-24: index committed in 11884 ms (24 + 1 + 24 files)
2026-11-08T06:42:53Z [load_day 2024-06-24] 2024-06-24: 5040716 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:42:53Z [load_day 2024-06-24] attempt 1 succeeded