orcaLog in

Runs · run 2521

load_day 2024-05-30, attempt 1 succeeded

Host
73ccef5e07c2:129075
Started
2026-11-08T06:18:59Z
Ended
2026-11-08T06:20:45Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
710 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
172.4 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2521/load_day/2024-05-30/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:18:59Z [load_day 2024-05-30] attempt 1 started
2026-11-08T06:19:00Z [load_day 2024-05-30] 2024-05-30: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:19:07Z [load_day 2024-05-30] 2024-05-30 hour 0: 183212 events in 0 files, snapshot none (task 6532 ms: download 3266 ms overlapping gunzip 922 ms, parse 4029 ms, sort 0 ms, write 0 ms, index 843 ms: 7 candidates, 93069 repo-hours, 1202 releases; waiting 508 ms; commit 0 ms)
2026-11-08T06:19:07Z [load_day 2024-05-30] 2024-05-30 hour 1: 191320 events in 0 files, snapshot none (task 6547 ms: download 2792 ms overlapping gunzip 930 ms, parse 4008 ms, sort 0 ms, write 0 ms, index 836 ms: 10 candidates, 103209 repo-hours, 865 releases; waiting 517 ms; commit 0 ms)
2026-11-08T06:19:13Z [load_day 2024-05-30] 2024-05-30 hour 2: 171892 events in 0 files, snapshot none (task 5480 ms: download 2934 ms overlapping gunzip 731 ms, parse 3130 ms, sort 0 ms, write 0 ms, index 689 ms: 6 candidates, 65581 repo-hours, 841 releases; waiting 514 ms; commit 0 ms)
2026-11-08T06:19:14Z [load_day 2024-05-30] 2024-05-30 hour 3: 183522 events in 0 files, snapshot none (task 6247 ms: download 3652 ms overlapping gunzip 849 ms, parse 3518 ms, sort 0 ms, write 0 ms, index 1106 ms: 12 candidates, 74785 repo-hours, 4275 releases; waiting 495 ms; commit 0 ms)
2026-11-08T06:19:20Z [load_day 2024-05-30] 2024-05-30 hour 4: 155693 events in 0 files, snapshot none (task 6699 ms: download 3110 ms overlapping gunzip 1025 ms, parse 4253 ms, sort 0 ms, write 0 ms, index 570 ms: 5 candidates, 61962 repo-hours, 655 releases; waiting 523 ms; commit 0 ms)
2026-11-08T06:19:21Z [load_day 2024-05-30] 2024-05-30 hour 5: 172239 events in 0 files, snapshot none (task 7173 ms: download 4072 ms overlapping gunzip 1159 ms, parse 4824 ms, sort 0 ms, write 0 ms, index 537 ms: 13 candidates, 68456 repo-hours, 767 releases; waiting 402 ms; commit 0 ms)
2026-11-08T06:19:29Z [load_day 2024-05-30] 2024-05-30 hour 6: 210164 events in 0 files, snapshot none (task 8205 ms: download 4706 ms overlapping gunzip 1205 ms, parse 5183 ms, sort 0 ms, write 0 ms, index 1033 ms: 11 candidates, 93894 repo-hours, 1099 releases; waiting 521 ms; commit 0 ms)
2026-11-08T06:19:30Z [load_day 2024-05-30] 2024-05-30 hour 7: 210358 events in 0 files, snapshot none (task 8417 ms: download 5145 ms overlapping gunzip 1290 ms, parse 5492 ms, sort 0 ms, write 0 ms, index 763 ms: 5 candidates, 84221 repo-hours, 894 releases; waiting 513 ms; commit 0 ms)
2026-11-08T06:19:39Z [load_day 2024-05-30] 2024-05-30 hour 8: 232162 events in 0 files, snapshot none (task 9666 ms: download 5940 ms overlapping gunzip 1418 ms, parse 6359 ms, sort 0 ms, write 0 ms, index 1001 ms: 17 candidates, 94766 repo-hours, 1332 releases; waiting 573 ms; commit 0 ms)
2026-11-08T06:19:40Z [load_day 2024-05-30] 2024-05-30 hour 9: 229802 events in 0 files, snapshot none (task 9463 ms: download 6340 ms overlapping gunzip 1393 ms, parse 6546 ms, sort 0 ms, write 0 ms, index 795 ms: 18 candidates, 98771 repo-hours, 1477 releases; waiting 468 ms; commit 0 ms)
2026-11-08T06:19:48Z [load_day 2024-05-30] 2024-05-30 hour 10: 217006 events in 0 files, snapshot none (task 7945 ms: download 4510 ms overlapping gunzip 1138 ms, parse 4735 ms, sort 0 ms, write 0 ms, index 936 ms: 20 candidates, 88889 repo-hours, 1202 releases; waiting 648 ms; commit 0 ms)
2026-11-08T06:19:48Z [load_day 2024-05-30] 2024-05-30 hour 11: 225868 events in 0 files, snapshot none (task 7752 ms: download 4762 ms overlapping gunzip 1203 ms, parse 4988 ms, sort 0 ms, write 0 ms, index 806 ms: 22 candidates, 85208 repo-hours, 1128 releases; waiting 495 ms; commit 0 ms)
2026-11-08T06:19:56Z [load_day 2024-05-30] 2024-05-30 hour 12: 278794 events in 0 files, snapshot none (task 8113 ms: download 4745 ms overlapping gunzip 1187 ms, parse 5553 ms, sort 0 ms, write 0 ms, index 1298 ms: 11 candidates, 130411 repo-hours, 1353 releases; waiting 15 ms; commit 0 ms)
2026-11-08T06:19:57Z [load_day 2024-05-30] 2024-05-30 hour 13: 259727 events in 0 files, snapshot none (task 8603 ms: download 5513 ms overlapping gunzip 1405 ms, parse 6173 ms, sort 0 ms, write 0 ms, index 939 ms: 20 candidates, 111800 repo-hours, 1318 releases; waiting 21 ms; commit 0 ms)
2026-11-08T06:20:05Z [load_day 2024-05-30] 2024-05-30 hour 14: 250094 events in 0 files, snapshot none (task 8082 ms: download 4849 ms overlapping gunzip 1365 ms, parse 5672 ms, sort 0 ms, write 0 ms, index 966 ms: 13 candidates, 103452 repo-hours, 1302 releases; waiting 7 ms; commit 0 ms)
2026-11-08T06:20:06Z [load_day 2024-05-30] 2024-05-30 hour 15: 246604 events in 0 files, snapshot none (task 8229 ms: download 5339 ms overlapping gunzip 1438 ms, parse 5880 ms, sort 0 ms, write 0 ms, index 821 ms: 14 candidates, 109606 repo-hours, 1466 releases; waiting 0 ms; commit 0 ms)
2026-11-08T06:20:12Z [load_day 2024-05-30] 2024-05-30 hour 16: 233237 events in 0 files, snapshot none (task 6581 ms: download 4367 ms overlapping gunzip 1104 ms, parse 4752 ms, sort 0 ms, write 0 ms, index 661 ms: 14 candidates, 94666 repo-hours, 1427 releases; waiting 5 ms; commit 0 ms)
2026-11-08T06:20:13Z [load_day 2024-05-30] 2024-05-30 hour 17: 220194 events in 0 files, snapshot none (task 5976 ms: download 3753 ms overlapping gunzip 993 ms, parse 4301 ms, sort 0 ms, write 0 ms, index 614 ms: 15 candidates, 87824 repo-hours, 1195 releases; waiting 9 ms; commit 0 ms)
2026-11-08T06:20:19Z [load_day 2024-05-30] 2024-05-30 hour 18: 231202 events in 0 files, snapshot none (task 6115 ms: download 3741 ms overlapping gunzip 1021 ms, parse 4295 ms, sort 0 ms, write 0 ms, index 729 ms: 15 candidates, 99493 repo-hours, 1314 releases; waiting 13 ms; commit 0 ms)
2026-11-08T06:20:19Z [load_day 2024-05-30] 2024-05-30 hour 19: 221814 events in 0 files, snapshot none (task 5719 ms: download 3555 ms overlapping gunzip 981 ms, parse 4087 ms, sort 0 ms, write 0 ms, index 580 ms: 16 candidates, 78111 repo-hours, 1147 releases; waiting 13 ms; commit 0 ms)
2026-11-08T06:20:27Z [load_day 2024-05-30] 2024-05-30 hour 20: 204182 events in 0 files, snapshot none (task 7414 ms: download 4987 ms overlapping gunzip 1349 ms, parse 5399 ms, sort 0 ms, write 0 ms, index 589 ms: 17 candidates, 80029 repo-hours, 1030 releases; waiting 9 ms; commit 0 ms)
2026-11-08T06:20:27Z [load_day 2024-05-30] 2024-05-30 hour 21: 190426 events in 0 files, snapshot none (task 6685 ms: download 3766 ms overlapping gunzip 1199 ms, parse 4830 ms, sort 0 ms, write 0 ms, index 587 ms: 15 candidates, 77914 repo-hours, 1124 releases; waiting 13 ms; commit 0 ms)
2026-11-08T06:20:33Z [load_day 2024-05-30] 2024-05-30 hour 22: 165117 events in 0 files, snapshot none (task 5650 ms: download 3477 ms overlapping gunzip 1002 ms, parse 4063 ms, sort 0 ms, write 0 ms, index 516 ms: 17 candidates, 61839 repo-hours, 1002 releases; waiting 16 ms; commit 0 ms)
2026-11-08T06:20:33Z [load_day 2024-05-30] 2024-05-30 hour 23: 157022 events in 0 files, snapshot none (task 5485 ms: download 3147 ms overlapping gunzip 923 ms, parse 4023 ms, sort 0 ms, write 0 ms, index 464 ms: 12 candidates, 57811 repo-hours, 758 releases; waiting 8 ms; commit 0 ms)
2026-11-08T06:20:42Z [load_day 2024-05-30] 2024-05-30: repo_hour merged from 24 files to 1 (2105767 rows, 9461 ms)
2026-11-08T06:20:44Z [load_day 2024-05-30] 2024-05-30: index committed in 11488 ms (24 + 1 + 24 files)
2026-11-08T06:20:44Z [load_day 2024-05-30] 2024-05-30: 5041651 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:20:44Z [load_day 2024-05-30] attempt 1 succeeded