orcaLog in

Runs · run 2005

load_day 2024-01-25, attempt 1 succeeded

Host
73ccef5e07c2:69571
Started
2026-11-08T04:19:04Z
Ended
2026-11-08T04:21:05Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
687 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
176.5 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2005/load_day/2024-01-25/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:19:04Z [load_day 2024-01-25] attempt 1 started
2026-11-08T04:19:05Z [load_day 2024-01-25] 2024-01-25: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:19:14Z [load_day 2024-01-25] 2024-01-25 hour 0: 203910 events in 0 files, snapshot none (task 8511 ms: download 5158 ms overlapping gunzip 1354 ms, parse 5549 ms, sort 0 ms, write 0 ms, index 756 ms: 7 candidates, 85391 repo-hours, 1009 releases; waiting 534 ms; commit 0 ms)
2026-11-08T04:19:14Z [load_day 2024-01-25] 2024-01-25 hour 1: 206425 events in 0 files, snapshot none (task 8023 ms: download 4748 ms overlapping gunzip 1195 ms, parse 5065 ms, sort 0 ms, write 0 ms, index 1044 ms: 8 candidates, 95617 repo-hours, 996 releases; waiting 476 ms; commit 0 ms)
2026-11-08T04:19:20Z [load_day 2024-01-25] 2024-01-25 hour 2: 182145 events in 0 files, snapshot none (task 5686 ms: download 2589 ms overlapping gunzip 844 ms, parse 3533 ms, sort 0 ms, write 0 ms, index 739 ms: 3 candidates, 64967 repo-hours, 751 releases; waiting 245 ms; commit 0 ms)
2026-11-08T04:19:22Z [load_day 2024-01-25] 2024-01-25 hour 3: 182898 events in 0 files, snapshot none (task 7817 ms: download 3677 ms overlapping gunzip 1154 ms, parse 4770 ms, sort 0 ms, write 0 ms, index 1037 ms: 1 candidates, 64611 repo-hours, 830 releases; waiting 490 ms; commit 0 ms)
2026-11-08T04:19:27Z [load_day 2024-01-25] 2024-01-25 hour 4: 177109 events in 0 files, snapshot none (task 6197 ms: download 4207 ms overlapping gunzip 1011 ms, parse 3885 ms, sort 0 ms, write 0 ms, index 464 ms: 2 candidates, 58891 repo-hours, 650 releases; waiting 487 ms; commit 0 ms)
2026-11-08T04:19:30Z [load_day 2024-01-25] 2024-01-25 hour 5: 184808 events in 0 files, snapshot none (task 6893 ms: download 3720 ms overlapping gunzip 1047 ms, parse 4231 ms, sort 0 ms, write 0 ms, index 870 ms: 5 candidates, 62376 repo-hours, 665 releases; waiting 493 ms; commit 0 ms)
2026-11-08T04:19:35Z [load_day 2024-01-25] 2024-01-25 hour 6: 200973 events in 0 files, snapshot none (task 7959 ms: download 4382 ms overlapping gunzip 1193 ms, parse 5257 ms, sort 0 ms, write 0 ms, index 692 ms: 7 candidates, 75053 repo-hours, 813 releases; waiting 538 ms; commit 0 ms)
2026-11-08T04:19:37Z [load_day 2024-01-25] 2024-01-25 hour 7: 206564 events in 0 files, snapshot none (task 7072 ms: download 4714 ms overlapping gunzip 1127 ms, parse 4674 ms, sort 0 ms, write 0 ms, index 553 ms: 7 candidates, 74703 repo-hours, 821 releases; waiting 452 ms; commit 0 ms)
2026-11-08T04:19:44Z [load_day 2024-01-25] 2024-01-25 hour 8: 207737 events in 0 files, snapshot none (task 8604 ms: download 5124 ms overlapping gunzip 1328 ms, parse 5606 ms, sort 0 ms, write 0 ms, index 820 ms: 8 candidates, 80330 repo-hours, 984 releases; waiting 544 ms; commit 0 ms)
2026-11-08T04:19:47Z [load_day 2024-01-25] 2024-01-25 hour 9: 230289 events in 0 files, snapshot none (task 9490 ms: download 6657 ms overlapping gunzip 1555 ms, parse 6301 ms, sort 0 ms, write 0 ms, index 824 ms: 11 candidates, 88239 repo-hours, 1243 releases; waiting 509 ms; commit 0 ms)
2026-11-08T04:19:55Z [load_day 2024-01-25] 2024-01-25 hour 10: 227831 events in 0 files, snapshot none (task 9789 ms: download 5992 ms overlapping gunzip 1504 ms, parse 6470 ms, sort 0 ms, write 0 ms, index 1026 ms: 9 candidates, 87303 repo-hours, 1114 releases; waiting 488 ms; commit 0 ms)
2026-11-08T04:19:57Z [load_day 2024-01-25] 2024-01-25 hour 11: 223859 events in 0 files, snapshot none (task 8799 ms: download 6120 ms overlapping gunzip 1433 ms, parse 5787 ms, sort 0 ms, write 0 ms, index 750 ms: 5 candidates, 84202 repo-hours, 1105 releases; waiting 527 ms; commit 0 ms)
2026-11-08T04:20:05Z [load_day 2024-01-25] 2024-01-25 hour 12: 265568 events in 0 files, snapshot none (task 9805 ms: download 5406 ms overlapping gunzip 1391 ms, parse 6250 ms, sort 0 ms, write 0 ms, index 1360 ms: 10 candidates, 113439 repo-hours, 1176 releases; waiting 509 ms; commit 0 ms)
2026-11-08T04:20:08Z [load_day 2024-01-25] 2024-01-25 hour 13: 250647 events in 0 files, snapshot none (task 10421 ms: download 7355 ms overlapping gunzip 1569 ms, parse 7009 ms, sort 0 ms, write 0 ms, index 1015 ms: 19 candidates, 107877 repo-hours, 1085 releases; waiting 552 ms; commit 0 ms)
2026-11-08T04:20:16Z [load_day 2024-01-25] 2024-01-25 hour 14: 243468 events in 0 files, snapshot none (task 10409 ms: download 7075 ms overlapping gunzip 1699 ms, parse 6995 ms, sort 0 ms, write 0 ms, index 906 ms: 7 candidates, 99977 repo-hours, 1197 releases; waiting 459 ms; commit 0 ms)
2026-11-08T04:20:18Z [load_day 2024-01-25] 2024-01-25 hour 15: 247841 events in 0 files, snapshot none (task 9885 ms: download 7236 ms overlapping gunzip 1592 ms, parse 6777 ms, sort 0 ms, write 0 ms, index 734 ms: 10 candidates, 100747 repo-hours, 1480 releases; waiting 488 ms; commit 0 ms)
2026-11-08T04:20:27Z [load_day 2024-01-25] 2024-01-25 hour 16: 232671 events in 0 files, snapshot none (task 10042 ms: download 7130 ms overlapping gunzip 1631 ms, parse 6433 ms, sort 0 ms, write 0 ms, index 712 ms: 14 candidates, 94571 repo-hours, 1284 releases; waiting 935 ms; commit 0 ms)
2026-11-08T04:20:28Z [load_day 2024-01-25] 2024-01-25 hour 17: 228653 events in 0 files, snapshot none (task 9508 ms: download 7017 ms overlapping gunzip 1551 ms, parse 6694 ms, sort 0 ms, write 0 ms, index 662 ms: 11 candidates, 90624 repo-hours, 1081 releases; waiting 291 ms; commit 0 ms)
2026-11-08T04:20:35Z [load_day 2024-01-25] 2024-01-25 hour 18: 231204 events in 0 files, snapshot none (task 7909 ms: download 5043 ms overlapping gunzip 1182 ms, parse 5165 ms, sort 0 ms, write 0 ms, index 751 ms: 11 candidates, 92026 repo-hours, 1124 releases; waiting 499 ms; commit 0 ms)
2026-11-08T04:20:36Z [load_day 2024-01-25] 2024-01-25 hour 19: 212536 events in 0 files, snapshot none (task 7195 ms: download 4656 ms overlapping gunzip 1184 ms, parse 4910 ms, sort 0 ms, write 0 ms, index 647 ms: 6 candidates, 81233 repo-hours, 1084 releases; waiting 178 ms; commit 0 ms)
2026-11-08T04:20:42Z [load_day 2024-01-25] 2024-01-25 hour 20: 216874 events in 0 files, snapshot none (task 6962 ms: download 4127 ms overlapping gunzip 998 ms, parse 4127 ms, sort 0 ms, write 0 ms, index 890 ms: 7 candidates, 78919 repo-hours, 1113 releases; waiting 644 ms; commit 0 ms)
2026-11-08T04:20:46Z [load_day 2024-01-25] 2024-01-25 hour 21: 207632 events in 0 files, snapshot none (task 9347 ms: download 5365 ms overlapping gunzip 1172 ms, parse 5066 ms, sort 0 ms, write 0 ms, index 1296 ms: 9 candidates, 73536 repo-hours, 1030 releases; waiting 1525 ms; commit 0 ms)
2026-11-08T04:20:50Z [load_day 2024-01-25] 2024-01-25 hour 22: 181100 events in 0 files, snapshot none (task 7481 ms: download 4565 ms overlapping gunzip 1226 ms, parse 4952 ms, sort 0 ms, write 0 ms, index 514 ms: 13 candidates, 65167 repo-hours, 1229 releases; waiting 505 ms; commit 0 ms)
2026-11-08T04:20:53Z [load_day 2024-01-25] 2024-01-25 hour 23: 175527 events in 0 files, snapshot none (task 6890 ms: download 3818 ms overlapping gunzip 1024 ms, parse 4293 ms, sort 0 ms, write 0 ms, index 766 ms: 8 candidates, 61025 repo-hours, 865 releases; waiting 495 ms; commit 0 ms)
2026-11-08T04:21:02Z [load_day 2024-01-25] 2024-01-25: repo_hour merged from 24 files to 1 (1980824 rows, 9314 ms)
2026-11-08T04:21:05Z [load_day 2024-01-25] 2024-01-25: index committed in 11977 ms (24 + 1 + 24 files)
2026-11-08T04:21:05Z [load_day 2024-01-25] 2024-01-25: 5128269 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:21:05Z [load_day 2024-01-25] attempt 1 succeeded