orcaLog in

Runs · run 3696

load_day 2025-03-21, attempt 1 succeeded

Host
73ccef5e07c2:274487
Started
2026-11-08T10:58:17Z
Ended
2026-11-08T11:00:26Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
806 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
202.7 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3696/load_day/2025-03-21/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:58:17Z [load_day 2025-03-21] attempt 1 started
2026-11-08T10:58:18Z [load_day 2025-03-21] 2025-03-21: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:58:27Z [load_day 2025-03-21] 2025-03-21 hour 0: 211082 events in 0 files, snapshot none (task 8524 ms: download 5728 ms overlapping gunzip 1298 ms, parse 5650 ms, sort 0 ms, write 0 ms, index 703 ms: 5 candidates, 97883 repo-hours, 1286 releases; waiting 644 ms; commit 0 ms)
2026-11-08T10:58:27Z [load_day 2025-03-21] 2025-03-21 hour 1: 229944 events in 0 files, snapshot none (task 8225 ms: download 5254 ms overlapping gunzip 1240 ms, parse 5366 ms, sort 0 ms, write 0 ms, index 895 ms: 5 candidates, 123720 repo-hours, 907 releases; waiting 458 ms; commit 0 ms)
2026-11-08T10:58:34Z [load_day 2025-03-21] 2025-03-21 hour 2: 197909 events in 0 files, snapshot none (task 6341 ms: download 3500 ms overlapping gunzip 909 ms, parse 3776 ms, sort 0 ms, write 0 ms, index 765 ms: 6 candidates, 86753 repo-hours, 1053 releases; waiting 542 ms; commit 0 ms)
2026-11-08T10:58:35Z [load_day 2025-03-21] 2025-03-21 hour 3: 215954 events in 0 files, snapshot none (task 7367 ms: download 4402 ms overlapping gunzip 1120 ms, parse 4482 ms, sort 0 ms, write 0 ms, index 715 ms: 3 candidates, 88710 repo-hours, 3244 releases; waiting 794 ms; commit 0 ms)
2026-11-08T10:58:40Z [load_day 2025-03-21] 2025-03-21 hour 4: 195943 events in 0 files, snapshot none (task 5518 ms: download 3290 ms overlapping gunzip 781 ms, parse 3358 ms, sort 0 ms, write 0 ms, index 540 ms: 3 candidates, 73142 repo-hours, 684 releases; waiting 531 ms; commit 0 ms)
2026-11-08T10:58:41Z [load_day 2025-03-21] 2025-03-21 hour 5: 203898 events in 0 files, snapshot none (task 5415 ms: download 3104 ms overlapping gunzip 839 ms, parse 3627 ms, sort 0 ms, write 0 ms, index 557 ms: 3 candidates, 78879 repo-hours, 814 releases; waiting 182 ms; commit 0 ms)
2026-11-08T10:58:48Z [load_day 2025-03-21] 2025-03-21 hour 6: 234257 events in 0 files, snapshot none (task 7531 ms: download 3944 ms overlapping gunzip 999 ms, parse 4078 ms, sort 0 ms, write 0 ms, index 1570 ms: 2 candidates, 101599 repo-hours, 1142 releases; waiting 543 ms; commit 0 ms)
2026-11-08T10:58:52Z [load_day 2025-03-21] 2025-03-21 hour 7: 229798 events in 0 files, snapshot none (task 10699 ms: download 7733 ms overlapping gunzip 1381 ms, parse 5616 ms, sort 0 ms, write 0 ms, index 656 ms: 7 candidates, 89901 repo-hours, 1045 releases; waiting 2658 ms; commit 0 ms)
2026-11-08T10:58:58Z [load_day 2025-03-21] 2025-03-21 hour 8: 243862 events in 0 files, snapshot none (task 8907 ms: download 5560 ms overlapping gunzip 1411 ms, parse 5831 ms, sort 0 ms, write 0 ms, index 845 ms: 7 candidates, 99981 repo-hours, 1106 releases; waiting 503 ms; commit 0 ms)
2026-11-08T10:59:03Z [load_day 2025-03-21] 2025-03-21 hour 9: 263461 events in 0 files, snapshot none (task 10670 ms: download 6791 ms overlapping gunzip 1714 ms, parse 7034 ms, sort 0 ms, write 0 ms, index 1197 ms: 7 candidates, 110804 repo-hours, 1433 releases; waiting 508 ms; commit 0 ms)
2026-11-08T10:59:09Z [load_day 2025-03-21] 2025-03-21 hour 10: 255826 events in 0 files, snapshot none (task 10451 ms: download 6446 ms overlapping gunzip 1557 ms, parse 6412 ms, sort 0 ms, write 0 ms, index 1369 ms: 3 candidates, 104454 repo-hours, 1434 releases; waiting 522 ms; commit 0 ms)
2026-11-08T10:59:13Z [load_day 2025-03-21] 2025-03-21 hour 11: 247996 events in 0 files, snapshot none (task 9005 ms: download 6226 ms overlapping gunzip 1579 ms, parse 6202 ms, sort 0 ms, write 0 ms, index 742 ms: 12 candidates, 96454 repo-hours, 1190 releases; waiting 191 ms; commit 0 ms)
2026-11-08T10:59:21Z [load_day 2025-03-21] 2025-03-21 hour 12: 289400 events in 0 files, snapshot none (task 11358 ms: download 7171 ms overlapping gunzip 1646 ms, parse 7473 ms, sort 0 ms, write 0 ms, index 1510 ms: 14 candidates, 141524 repo-hours, 1336 releases; waiting 483 ms; commit 0 ms)
2026-11-08T10:59:26Z [load_day 2025-03-21] 2025-03-21 hour 13: 275373 events in 0 files, snapshot none (task 12580 ms: download 7703 ms overlapping gunzip 1951 ms, parse 8430 ms, sort 0 ms, write 0 ms, index 1400 ms: 8 candidates, 124253 repo-hours, 1295 releases; waiting 525 ms; commit 0 ms)
2026-11-08T10:59:34Z [load_day 2025-03-21] 2025-03-21 hour 14: 272283 events in 0 files, snapshot none (task 12332 ms: download 8256 ms overlapping gunzip 1827 ms, parse 7945 ms, sort 0 ms, write 0 ms, index 1754 ms: 9 candidates, 110426 repo-hours, 1359 releases; waiting 499 ms; commit 0 ms)
2026-11-08T10:59:38Z [load_day 2025-03-21] 2025-03-21 hour 15: 273667 events in 0 files, snapshot none (task 10971 ms: download 7590 ms overlapping gunzip 1769 ms, parse 7569 ms, sort 0 ms, write 0 ms, index 1228 ms: 6 candidates, 116403 repo-hours, 1504 releases; waiting 195 ms; commit 0 ms)
2026-11-08T10:59:45Z [load_day 2025-03-21] 2025-03-21 hour 16: 255396 events in 0 files, snapshot none (task 10971 ms: download 7336 ms overlapping gunzip 1678 ms, parse 7341 ms, sort 0 ms, write 0 ms, index 1087 ms: 6 candidates, 106416 repo-hours, 1486 releases; waiting 543 ms; commit 0 ms)
2026-11-08T10:59:48Z [load_day 2025-03-21] 2025-03-21 hour 17: 252921 events in 0 files, snapshot none (task 10077 ms: download 7266 ms overlapping gunzip 1559 ms, parse 6736 ms, sort 0 ms, write 0 ms, index 1095 ms: 10 candidates, 100950 repo-hours, 1176 releases; waiting 475 ms; commit 0 ms)
2026-11-08T10:59:56Z [load_day 2025-03-21] 2025-03-21 hour 18: 257090 events in 0 files, snapshot none (task 9966 ms: download 7196 ms overlapping gunzip 1650 ms, parse 6513 ms, sort 0 ms, write 0 ms, index 844 ms: 6 candidates, 110847 repo-hours, 1216 releases; waiting 606 ms; commit 0 ms)
2026-11-08T10:59:57Z [load_day 2025-03-21] 2025-03-21 hour 19: 231594 events in 0 files, snapshot none (task 8510 ms: download 5794 ms overlapping gunzip 1444 ms, parse 5684 ms, sort 0 ms, write 0 ms, index 714 ms: 10 candidates, 86985 repo-hours, 1154 releases; waiting 411 ms; commit 0 ms)
2026-11-08T11:00:04Z [load_day 2025-03-21] 2025-03-21 hour 20: 216399 events in 0 files, snapshot none (task 7576 ms: download 4697 ms overlapping gunzip 1157 ms, parse 4773 ms, sort 0 ms, write 0 ms, index 855 ms: 12 candidates, 84443 repo-hours, 1073 releases; waiting 500 ms; commit 0 ms)
2026-11-08T11:00:06Z [load_day 2025-03-21] 2025-03-21 hour 21: 219527 events in 0 files, snapshot none (task 8411 ms: download 5994 ms overlapping gunzip 1250 ms, parse 5005 ms, sort 0 ms, write 0 ms, index 719 ms: 7 candidates, 83262 repo-hours, 1144 releases; waiting 1204 ms; commit 0 ms)
2026-11-08T11:00:13Z [load_day 2025-03-21] 2025-03-21 hour 22: 202396 events in 0 files, snapshot none (task 8486 ms: download 5152 ms overlapping gunzip 1319 ms, parse 5051 ms, sort 0 ms, write 0 ms, index 685 ms: 17 candidates, 75695 repo-hours, 1151 releases; waiting 920 ms; commit 0 ms)
2026-11-08T11:00:14Z [load_day 2025-03-21] 2025-03-21 hour 23: 195330 events in 0 files, snapshot none (task 7251 ms: download 4430 ms overlapping gunzip 1202 ms, parse 4664 ms, sort 0 ms, write 0 ms, index 566 ms: 8 candidates, 70257 repo-hours, 1141 releases; waiting 538 ms; commit 0 ms)
2026-11-08T11:00:24Z [load_day 2025-03-21] 2025-03-21: repo_hour merged from 24 files to 1 (2363741 rows, 9661 ms)
2026-11-08T11:00:26Z [load_day 2025-03-21] 2025-03-21: index committed in 12480 ms (24 + 1 + 24 files)
2026-11-08T11:00:26Z [load_day 2025-03-21] 2025-03-21: 5671306 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:00:26Z [load_day 2025-03-21] attempt 1 succeeded