orcaLog in

Runs · run 3522

load_day 2025-02-05, attempt 1 succeeded

Host
73ccef5e07c2:249703
Started
2026-11-08T10:10:41Z
Ended
2026-11-08T10:12:58Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
809 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
208.3 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3522/load_day/2025-02-05/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:10:41Z [load_day 2025-02-05] attempt 1 started
2026-11-08T10:10:42Z [load_day 2025-02-05] 2025-02-05: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:10:52Z [load_day 2025-02-05] 2025-02-05 hour 0: 203826 events in 0 files, snapshot none (task 9370 ms: download 6349 ms overlapping gunzip 1433 ms, parse 6339 ms, sort 0 ms, write 0 ms, index 772 ms: 14 candidates, 99040 repo-hours, 1297 releases; waiting 513 ms; commit 0 ms)
2026-11-08T10:10:52Z [load_day 2025-02-05] 2025-02-05 hour 1: 220286 events in 0 files, snapshot none (task 9109 ms: download 5345 ms overlapping gunzip 1326 ms, parse 5784 ms, sort 0 ms, write 0 ms, index 1196 ms: 3 candidates, 118804 repo-hours, 1146 releases; waiting 533 ms; commit 0 ms)
2026-11-08T10:11:00Z [load_day 2025-02-05] 2025-02-05 hour 2: 191664 events in 0 files, snapshot none (task 7177 ms: download 3544 ms overlapping gunzip 965 ms, parse 4264 ms, sort 0 ms, write 0 ms, index 1036 ms: 5 candidates, 85060 repo-hours, 1145 releases; waiting 570 ms; commit 0 ms)
2026-11-08T10:11:00Z [load_day 2025-02-05] 2025-02-05 hour 3: 206486 events in 0 files, snapshot none (task 7575 ms: download 3693 ms overlapping gunzip 1120 ms, parse 4597 ms, sort 0 ms, write 0 ms, index 1051 ms: 4 candidates, 84113 repo-hours, 4237 releases; waiting 499 ms; commit 0 ms)
2026-11-08T10:11:09Z [load_day 2025-02-05] 2025-02-05 hour 4: 195252 events in 0 files, snapshot none (task 8491 ms: download 5199 ms overlapping gunzip 1212 ms, parse 5178 ms, sort 0 ms, write 0 ms, index 678 ms: 7 candidates, 72717 repo-hours, 847 releases; waiting 1122 ms; commit 0 ms)
2026-11-08T10:11:09Z [load_day 2025-02-05] 2025-02-05 hour 5: 205078 events in 0 files, snapshot none (task 7735 ms: download 4667 ms overlapping gunzip 1132 ms, parse 4814 ms, sort 0 ms, write 0 ms, index 950 ms: 3 candidates, 77616 repo-hours, 1111 releases; waiting 484 ms; commit 0 ms)
2026-11-08T10:11:17Z [load_day 2025-02-05] 2025-02-05 hour 6: 228465 events in 0 files, snapshot none (task 7785 ms: download 5118 ms overlapping gunzip 1175 ms, parse 5064 ms, sort 0 ms, write 0 ms, index 753 ms: 9 candidates, 99016 repo-hours, 1116 releases; waiting 487 ms; commit 0 ms)
2026-11-08T10:11:17Z [load_day 2025-02-05] 2025-02-05 hour 7: 223438 events in 0 files, snapshot none (task 7589 ms: download 5039 ms overlapping gunzip 1179 ms, parse 4928 ms, sort 0 ms, write 0 ms, index 649 ms: 5 candidates, 87108 repo-hours, 1089 releases; waiting 501 ms; commit 0 ms)
2026-11-08T10:11:25Z [load_day 2025-02-05] 2025-02-05 hour 8: 240128 events in 0 files, snapshot none (task 7912 ms: download 5356 ms overlapping gunzip 1239 ms, parse 4988 ms, sort 0 ms, write 0 ms, index 690 ms: 8 candidates, 97695 repo-hours, 1313 releases; waiting 716 ms; commit 0 ms)
2026-11-08T10:11:25Z [load_day 2025-02-05] 2025-02-05 hour 9: 254357 events in 0 files, snapshot none (task 8095 ms: download 5359 ms overlapping gunzip 1230 ms, parse 5220 ms, sort 0 ms, write 0 ms, index 777 ms: 10 candidates, 106830 repo-hours, 1525 releases; waiting 512 ms; commit 0 ms)
2026-11-08T10:11:36Z [load_day 2025-02-05] 2025-02-05 hour 10: 246295 events in 0 files, snapshot none (task 10202 ms: download 6887 ms overlapping gunzip 1658 ms, parse 6763 ms, sort 0 ms, write 0 ms, index 927 ms: 16 candidates, 101123 repo-hours, 1456 releases; waiting 547 ms; commit 0 ms)
2026-11-08T10:11:36Z [load_day 2025-02-05] 2025-02-05 hour 11: 240790 events in 0 files, snapshot none (task 9802 ms: download 6433 ms overlapping gunzip 1568 ms, parse 6523 ms, sort 0 ms, write 0 ms, index 855 ms: 14 candidates, 93915 repo-hours, 1259 releases; waiting 538 ms; commit 0 ms)
2026-11-08T10:11:48Z [load_day 2025-02-05] 2025-02-05 hour 12: 272481 events in 0 files, snapshot none (task 11785 ms: download 8203 ms overlapping gunzip 1886 ms, parse 8081 ms, sort 0 ms, write 0 ms, index 1041 ms: 12 candidates, 136743 repo-hours, 1497 releases; waiting 497 ms; commit 0 ms)
2026-11-08T10:11:48Z [load_day 2025-02-05] 2025-02-05 hour 13: 269338 events in 0 files, snapshot none (task 11936 ms: download 8628 ms overlapping gunzip 1986 ms, parse 8214 ms, sort 0 ms, write 0 ms, index 890 ms: 13 candidates, 121561 repo-hours, 1446 releases; waiting 547 ms; commit 0 ms)
2026-11-08T10:12:01Z [load_day 2025-02-05] 2025-02-05 hour 14: 261076 events in 0 files, snapshot none (task 11718 ms: download 8214 ms overlapping gunzip 1847 ms, parse 8118 ms, sort 0 ms, write 0 ms, index 1066 ms: 8 candidates, 107223 repo-hours, 1581 releases; waiting 485 ms; commit 0 ms)
2026-11-08T10:12:01Z [load_day 2025-02-05] 2025-02-05 hour 15: 265522 events in 0 files, snapshot none (task 11947 ms: download 8642 ms overlapping gunzip 1944 ms, parse 8157 ms, sort 0 ms, write 0 ms, index 929 ms: 9 candidates, 114300 repo-hours, 1671 releases; waiting 532 ms; commit 0 ms)
2026-11-08T10:12:13Z [load_day 2025-02-05] 2025-02-05 hour 16: 260438 events in 0 files, snapshot none (task 12315 ms: download 9140 ms overlapping gunzip 1956 ms, parse 8358 ms, sort 0 ms, write 0 ms, index 872 ms: 10 candidates, 110315 repo-hours, 1519 releases; waiting 756 ms; commit 0 ms)
2026-11-08T10:12:13Z [load_day 2025-02-05] 2025-02-05 hour 17: 252431 events in 0 files, snapshot none (task 11239 ms: download 7458 ms overlapping gunzip 1902 ms, parse 7901 ms, sort 0 ms, write 0 ms, index 925 ms: 6 candidates, 100618 repo-hours, 1400 releases; waiting 235 ms; commit 0 ms)
2026-11-08T10:12:25Z [load_day 2025-02-05] 2025-02-05 hour 18: 255748 events in 0 files, snapshot none (task 10589 ms: download 7652 ms overlapping gunzip 1532 ms, parse 7350 ms, sort 0 ms, write 0 ms, index 929 ms: 5 candidates, 113978 repo-hours, 1472 releases; waiting 483 ms; commit 0 ms)
2026-11-08T10:12:25Z [load_day 2025-02-05] 2025-02-05 hour 19: 231411 events in 0 files, snapshot none (task 9362 ms: download 6442 ms overlapping gunzip 1503 ms, parse 6581 ms, sort 0 ms, write 0 ms, index 658 ms: 11 candidates, 92178 repo-hours, 1459 releases; waiting 310 ms; commit 0 ms)
2026-11-08T10:12:35Z [load_day 2025-02-05] 2025-02-05 hour 20: 226766 events in 0 files, snapshot none (task 9552 ms: download 6855 ms overlapping gunzip 1492 ms, parse 6552 ms, sort 0 ms, write 0 ms, index 668 ms: 5 candidates, 90937 repo-hours, 1359 releases; waiting 543 ms; commit 0 ms)
2026-11-08T10:12:35Z [load_day 2025-02-05] 2025-02-05 hour 21: 222951 events in 0 files, snapshot none (task 9494 ms: download 7045 ms overlapping gunzip 1451 ms, parse 6622 ms, sort 0 ms, write 0 ms, index 631 ms: 3 candidates, 88193 repo-hours, 1500 releases; waiting 464 ms; commit 0 ms)
2026-11-08T10:12:45Z [load_day 2025-02-05] 2025-02-05 hour 22: 203532 events in 0 files, snapshot none (task 9458 ms: download 6390 ms overlapping gunzip 1500 ms, parse 6497 ms, sort 0 ms, write 0 ms, index 728 ms: 6 candidates, 78160 repo-hours, 1502 releases; waiting 490 ms; commit 0 ms)
2026-11-08T10:12:45Z [load_day 2025-02-05] 2025-02-05 hour 23: 187984 events in 0 files, snapshot none (task 9204 ms: download 5844 ms overlapping gunzip 1457 ms, parse 6191 ms, sort 0 ms, write 0 ms, index 668 ms: 8 candidates, 70866 repo-hours, 1295 releases; waiting 505 ms; commit 0 ms)
2026-11-08T10:12:55Z [load_day 2025-02-05] 2025-02-05: repo_hour merged from 24 files to 1 (2348109 rows, 10829 ms)
2026-11-08T10:12:58Z [load_day 2025-02-05] 2025-02-05: index committed in 13775 ms (24 + 1 + 24 files)
2026-11-08T10:12:58Z [load_day 2025-02-05] 2025-02-05: 5565743 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:12:58Z [load_day 2025-02-05] attempt 1 succeeded