orcaLog in

Runs · run 3572

load_day 2025-02-17, attempt 1 succeeded

Host
73ccef5e07c2:256716
Started
2026-11-08T10:23:10Z
Ended
2026-11-08T10:25:37Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
1077 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
226.0 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3572/load_day/2025-02-17/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:23:10Z [load_day 2025-02-17] attempt 1 started
2026-11-08T10:23:11Z [load_day 2025-02-17] 2025-02-17: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:23:22Z [load_day 2025-02-17] 2025-02-17 hour 0: 198519 events in 0 files, snapshot none (task 9563 ms: download 4421 ms overlapping gunzip 1240 ms, parse 4663 ms, sort 0 ms, write 0 ms, index 2960 ms: 10 candidates, 92956 repo-hours, 1189 releases; waiting 480 ms; commit 0 ms)
2026-11-08T10:23:22Z [load_day 2025-02-17] 2025-02-17 hour 1: 227373 events in 0 files, snapshot none (task 8843 ms: download 5354 ms overlapping gunzip 1345 ms, parse 5182 ms, sort 0 ms, write 0 ms, index 1547 ms: 4 candidates, 119685 repo-hours, 1003 releases; waiting 492 ms; commit 0 ms)
2026-11-08T10:23:31Z [load_day 2025-02-17] 2025-02-17 hour 2: 203841 events in 0 files, snapshot none (task 9129 ms: download 6479 ms overlapping gunzip 1472 ms, parse 5977 ms, sort 0 ms, write 0 ms, index 732 ms: 6 candidates, 88101 repo-hours, 836 releases; waiting 518 ms; commit 0 ms)
2026-11-08T10:23:31Z [load_day 2025-02-17] 2025-02-17 hour 3: 219701 events in 0 files, snapshot none (task 8703 ms: download 6191 ms overlapping gunzip 1472 ms, parse 5693 ms, sort 0 ms, write 0 ms, index 659 ms: 8 candidates, 88110 repo-hours, 3822 releases; waiting 520 ms; commit 0 ms)
2026-11-08T10:23:40Z [load_day 2025-02-17] 2025-02-17 hour 4: 200540 events in 0 files, snapshot none (task 8131 ms: download 5751 ms overlapping gunzip 1324 ms, parse 5443 ms, sort 0 ms, write 0 ms, index 624 ms: 6 candidates, 74940 repo-hours, 798 releases; waiting 493 ms; commit 0 ms)
2026-11-08T10:23:41Z [load_day 2025-02-17] 2025-02-17 hour 5: 212808 events in 0 files, snapshot none (task 8648 ms: download 6177 ms overlapping gunzip 1502 ms, parse 5827 ms, sort 0 ms, write 0 ms, index 773 ms: 5 candidates, 79866 repo-hours, 774 releases; waiting 331 ms; commit 0 ms)
2026-11-08T10:23:50Z [load_day 2025-02-17] 2025-02-17 hour 6: 237198 events in 0 files, snapshot none (task 9472 ms: download 6118 ms overlapping gunzip 1519 ms, parse 6002 ms, sort 0 ms, write 0 ms, index 1096 ms: 14 candidates, 101614 repo-hours, 1119 releases; waiting 525 ms; commit 0 ms)
2026-11-08T10:23:51Z [load_day 2025-02-17] 2025-02-17 hour 7: 238900 events in 0 files, snapshot none (task 9666 ms: download 6149 ms overlapping gunzip 1656 ms, parse 6456 ms, sort 0 ms, write 0 ms, index 914 ms: 9 candidates, 91984 repo-hours, 967 releases; waiting 315 ms; commit 0 ms)
2026-11-08T10:23:59Z [load_day 2025-02-17] 2025-02-17 hour 8: 254243 events in 0 files, snapshot none (task 8541 ms: download 5769 ms overlapping gunzip 1404 ms, parse 5536 ms, sort 0 ms, write 0 ms, index 792 ms: 9 candidates, 102445 repo-hours, 1315 releases; waiting 492 ms; commit 0 ms)
2026-11-08T10:24:00Z [load_day 2025-02-17] 2025-02-17 hour 9: 266257 events in 0 files, snapshot none (task 8972 ms: download 6355 ms overlapping gunzip 1461 ms, parse 5798 ms, sort 0 ms, write 0 ms, index 846 ms: 5 candidates, 110849 repo-hours, 1521 releases; waiting 593 ms; commit 0 ms)
2026-11-08T10:24:09Z [load_day 2025-02-17] 2025-02-17 hour 10: 258518 events in 0 files, snapshot none (task 9285 ms: download 5849 ms overlapping gunzip 1421 ms, parse 5541 ms, sort 0 ms, write 0 ms, index 1491 ms: 9 candidates, 104748 repo-hours, 1378 releases; waiting 530 ms; commit 0 ms)
2026-11-08T10:24:10Z [load_day 2025-02-17] 2025-02-17 hour 11: 255539 events in 0 files, snapshot none (task 9498 ms: download 6025 ms overlapping gunzip 1640 ms, parse 6181 ms, sort 0 ms, write 0 ms, index 1043 ms: 11 candidates, 99310 repo-hours, 1347 releases; waiting 335 ms; commit 0 ms)
2026-11-08T10:24:22Z [load_day 2025-02-17] 2025-02-17 hour 12: 289979 events in 0 files, snapshot none (task 12102 ms: download 8174 ms overlapping gunzip 1993 ms, parse 7899 ms, sort 0 ms, write 0 ms, index 1234 ms: 10 candidates, 143047 repo-hours, 1453 releases; waiting 639 ms; commit 0 ms)
2026-11-08T10:24:22Z [load_day 2025-02-17] 2025-02-17 hour 13: 276573 events in 0 files, snapshot none (task 11286 ms: download 8456 ms overlapping gunzip 1876 ms, parse 7771 ms, sort 0 ms, write 0 ms, index 888 ms: 9 candidates, 125042 repo-hours, 1322 releases; waiting 444 ms; commit 0 ms)
2026-11-08T10:24:37Z [load_day 2025-02-17] 2025-02-17 hour 14: 273605 events in 0 files, snapshot none (task 14668 ms: download 11224 ms overlapping gunzip 2424 ms, parse 10417 ms, sort 0 ms, write 0 ms, index 1102 ms: 10 candidates, 112864 repo-hours, 1498 releases; waiting 494 ms; commit 0 ms)
2026-11-08T10:24:37Z [load_day 2025-02-17] 2025-02-17 hour 15: 284358 events in 0 files, snapshot none (task 14607 ms: download 10730 ms overlapping gunzip 2514 ms, parse 10154 ms, sort 0 ms, write 0 ms, index 1119 ms: 13 candidates, 118845 repo-hours, 1585 releases; waiting 494 ms; commit 0 ms)
2026-11-08T10:24:50Z [load_day 2025-02-17] 2025-02-17 hour 16: 275409 events in 0 files, snapshot none (task 12925 ms: download 8884 ms overlapping gunzip 2142 ms, parse 8994 ms, sort 0 ms, write 0 ms, index 1224 ms: 9 candidates, 112161 repo-hours, 1438 releases; waiting 254 ms; commit 0 ms)
2026-11-08T10:24:50Z [load_day 2025-02-17] 2025-02-17 hour 17: 263332 events in 0 files, snapshot none (task 11495 ms: download 7544 ms overlapping gunzip 1878 ms, parse 7626 ms, sort 0 ms, write 0 ms, index 1447 ms: 9 candidates, 102883 repo-hours, 1248 releases; waiting 183 ms; commit 0 ms)
2026-11-08T10:25:03Z [load_day 2025-02-17] 2025-02-17 hour 18: 269440 events in 0 files, snapshot none (task 11943 ms: download 8984 ms overlapping gunzip 2060 ms, parse 8199 ms, sort 0 ms, write 0 ms, index 814 ms: 8 candidates, 114601 repo-hours, 1371 releases; waiting 531 ms; commit 0 ms)
2026-11-08T10:25:03Z [load_day 2025-02-17] 2025-02-17 hour 19: 248036 events in 0 files, snapshot none (task 11025 ms: download 7919 ms overlapping gunzip 1810 ms, parse 7476 ms, sort 0 ms, write 0 ms, index 799 ms: 8 candidates, 92336 repo-hours, 1101 releases; waiting 543 ms; commit 0 ms)
2026-11-08T10:25:13Z [load_day 2025-02-17] 2025-02-17 hour 20: 240152 events in 0 files, snapshot none (task 9918 ms: download 6976 ms overlapping gunzip 1667 ms, parse 6559 ms, sort 0 ms, write 0 ms, index 847 ms: 10 candidates, 90371 repo-hours, 1085 releases; waiting 565 ms; commit 0 ms)
2026-11-08T10:25:13Z [load_day 2025-02-17] 2025-02-17 hour 21: 230307 events in 0 files, snapshot none (task 8616 ms: download 5306 ms overlapping gunzip 1436 ms, parse 5625 ms, sort 0 ms, write 0 ms, index 1018 ms: 5 candidates, 89298 repo-hours, 1222 releases; waiting 307 ms; commit 0 ms)
2026-11-08T10:25:24Z [load_day 2025-02-17] 2025-02-17 hour 22: 216469 events in 0 files, snapshot none (task 9228 ms: download 6378 ms overlapping gunzip 1523 ms, parse 5878 ms, sort 0 ms, write 0 ms, index 680 ms: 11 candidates, 80986 repo-hours, 1191 releases; waiting 785 ms; commit 0 ms)
2026-11-08T10:25:24Z [load_day 2025-02-17] 2025-02-17 hour 23: 204326 events in 0 files, snapshot none (task 7765 ms: download 4646 ms overlapping gunzip 1246 ms, parse 4771 ms, sort 0 ms, write 0 ms, index 717 ms: 13 candidates, 73841 repo-hours, 1063 releases; waiting 519 ms; commit 0 ms)
2026-11-08T10:25:34Z [load_day 2025-02-17] 2025-02-17: repo_hour merged from 24 files to 1 (2410883 rows, 10798 ms)
2026-11-08T10:25:37Z [load_day 2025-02-17] 2025-02-17: index committed in 13407 ms (24 + 1 + 24 files)
2026-11-08T10:25:37Z [load_day 2025-02-17] 2025-02-17: 5845423 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:25:37Z [load_day 2025-02-17] attempt 1 succeeded