orcaLog in

Runs · run 3637

load_day 2025-03-06, attempt 1 succeeded

Host
73ccef5e07c2:265924
Started
2026-11-08T10:41:15Z
Ended
2026-11-08T10:43:30Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
863 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
206.3 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3637/load_day/2025-03-06/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:41:15Z [load_day 2025-03-06] attempt 1 started
2026-11-08T10:41:16Z [load_day 2025-03-06] 2025-03-06: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:41:24Z [load_day 2025-03-06] 2025-03-06 hour 0: 215151 events in 0 files, snapshot none (task 7871 ms: download 5029 ms overlapping gunzip 1227 ms, parse 5165 ms, sort 0 ms, write 0 ms, index 715 ms: 5 candidates, 95066 repo-hours, 1214 releases; waiting 488 ms; commit 0 ms)
2026-11-08T10:41:24Z [load_day 2025-03-06] 2025-03-06 hour 1: 230315 events in 0 files, snapshot none (task 7583 ms: download 4571 ms overlapping gunzip 1093 ms, parse 4737 ms, sort 0 ms, write 0 ms, index 1025 ms: 3 candidates, 121593 repo-hours, 1064 releases; waiting 458 ms; commit 0 ms)
2026-11-08T10:41:32Z [load_day 2025-03-06] 2025-03-06 hour 2: 208487 events in 0 files, snapshot none (task 7525 ms: download 4370 ms overlapping gunzip 1192 ms, parse 4635 ms, sort 0 ms, write 0 ms, index 845 ms: 7 candidates, 90154 repo-hours, 972 releases; waiting 482 ms; commit 0 ms)
2026-11-08T10:41:37Z [load_day 2025-03-06] 2025-03-06 hour 3: 226182 events in 0 files, snapshot none (task 11874 ms: download 7866 ms overlapping gunzip 1302 ms, parse 5835 ms, sort 0 ms, write 0 ms, index 1124 ms: 5 candidates, 92350 repo-hours, 3868 releases; waiting 3344 ms; commit 0 ms)
2026-11-08T10:41:42Z [load_day 2025-03-06] 2025-03-06 hour 4: 209785 events in 0 files, snapshot none (task 9334 ms: download 5058 ms overlapping gunzip 1452 ms, parse 5967 ms, sort 0 ms, write 0 ms, index 1167 ms: 11 candidates, 78750 repo-hours, 698 releases; waiting 524 ms; commit 0 ms)
2026-11-08T10:41:46Z [load_day 2025-03-06] 2025-03-06 hour 5: 215386 events in 0 files, snapshot none (task 8790 ms: download 5540 ms overlapping gunzip 1392 ms, parse 5797 ms, sort 0 ms, write 0 ms, index 799 ms: 4 candidates, 83324 repo-hours, 829 releases; waiting 502 ms; commit 0 ms)
2026-11-08T10:41:52Z [load_day 2025-03-06] 2025-03-06 hour 6: 237828 events in 0 files, snapshot none (task 8867 ms: download 5022 ms overlapping gunzip 1352 ms, parse 5660 ms, sort 0 ms, write 0 ms, index 1155 ms: 4 candidates, 103016 repo-hours, 997 releases; waiting 472 ms; commit 0 ms)
2026-11-08T10:41:57Z [load_day 2025-03-06] 2025-03-06 hour 7: 234191 events in 0 files, snapshot none (task 10145 ms: download 6960 ms overlapping gunzip 1600 ms, parse 6996 ms, sort 0 ms, write 0 ms, index 792 ms: 9 candidates, 94294 repo-hours, 932 releases; waiting 479 ms; commit 0 ms)
2026-11-08T10:42:01Z [load_day 2025-03-06] 2025-03-06 hour 8: 246782 events in 0 files, snapshot none (task 8874 ms: download 5250 ms overlapping gunzip 1344 ms, parse 5644 ms, sort 0 ms, write 0 ms, index 1135 ms: 6 candidates, 103368 repo-hours, 1214 releases; waiting 493 ms; commit 0 ms)
2026-11-08T10:42:08Z [load_day 2025-03-06] 2025-03-06 hour 9: 258668 events in 0 files, snapshot none (task 10914 ms: download 8049 ms overlapping gunzip 1727 ms, parse 7085 ms, sort 0 ms, write 0 ms, index 802 ms: 5 candidates, 110571 repo-hours, 1373 releases; waiting 1056 ms; commit 0 ms)
2026-11-08T10:42:11Z [load_day 2025-03-06] 2025-03-06 hour 10: 254149 events in 0 files, snapshot none (task 9658 ms: download 6321 ms overlapping gunzip 1470 ms, parse 6289 ms, sort 0 ms, write 0 ms, index 1194 ms: 16 candidates, 104742 repo-hours, 1215 releases; waiting 361 ms; commit 0 ms)
2026-11-08T10:42:19Z [load_day 2025-03-06] 2025-03-06 hour 11: 253765 events in 0 files, snapshot none (task 9856 ms: download 6946 ms overlapping gunzip 1513 ms, parse 6667 ms, sort 0 ms, write 0 ms, index 837 ms: 9 candidates, 98989 repo-hours, 1293 releases; waiting 522 ms; commit 0 ms)
2026-11-08T10:42:20Z [load_day 2025-03-06] 2025-03-06 hour 12: 282685 events in 0 files, snapshot none (task 8778 ms: download 5535 ms overlapping gunzip 1338 ms, parse 5742 ms, sort 0 ms, write 0 ms, index 1175 ms: 13 candidates, 139772 repo-hours, 1439 releases; waiting 178 ms; commit 0 ms)
2026-11-08T10:42:29Z [load_day 2025-03-06] 2025-03-06 hour 13: 274039 events in 0 files, snapshot none (task 9594 ms: download 6939 ms overlapping gunzip 1476 ms, parse 6506 ms, sort 0 ms, write 0 ms, index 860 ms: 9 candidates, 124961 repo-hours, 1280 releases; waiting 494 ms; commit 0 ms)
2026-11-08T10:42:31Z [load_day 2025-03-06] 2025-03-06 hour 14: 274939 events in 0 files, snapshot none (task 9567 ms: download 6861 ms overlapping gunzip 1475 ms, parse 6431 ms, sort 0 ms, write 0 ms, index 836 ms: 11 candidates, 113703 repo-hours, 1433 releases; waiting 535 ms; commit 0 ms)
2026-11-08T10:42:38Z [load_day 2025-03-06] 2025-03-06 hour 15: 276502 events in 0 files, snapshot none (task 8632 ms: download 6030 ms overlapping gunzip 1326 ms, parse 5651 ms, sort 0 ms, write 0 ms, index 844 ms: 10 candidates, 120799 repo-hours, 1483 releases; waiting 535 ms; commit 0 ms)
2026-11-08T10:42:40Z [load_day 2025-03-06] 2025-03-06 hour 16: 268020 events in 0 files, snapshot none (task 8529 ms: download 5817 ms overlapping gunzip 1348 ms, parse 5494 ms, sort 0 ms, write 0 ms, index 877 ms: 11 candidates, 112447 repo-hours, 1310 releases; waiting 512 ms; commit 0 ms)
2026-11-08T10:42:49Z [load_day 2025-03-06] 2025-03-06 hour 17: 260346 events in 0 files, snapshot none (task 10248 ms: download 7003 ms overlapping gunzip 1625 ms, parse 6982 ms, sort 0 ms, write 0 ms, index 848 ms: 10 candidates, 104875 repo-hours, 1318 releases; waiting 572 ms; commit 0 ms)
2026-11-08T10:42:51Z [load_day 2025-03-06] 2025-03-06 hour 18: 258631 events in 0 files, snapshot none (task 10290 ms: download 7320 ms overlapping gunzip 1702 ms, parse 6912 ms, sort 0 ms, write 0 ms, index 922 ms: 6 candidates, 114101 repo-hours, 1264 releases; waiting 483 ms; commit 0 ms)
2026-11-08T10:42:59Z [load_day 2025-03-06] 2025-03-06 hour 19: 245021 events in 0 files, snapshot none (task 9702 ms: download 6813 ms overlapping gunzip 1495 ms, parse 6703 ms, sort 0 ms, write 0 ms, index 759 ms: 10 candidates, 93508 repo-hours, 1254 releases; waiting 508 ms; commit 0 ms)
2026-11-08T10:43:01Z [load_day 2025-03-06] 2025-03-06 hour 20: 233704 events in 0 files, snapshot none (task 9520 ms: download 6676 ms overlapping gunzip 1458 ms, parse 6621 ms, sort 0 ms, write 0 ms, index 767 ms: 5 candidates, 91907 repo-hours, 1208 releases; waiting 373 ms; commit 0 ms)
2026-11-08T10:43:09Z [load_day 2025-03-06] 2025-03-06 hour 21: 235719 events in 0 files, snapshot none (task 9447 ms: download 6554 ms overlapping gunzip 1560 ms, parse 6546 ms, sort 0 ms, write 0 ms, index 765 ms: 7 candidates, 91922 repo-hours, 1329 releases; waiting 312 ms; commit 0 ms)
2026-11-08T10:43:10Z [load_day 2025-03-06] 2025-03-06 hour 22: 221637 events in 0 files, snapshot none (task 8839 ms: download 6050 ms overlapping gunzip 1421 ms, parse 5983 ms, sort 0 ms, write 0 ms, index 680 ms: 9 candidates, 83033 repo-hours, 1380 releases; waiting 486 ms; commit 0 ms)
2026-11-08T10:43:17Z [load_day 2025-03-06] 2025-03-06 hour 23: 217702 events in 0 files, snapshot none (task 7005 ms: download 4392 ms overlapping gunzip 1078 ms, parse 4434 ms, sort 0 ms, write 0 ms, index 599 ms: 5 candidates, 78422 repo-hours, 1030 releases; waiting 500 ms; commit 0 ms)
2026-11-08T10:43:27Z [load_day 2025-03-06] 2025-03-06: repo_hour merged from 24 files to 1 (2445667 rows, 10684 ms)
2026-11-08T10:43:30Z [load_day 2025-03-06] 2025-03-06: index committed in 13104 ms (24 + 1 + 24 files)
2026-11-08T10:43:30Z [load_day 2025-03-06] 2025-03-06: 5839634 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:43:30Z [load_day 2025-03-06] attempt 1 succeeded