orcaLog in

Runs · run 3583

load_day 2025-02-20, attempt 1 succeeded

Host
73ccef5e07c2:258266
Started
2026-11-08T10:26:18Z
Ended
2026-11-08T10:28:41Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
861 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
211.4 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3583/load_day/2025-02-20/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:26:18Z [load_day 2025-02-20] attempt 1 started
2026-11-08T10:26:19Z [load_day 2025-02-20] 2025-02-20: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:26:29Z [load_day 2025-02-20] 2025-02-20 hour 0: 213585 events in 0 files, snapshot none (task 9360 ms: download 5860 ms overlapping gunzip 1544 ms, parse 6044 ms, sort 0 ms, write 0 ms, index 812 ms: 7 candidates, 103612 repo-hours, 1251 releases; waiting 525 ms; commit 0 ms)
2026-11-08T10:26:29Z [load_day 2025-02-20] 2025-02-20 hour 1: 233604 events in 0 files, snapshot none (task 9078 ms: download 5528 ms overlapping gunzip 1402 ms, parse 5926 ms, sort 0 ms, write 0 ms, index 1144 ms: 9 candidates, 123410 repo-hours, 1225 releases; waiting 270 ms; commit 0 ms)
2026-11-08T10:26:39Z [load_day 2025-02-20] 2025-02-20 hour 2: 209797 events in 0 files, snapshot none (task 9603 ms: download 5904 ms overlapping gunzip 1560 ms, parse 6060 ms, sort 0 ms, write 0 ms, index 976 ms: 9 candidates, 92878 repo-hours, 924 releases; waiting 568 ms; commit 0 ms)
2026-11-08T10:26:39Z [load_day 2025-02-20] 2025-02-20 hour 3: 220667 events in 0 files, snapshot none (task 8396 ms: download 4896 ms overlapping gunzip 1308 ms, parse 5216 ms, sort 0 ms, write 0 ms, index 1050 ms: 11 candidates, 90434 repo-hours, 3847 releases; waiting 526 ms; commit 0 ms)
2026-11-08T10:26:48Z [load_day 2025-02-20] 2025-02-20 hour 4: 208690 events in 0 files, snapshot none (task 8203 ms: download 4608 ms overlapping gunzip 1343 ms, parse 5312 ms, sort 0 ms, write 0 ms, index 773 ms: 9 candidates, 77523 repo-hours, 711 releases; waiting 400 ms; commit 0 ms)
2026-11-08T10:26:49Z [load_day 2025-02-20] 2025-02-20 hour 5: 219289 events in 0 files, snapshot none (task 8614 ms: download 5001 ms overlapping gunzip 1376 ms, parse 5736 ms, sort 0 ms, write 0 ms, index 788 ms: 5 candidates, 81689 repo-hours, 958 releases; waiting 312 ms; commit 0 ms)
2026-11-08T10:26:58Z [load_day 2025-02-20] 2025-02-20 hour 6: 238279 events in 0 files, snapshot none (task 8920 ms: download 6208 ms overlapping gunzip 1430 ms, parse 5831 ms, sort 0 ms, write 0 ms, index 904 ms: 9 candidates, 105410 repo-hours, 1074 releases; waiting 509 ms; commit 0 ms)
2026-11-08T10:26:58Z [load_day 2025-02-20] 2025-02-20 hour 7: 237831 events in 0 files, snapshot none (task 8899 ms: download 5943 ms overlapping gunzip 1396 ms, parse 5710 ms, sort 0 ms, write 0 ms, index 973 ms: 14 candidates, 94376 repo-hours, 950 releases; waiting 495 ms; commit 0 ms)
2026-11-08T10:27:09Z [load_day 2025-02-20] 2025-02-20 hour 8: 250420 events in 0 files, snapshot none (task 10345 ms: download 7704 ms overlapping gunzip 1749 ms, parse 7265 ms, sort 0 ms, write 0 ms, index 779 ms: 18 candidates, 104746 repo-hours, 1240 releases; waiting 260 ms; commit 0 ms)
2026-11-08T10:27:09Z [load_day 2025-02-20] 2025-02-20 hour 9: 254659 events in 0 files, snapshot none (task 10577 ms: download 7535 ms overlapping gunzip 1703 ms, parse 7147 ms, sort 0 ms, write 0 ms, index 917 ms: 7 candidates, 109503 repo-hours, 1314 releases; waiting 495 ms; commit 0 ms)
2026-11-08T10:27:20Z [load_day 2025-02-20] 2025-02-20 hour 10: 250012 events in 0 files, snapshot none (task 11286 ms: download 8468 ms overlapping gunzip 1910 ms, parse 7881 ms, sort 0 ms, write 0 ms, index 750 ms: 6 candidates, 105606 repo-hours, 1332 releases; waiting 489 ms; commit 0 ms)
2026-11-08T10:27:20Z [load_day 2025-02-20] 2025-02-20 hour 11: 248776 events in 0 files, snapshot none (task 10236 ms: download 7268 ms overlapping gunzip 1749 ms, parse 7261 ms, sort 0 ms, write 0 ms, index 727 ms: 7 candidates, 100196 repo-hours, 1236 releases; waiting 170 ms; commit 0 ms)
2026-11-08T10:27:31Z [load_day 2025-02-20] 2025-02-20 hour 12: 287977 events in 0 files, snapshot none (task 10457 ms: download 7346 ms overlapping gunzip 1692 ms, parse 6903 ms, sort 0 ms, write 0 ms, index 1081 ms: 9 candidates, 145432 repo-hours, 1299 releases; waiting 476 ms; commit 0 ms)
2026-11-08T10:27:32Z [load_day 2025-02-20] 2025-02-20 hour 13: 276483 events in 0 files, snapshot none (task 11504 ms: download 8601 ms overlapping gunzip 1901 ms, parse 7781 ms, sort 0 ms, write 0 ms, index 1003 ms: 16 candidates, 128460 repo-hours, 1293 releases; waiting 504 ms; commit 0 ms)
2026-11-08T10:27:44Z [load_day 2025-02-20] 2025-02-20 hour 14: 273644 events in 0 files, snapshot none (task 12542 ms: download 9709 ms overlapping gunzip 1505 ms, parse 6093 ms, sort 0 ms, write 0 ms, index 855 ms: 7 candidates, 116481 repo-hours, 1387 releases; waiting 3680 ms; commit 0 ms)
2026-11-08T10:27:46Z [load_day 2025-02-20] 2025-02-20 hour 15: 280654 events in 0 files, snapshot none (task 13590 ms: download 10868 ms overlapping gunzip 1504 ms, parse 6185 ms, sort 0 ms, write 0 ms, index 891 ms: 10 candidates, 123134 repo-hours, 1583 releases; waiting 4680 ms; commit 0 ms)
2026-11-08T10:27:54Z [load_day 2025-02-20] 2025-02-20 hour 16: 270103 events in 0 files, snapshot none (task 9581 ms: download 6905 ms overlapping gunzip 1354 ms, parse 5559 ms, sort 0 ms, write 0 ms, index 820 ms: 7 candidates, 116179 repo-hours, 1254 releases; waiting 1559 ms; commit 0 ms)
2026-11-08T10:27:55Z [load_day 2025-02-20] 2025-02-20 hour 17: 262043 events in 0 files, snapshot none (task 7858 ms: download 5315 ms overlapping gunzip 1204 ms, parse 4995 ms, sort 0 ms, write 0 ms, index 746 ms: 8 candidates, 106873 repo-hours, 1232 releases; waiting 679 ms; commit 0 ms)
2026-11-08T10:28:08Z [load_day 2025-02-20] 2025-02-20 hour 18: 262386 events in 0 files, snapshot none (task 12909 ms: download 9621 ms overlapping gunzip 1420 ms, parse 6156 ms, sort 0 ms, write 0 ms, index 1275 ms: 8 candidates, 116988 repo-hours, 1328 releases; waiting 3730 ms; commit 0 ms)
2026-11-08T10:28:08Z [load_day 2025-02-20] 2025-02-20 hour 19: 235456 events in 0 files, snapshot none (task 9290 ms: download 6262 ms overlapping gunzip 1486 ms, parse 6207 ms, sort 0 ms, write 0 ms, index 809 ms: 8 candidates, 94974 repo-hours, 1188 releases; waiting 475 ms; commit 0 ms)
2026-11-08T10:28:18Z [load_day 2025-02-20] 2025-02-20 hour 20: 222280 events in 0 files, snapshot none (task 9897 ms: download 6354 ms overlapping gunzip 1551 ms, parse 6653 ms, sort 0 ms, write 0 ms, index 863 ms: 13 candidates, 89715 repo-hours, 1223 releases; waiting 527 ms; commit 0 ms)
2026-11-08T10:28:18Z [load_day 2025-02-20] 2025-02-20 hour 21: 229221 events in 0 files, snapshot none (task 10015 ms: download 6547 ms overlapping gunzip 1716 ms, parse 6944 ms, sort 0 ms, write 0 ms, index 808 ms: 5 candidates, 91802 repo-hours, 1246 releases; waiting 253 ms; commit 0 ms)
2026-11-08T10:28:26Z [load_day 2025-02-20] 2025-02-20 hour 22: 214468 events in 0 files, snapshot none (task 7985 ms: download 4748 ms overlapping gunzip 1349 ms, parse 5518 ms, sort 0 ms, write 0 ms, index 714 ms: 10 candidates, 80990 repo-hours, 1265 releases; waiting 182 ms; commit 0 ms)
2026-11-08T10:28:27Z [load_day 2025-02-20] 2025-02-20 hour 23: 207789 events in 0 files, snapshot none (task 8803 ms: download 7134 ms overlapping gunzip 1399 ms, parse 5498 ms, sort 0 ms, write 0 ms, index 577 ms: 9 candidates, 76365 repo-hours, 1138 releases; waiting 977 ms; commit 0 ms)
2026-11-08T10:28:38Z [load_day 2025-02-20] 2025-02-20: repo_hour merged from 24 files to 1 (2476776 rows, 10782 ms)
2026-11-08T10:28:41Z [load_day 2025-02-20] 2025-02-20: index committed in 13577 ms (24 + 1 + 24 files)
2026-11-08T10:28:41Z [load_day 2025-02-20] 2025-02-20: 5808113 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:28:41Z [load_day 2025-02-20] attempt 1 succeeded