orcaLog in

Runs · run 3691

load_day 2025-03-20, attempt 1 succeeded

Host
73ccef5e07c2:273656
Started
2026-11-08T10:56:27Z
Ended
2026-11-08T10:58:42Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
940 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
212.9 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3691/load_day/2025-03-20/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:56:27Z [load_day 2025-03-20] attempt 1 started
2026-11-08T10:56:27Z [load_day 2025-03-20] 2025-03-20: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:56:36Z [load_day 2025-03-20] 2025-03-20 hour 0: 212435 events in 0 files, snapshot none (task 8060 ms: download 4513 ms overlapping gunzip 1240 ms, parse 5130 ms, sort 0 ms, write 0 ms, index 794 ms: 8 candidates, 99378 repo-hours, 1338 releases; waiting 665 ms; commit 0 ms)
2026-11-08T10:56:36Z [load_day 2025-03-20] 2025-03-20 hour 1: 237774 events in 0 files, snapshot none (task 8543 ms: download 4916 ms overlapping gunzip 1202 ms, parse 5407 ms, sort 0 ms, write 0 ms, index 1063 ms: 6 candidates, 126240 repo-hours, 975 releases; waiting 495 ms; commit 0 ms)
2026-11-08T10:56:45Z [load_day 2025-03-20] 2025-03-20 hour 2: 208058 events in 0 files, snapshot none (task 7966 ms: download 5389 ms overlapping gunzip 1283 ms, parse 5192 ms, sort 0 ms, write 0 ms, index 655 ms: 5 candidates, 91255 repo-hours, 939 releases; waiting 524 ms; commit 0 ms)
2026-11-08T10:56:45Z [load_day 2025-03-20] 2025-03-20 hour 3: 218328 events in 0 files, snapshot none (task 7423 ms: download 4688 ms overlapping gunzip 1131 ms, parse 4803 ms, sort 0 ms, write 0 ms, index 693 ms: 1 candidates, 90921 repo-hours, 3405 releases; waiting 497 ms; commit 0 ms)
2026-11-08T10:56:53Z [load_day 2025-03-20] 2025-03-20 hour 4: 200372 events in 0 files, snapshot none (task 7716 ms: download 4303 ms overlapping gunzip 1101 ms, parse 4930 ms, sort 0 ms, write 0 ms, index 806 ms: 3 candidates, 75595 repo-hours, 819 releases; waiting 483 ms; commit 0 ms)
2026-11-08T10:56:53Z [load_day 2025-03-20] 2025-03-20 hour 5: 209060 events in 0 files, snapshot none (task 7589 ms: download 4745 ms overlapping gunzip 1108 ms, parse 4546 ms, sort 0 ms, write 0 ms, index 954 ms: 3 candidates, 80933 repo-hours, 856 releases; waiting 675 ms; commit 0 ms)
2026-11-08T10:57:03Z [load_day 2025-03-20] 2025-03-20 hour 6: 239716 events in 0 files, snapshot none (task 9514 ms: download 6155 ms overlapping gunzip 1410 ms, parse 6097 ms, sort 0 ms, write 0 ms, index 1031 ms: 3 candidates, 104417 repo-hours, 1064 releases; waiting 501 ms; commit 0 ms)
2026-11-08T10:57:03Z [load_day 2025-03-20] 2025-03-20 hour 7: 240795 events in 0 files, snapshot none (task 9089 ms: download 5662 ms overlapping gunzip 1346 ms, parse 5725 ms, sort 0 ms, write 0 ms, index 1218 ms: 5 candidates, 94615 repo-hours, 939 releases; waiting 518 ms; commit 0 ms)
2026-11-08T10:57:16Z [load_day 2025-03-20] 2025-03-20 hour 8: 258390 events in 0 files, snapshot none (task 12520 ms: download 9253 ms overlapping gunzip 2110 ms, parse 8443 ms, sort 0 ms, write 0 ms, index 1175 ms: 7 candidates, 106094 repo-hours, 1224 releases; waiting 562 ms; commit 0 ms)
2026-11-08T10:57:16Z [load_day 2025-03-20] 2025-03-20 hour 9: 266914 events in 0 files, snapshot none (task 12905 ms: download 9308 ms overlapping gunzip 2079 ms, parse 8915 ms, sort 0 ms, write 0 ms, index 1354 ms: 5 candidates, 114501 repo-hours, 1535 releases; waiting 259 ms; commit 0 ms)
2026-11-08T10:57:27Z [load_day 2025-03-20] 2025-03-20 hour 10: 259887 events in 0 files, snapshot none (task 10761 ms: download 7462 ms overlapping gunzip 1755 ms, parse 7304 ms, sort 0 ms, write 0 ms, index 1000 ms: 9 candidates, 108952 repo-hours, 1341 releases; waiting 463 ms; commit 0 ms)
2026-11-08T10:57:28Z [load_day 2025-03-20] 2025-03-20 hour 11: 255054 events in 0 files, snapshot none (task 11307 ms: download 8121 ms overlapping gunzip 1765 ms, parse 7954 ms, sort 0 ms, write 0 ms, index 726 ms: 13 candidates, 103291 repo-hours, 1262 releases; waiting 528 ms; commit 0 ms)
2026-11-08T10:57:40Z [load_day 2025-03-20] 2025-03-20 hour 12: 284981 events in 0 files, snapshot none (task 12211 ms: download 8685 ms overlapping gunzip 1883 ms, parse 8231 ms, sort 0 ms, write 0 ms, index 1236 ms: 11 candidates, 144003 repo-hours, 1391 releases; waiting 495 ms; commit 0 ms)
2026-11-08T10:57:40Z [load_day 2025-03-20] 2025-03-20 hour 13: 276395 events in 0 files, snapshot none (task 11983 ms: download 9112 ms overlapping gunzip 1975 ms, parse 8462 ms, sort 0 ms, write 0 ms, index 905 ms: 9 candidates, 129404 repo-hours, 1299 releases; waiting 351 ms; commit 0 ms)
2026-11-08T10:57:52Z [load_day 2025-03-20] 2025-03-20 hour 14: 275691 events in 0 files, snapshot none (task 11374 ms: download 8550 ms overlapping gunzip 1867 ms, parse 7989 ms, sort 0 ms, write 0 ms, index 869 ms: 17 candidates, 119358 repo-hours, 1477 releases; waiting 350 ms; commit 0 ms)
2026-11-08T10:57:53Z [load_day 2025-03-20] 2025-03-20 hour 15: 284599 events in 0 files, snapshot none (task 11870 ms: download 9035 ms overlapping gunzip 1837 ms, parse 8230 ms, sort 0 ms, write 0 ms, index 1038 ms: 18 candidates, 123949 repo-hours, 1524 releases; waiting 459 ms; commit 0 ms)
2026-11-08T10:58:01Z [load_day 2025-03-20] 2025-03-20 hour 16: 274734 events in 0 files, snapshot none (task 8792 ms: download 6010 ms overlapping gunzip 1476 ms, parse 5915 ms, sort 0 ms, write 0 ms, index 873 ms: 11 candidates, 116079 repo-hours, 1307 releases; waiting 179 ms; commit 0 ms)
2026-11-08T10:58:03Z [load_day 2025-03-20] 2025-03-20 hour 17: 265532 events in 0 files, snapshot none (task 9400 ms: download 6815 ms overlapping gunzip 1494 ms, parse 6333 ms, sort 0 ms, write 0 ms, index 765 ms: 14 candidates, 105640 repo-hours, 1140 releases; waiting 517 ms; commit 0 ms)
2026-11-08T10:58:10Z [load_day 2025-03-20] 2025-03-20 hour 18: 259880 events in 0 files, snapshot none (task 8077 ms: download 5310 ms overlapping gunzip 1193 ms, parse 5061 ms, sort 0 ms, write 0 ms, index 836 ms: 12 candidates, 115127 repo-hours, 1379 releases; waiting 642 ms; commit 0 ms)
2026-11-08T10:58:11Z [load_day 2025-03-20] 2025-03-20 hour 19: 238889 events in 0 files, snapshot none (task 7538 ms: download 5034 ms overlapping gunzip 1185 ms, parse 4909 ms, sort 0 ms, write 0 ms, index 681 ms: 7 candidates, 92587 repo-hours, 1133 releases; waiting 483 ms; commit 0 ms)
2026-11-08T10:58:18Z [load_day 2025-03-20] 2025-03-20 hour 20: 226505 events in 0 files, snapshot none (task 7629 ms: download 4981 ms overlapping gunzip 1144 ms, parse 4776 ms, sort 0 ms, write 0 ms, index 709 ms: 9 candidates, 91273 repo-hours, 1245 releases; waiting 645 ms; commit 0 ms)
2026-11-08T10:58:18Z [load_day 2025-03-20] 2025-03-20 hour 21: 220349 events in 0 files, snapshot none (task 6990 ms: download 4656 ms overlapping gunzip 1087 ms, parse 4289 ms, sort 0 ms, write 0 ms, index 671 ms: 15 candidates, 87182 repo-hours, 1145 releases; waiting 672 ms; commit 0 ms)
2026-11-08T10:58:27Z [load_day 2025-03-20] 2025-03-20 hour 22: 214288 events in 0 files, snapshot none (task 9009 ms: download 6244 ms overlapping gunzip 1499 ms, parse 6109 ms, sort 0 ms, write 0 ms, index 582 ms: 13 candidates, 79032 repo-hours, 1316 releases; waiting 577 ms; commit 0 ms)
2026-11-08T10:58:27Z [load_day 2025-03-20] 2025-03-20 hour 23: 202008 events in 0 files, snapshot none (task 8613 ms: download 5714 ms overlapping gunzip 1427 ms, parse 5884 ms, sort 0 ms, write 0 ms, index 844 ms: 8 candidates, 73983 repo-hours, 1132 releases; waiting 194 ms; commit 0 ms)
2026-11-08T10:58:39Z [load_day 2025-03-20] 2025-03-20: repo_hour merged from 24 files to 1 (2473809 rows, 11463 ms)
2026-11-08T10:58:42Z [load_day 2025-03-20] 2025-03-20: index committed in 14448 ms (24 + 1 + 24 files)
2026-11-08T10:58:42Z [load_day 2025-03-20] 2025-03-20: 5830634 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:58:42Z [load_day 2025-03-20] attempt 1 succeeded