orcaLog in

Runs · run 693

load_day 2026-04-01, attempt 1 succeeded

Host
4e84322b8c45:171099
Started
2026-11-07T13:15:45Z
Ended
2026-11-07T13:17:24Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/693/load_day/2026-04-01/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T13:15:45Z [load_day 2026-04-01] attempt 1 started
2026-11-07T13:15:55Z [load_day 2026-04-01] 2026-04-01 hour 0: 153082 events in 4 files, snapshot 4560269755426370287 (task 6796 ms: download 2929 ms overlapping gunzip 476 ms, parse 1532 ms, sort 174 ms, write 2949 ms, index 498 ms: 12 candidates, 76050 repo-hours, 772 releases; waiting 783 ms; commit 1345 ms)
2026-11-07T13:16:00Z [load_day 2026-04-01] 2026-04-01 hour 1: 157106 events in 4 files, snapshot 8349729125849257498 (task 5579 ms: download 1252 ms overlapping gunzip 366 ms, parse 1259 ms, sort 162 ms, write 2694 ms, index 583 ms: 5 candidates, 89079 repo-hours, 301 releases; waiting 178 ms; commit 4128 ms)
2026-11-07T13:16:02Z [load_day 2026-04-01] 2026-04-01 hour 2: 157812 events in 4 files, snapshot 3049556491949864200 (task 5753 ms: download 2077 ms overlapping gunzip 332 ms, parse 1090 ms, sort 146 ms, write 2679 ms, index 658 ms: 12 candidates, 93710 repo-hours, 371 releases; waiting 528 ms; commit 1298 ms)
2026-11-07T13:16:03Z [load_day 2026-04-01] 2026-04-01 hour 3: 156892 events in 4 files, snapshot 6283657755484318533 (task 5762 ms: download 2064 ms overlapping gunzip 391 ms, parse 1275 ms, sort 185 ms, write 2583 ms, index 575 ms: 5 candidates, 84722 repo-hours, 579 releases; waiting 424 ms; commit 1378 ms)
2026-11-07T13:16:09Z [load_day 2026-04-01] 2026-04-01 hour 4: 156068 events in 4 files, snapshot 8758373423807648819 (task 6739 ms: download 2132 ms overlapping gunzip 507 ms, parse 1577 ms, sort 200 ms, write 3061 ms, index 497 ms: 10 candidates, 75955 repo-hours, 700 releases; waiting 587 ms; commit 1286 ms)
2026-11-07T13:16:11Z [load_day 2026-04-01] 2026-04-01 hour 5: 158162 events in 4 files, snapshot 8302755308101165718 (task 7098 ms: download 2029 ms overlapping gunzip 492 ms, parse 1552 ms, sort 191 ms, write 3724 ms, index 507 ms: 10 candidates, 77354 repo-hours, 494 releases; waiting 328 ms; commit 1339 ms)
2026-11-07T13:16:18Z [load_day 2026-04-01] 2026-04-01 hour 6: 162757 events in 4 files, snapshot 9174179173072792836 (task 7822 ms: download 3668 ms overlapping gunzip 430 ms, parse 1280 ms, sort 223 ms, write 2789 ms, index 598 ms: 10 candidates, 86599 repo-hours, 427 releases; waiting 2202 ms; commit 1122 ms)
2026-11-07T13:16:19Z [load_day 2026-04-01] 2026-04-01 hour 7: 158595 events in 4 files, snapshot 242724583871782040 (task 5738 ms: download 2307 ms overlapping gunzip 346 ms, parse 1073 ms, sort 156 ms, write 2613 ms, index 582 ms: 10 candidates, 87946 repo-hours, 267 releases; waiting 585 ms; commit 1258 ms)
2026-11-07T13:16:24Z [load_day 2026-04-01] 2026-04-01 hour 8: 160943 events in 4 files, snapshot 1161699272621991849 (task 5540 ms: download 1948 ms overlapping gunzip 342 ms, parse 1092 ms, sort 155 ms, write 2462 ms, index 618 ms: 11 candidates, 86447 repo-hours, 221 releases; waiting 554 ms; commit 1233 ms)
2026-11-07T13:16:25Z [load_day 2026-04-01] 2026-04-01 hour 9: 159564 events in 4 files, snapshot 5842705110111302364 (task 5192 ms: download 1714 ms overlapping gunzip 310 ms, parse 986 ms, sort 151 ms, write 2306 ms, index 605 ms: 9 candidates, 87808 repo-hours, 166 releases; waiting 549 ms; commit 1200 ms)
2026-11-07T13:16:31Z [load_day 2026-04-01] 2026-04-01 hour 10: 158728 events in 4 files, snapshot 8507112504845779678 (task 5578 ms: download 1777 ms overlapping gunzip 354 ms, parse 1150 ms, sort 164 ms, write 2517 ms, index 605 ms: 12 candidates, 84987 repo-hours, 305 releases; waiting 550 ms; commit 1289 ms)
2026-11-07T13:16:32Z [load_day 2026-04-01] 2026-04-01 hour 11: 156429 events in 4 files, snapshot 2355640752533841441 (task 5624 ms: download 2034 ms overlapping gunzip 350 ms, parse 1112 ms, sort 209 ms, write 2401 ms, index 583 ms: 8 candidates, 85277 repo-hours, 307 releases; waiting 560 ms; commit 1110 ms)
2026-11-07T13:16:38Z [load_day 2026-04-01] 2026-04-01 hour 12: 155959 events in 4 files, snapshot 8039627665517432105 (task 4940 ms: download 1579 ms overlapping gunzip 316 ms, parse 997 ms, sort 125 ms, write 2037 ms, index 606 ms: 11 candidates, 89051 repo-hours, 224 releases; waiting 553 ms; commit 2763 ms)
2026-11-07T13:16:39Z [load_day 2026-04-01] 2026-04-01 hour 13: 158110 events in 4 files, snapshot 591511459053374438 (task 6141 ms: download 2148 ms overlapping gunzip 340 ms, parse 1181 ms, sort 169 ms, write 2298 ms, index 658 ms: 7 candidates, 97006 repo-hours, 131 releases; waiting 1253 ms; commit 1283 ms)
2026-11-07T13:16:44Z [load_day 2026-04-01] 2026-04-01 hour 14: 154494 events in 4 files, snapshot 8075117833993356853 (task 5826 ms: download 2014 ms overlapping gunzip 401 ms, parse 1300 ms, sort 135 ms, write 2429 ms, index 747 ms: 5 candidates, 89784 repo-hours, 310 releases; waiting 428 ms; commit 1435 ms)
2026-11-07T13:16:45Z [load_day 2026-04-01] 2026-04-01 hour 15: 154952 events in 4 files, snapshot 6637797583618484432 (task 5520 ms: download 1357 ms overlapping gunzip 390 ms, parse 1318 ms, sort 139 ms, write 2488 ms, index 624 ms: 17 candidates, 86373 repo-hours, 308 releases; waiting 189 ms; commit 1137 ms)
2026-11-07T13:16:51Z [load_day 2026-04-01] 2026-04-01 hour 16: 154786 events in 4 files, snapshot 4073298511518972755 (task 6538 ms: download 2258 ms overlapping gunzip 426 ms, parse 1395 ms, sort 235 ms, write 2929 ms, index 585 ms: 8 candidates, 84140 repo-hours, 414 releases; waiting 638 ms; commit 1244 ms)
2026-11-07T13:16:53Z [load_day 2026-04-01] 2026-04-01 hour 17: 154757 events in 4 files, snapshot 3978602876670346972 (task 6272 ms: download 2427 ms overlapping gunzip 403 ms, parse 1306 ms, sort 147 ms, write 2828 ms, index 550 ms: 7 candidates, 83503 repo-hours, 407 releases; waiting 715 ms; commit 1351 ms)
2026-11-07T13:16:58Z [load_day 2026-04-01] 2026-04-01 hour 18: 155266 events in 4 files, snapshot 1684127799114789375 (task 6175 ms: download 2077 ms overlapping gunzip 401 ms, parse 1315 ms, sort 134 ms, write 2838 ms, index 580 ms: 7 candidates, 84479 repo-hours, 424 releases; waiting 591 ms; commit 1285 ms)
2026-11-07T13:16:59Z [load_day 2026-04-01] 2026-04-01 hour 19: 158165 events in 4 files, snapshot 1571075923266240507 (task 5990 ms: download 1873 ms overlapping gunzip 376 ms, parse 1222 ms, sort 154 ms, write 2754 ms, index 576 ms: 9 candidates, 85020 repo-hours, 388 releases; waiting 586 ms; commit 1169 ms)
2026-11-07T13:17:05Z [load_day 2026-04-01] 2026-04-01 hour 20: 157311 events in 4 files, snapshot 740583198295451028 (task 6119 ms: download 1711 ms overlapping gunzip 466 ms, parse 1485 ms, sort 201 ms, write 2829 ms, index 567 ms: 14 candidates, 82683 repo-hours, 530 releases; waiting 254 ms; commit 1395 ms)
2026-11-07T13:17:07Z [load_day 2026-04-01] 2026-04-01 hour 21: 155250 events in 4 files, snapshot 3988751394448092317 (task 6945 ms: download 3272 ms overlapping gunzip 516 ms, parse 1644 ms, sort 159 ms, write 2812 ms, index 534 ms: 11 candidates, 78327 repo-hours, 638 releases; waiting 814 ms; commit 1364 ms)
2026-11-07T13:17:13Z [load_day 2026-04-01] 2026-04-01 hour 22: 152027 events in 4 files, snapshot 3421687405096797257 (task 6957 ms: download 2243 ms overlapping gunzip 496 ms, parse 1599 ms, sort 220 ms, write 3330 ms, index 457 ms: 3 candidates, 72272 repo-hours, 617 releases; waiting 613 ms; commit 1225 ms)
2026-11-07T13:17:14Z [load_day 2026-04-01] 2026-04-01 hour 23: 156245 events in 4 files, snapshot 3732576346933292377 (task 6837 ms: download 2704 ms overlapping gunzip 492 ms, parse 1643 ms, sort 189 ms, write 3100 ms, index 442 ms: 8 candidates, 71312 repo-hours, 673 releases; waiting 624 ms; commit 1144 ms)
2026-11-07T13:17:22Z [load_day 2026-04-01] 2026-04-01: repo_hour merged from 24 files to 1 (2019884 rows, 8149 ms)
2026-11-07T13:17:24Z [load_day 2026-04-01] 2026-04-01: index committed in 10186 ms (24 + 1 + 24 files)
2026-11-07T13:17:24Z [load_day 2026-04-01] 2026-04-01: 3763460 events in 24 hours
2026-11-07T13:17:24Z [load_day 2026-04-01] attempt 1 succeeded