orcaLog in

Runs · run 533

load_day 2026-05-24, attempt 1 succeeded

Host
4e84322b8c45:117521
Started
2026-11-07T06:16:42Z
Ended
2026-11-07T06:18:04Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/533/load_day/2026-05-24/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:16:42Z [load_day 2026-05-24] attempt 1 started
2026-11-07T06:16:52Z [load_day 2026-05-24] 2026-05-24 hour 0: 147429 events in 3 files, snapshot 2008544332107064534 (task 6585 ms: download 2115 ms overlapping gunzip 420 ms, parse 1506 ms, sort 197 ms, write 3267 ms, index 389 ms: 5 candidates, 61405 repo-hours, 1025 releases; waiting 502 ms; commit 1217 ms)
2026-11-07T06:16:53Z [load_day 2026-05-24] 2026-05-24 hour 1: 147071 events in 3 files, snapshot 5426862125251657415 (task 6188 ms: download 2170 ms overlapping gunzip 373 ms, parse 1265 ms, sort 167 ms, write 3021 ms, index 442 ms: 7 candidates, 67053 repo-hours, 797 releases; waiting 526 ms; commit 1016 ms)
2026-11-07T06:16:58Z [load_day 2026-05-24] 2026-05-24 hour 2: 156689 events in 4 files, snapshot 7997927041518640587 (task 5120 ms: download 1661 ms overlapping gunzip 313 ms, parse 1080 ms, sort 122 ms, write 2321 ms, index 492 ms: 4 candidates, 80491 repo-hours, 502 releases; waiting 527 ms; commit 1142 ms)
2026-11-07T06:16:59Z [load_day 2026-05-24] 2026-05-24 hour 3: 150509 events in 4 files, snapshot 5738417362645939099 (task 5184 ms: download 1623 ms overlapping gunzip 327 ms, parse 1106 ms, sort 164 ms, write 2221 ms, index 507 ms: 7 candidates, 74831 repo-hours, 693 releases; waiting 585 ms; commit 1111 ms)
2026-11-07T06:17:04Z [load_day 2026-05-24] 2026-05-24 hour 4: 157410 events in 4 files, snapshot 7468147561910802122 (task 5892 ms: download 1894 ms overlapping gunzip 377 ms, parse 1270 ms, sort 216 ms, write 2681 ms, index 499 ms: 6 candidates, 76088 repo-hours, 748 releases; waiting 537 ms; commit 975 ms)
2026-11-07T06:17:05Z [load_day 2026-05-24] 2026-05-24 hour 5: 151874 events in 4 files, snapshot 6145218865404296243 (task 5651 ms: download 1933 ms overlapping gunzip 363 ms, parse 1177 ms, sort 150 ms, write 2685 ms, index 442 ms: 5 candidates, 67837 repo-hours, 768 releases; waiting 527 ms; commit 1014 ms)
2026-11-07T06:17:10Z [load_day 2026-05-24] 2026-05-24 hour 6: 150866 events in 4 files, snapshot 2181641490077756004 (task 5068 ms: download 2096 ms overlapping gunzip 347 ms, parse 1135 ms, sort 134 ms, write 2140 ms, index 458 ms: 4 candidates, 67264 repo-hours, 784 releases; waiting 522 ms; commit 1079 ms)
2026-11-07T06:17:11Z [load_day 2026-05-24] 2026-05-24 hour 7: 156075 events in 4 files, snapshot 5301439317092171686 (task 5174 ms: download 1954 ms overlapping gunzip 330 ms, parse 1069 ms, sort 128 ms, write 2280 ms, index 489 ms: 5 candidates, 70873 repo-hours, 617 releases; waiting 541 ms; commit 1108 ms)
2026-11-07T06:17:15Z [load_day 2026-05-24] 2026-05-24 hour 8: 156248 events in 4 files, snapshot 6597461289114137725 (task 4455 ms: download 1235 ms overlapping gunzip 290 ms, parse 1006 ms, sort 111 ms, write 1769 ms, index 489 ms: 7 candidates, 75854 repo-hours, 362 releases; waiting 235 ms; commit 1202 ms)
2026-11-07T06:17:18Z [load_day 2026-05-24] 2026-05-24 hour 9: 153989 events in 4 files, snapshot 1295648091835931134 (task 5263 ms: download 1473 ms overlapping gunzip 324 ms, parse 1126 ms, sort 120 ms, write 2208 ms, index 688 ms: 17 candidates, 77098 repo-hours, 567 releases; waiting 517 ms; commit 1158 ms)
2026-11-07T06:17:21Z [load_day 2026-05-24] 2026-05-24 hour 10: 154897 events in 4 files, snapshot 8394782866564868845 (task 5105 ms: download 1857 ms overlapping gunzip 309 ms, parse 1025 ms, sort 131 ms, write 2224 ms, index 573 ms: 3 candidates, 72797 repo-hours, 502 releases; waiting 544 ms; commit 1198 ms)
2026-11-07T06:17:23Z [load_day 2026-05-24] 2026-05-24 hour 11: 157961 events in 4 files, snapshot 5448565386590288905 (task 4423 ms: download 1547 ms overlapping gunzip 246 ms, parse 851 ms, sort 110 ms, write 1909 ms, index 475 ms: 5 candidates, 72012 repo-hours, 289 releases; waiting 532 ms; commit 1080 ms)
2026-11-07T06:17:26Z [load_day 2026-05-24] 2026-05-24 hour 12: 160626 events in 4 files, snapshot 4271470259275181737 (task 4476 ms: download 1439 ms overlapping gunzip 273 ms, parse 905 ms, sort 109 ms, write 1898 ms, index 532 ms: 10 candidates, 81625 repo-hours, 291 releases; waiting 527 ms; commit 1127 ms)
2026-11-07T06:17:28Z [load_day 2026-05-24] 2026-05-24 hour 13: 165293 events in 4 files, snapshot 7091143559569277678 (task 4103 ms: download 1316 ms overlapping gunzip 210 ms, parse 777 ms, sort 105 ms, write 1597 ms, index 580 ms: 9 candidates, 91862 repo-hours, 81 releases; waiting 546 ms; commit 2181 ms)
2026-11-07T06:17:31Z [load_day 2026-05-24] 2026-05-24 hour 14: 159594 events in 4 files, snapshot 472051134218772994 (task 3791 ms: download 809 ms overlapping gunzip 199 ms, parse 731 ms, sort 102 ms, write 1578 ms, index 554 ms: 3 candidates, 80281 repo-hours, 74 releases; waiting 213 ms; commit 961 ms)
2026-11-07T06:17:33Z [load_day 2026-05-24] 2026-05-24 hour 15: 161672 events in 4 files, snapshot 6441110594698302537 (task 4385 ms: download 1588 ms overlapping gunzip 245 ms, parse 833 ms, sort 109 ms, write 1492 ms, index 551 ms: 6 candidates, 78370 repo-hours, 157 releases; waiting 513 ms; commit 1089 ms)
2026-11-07T06:17:36Z [load_day 2026-05-24] 2026-05-24 hour 16: 160158 events in 4 files, snapshot 7678027264093967623 (task 4272 ms: download 1402 ms overlapping gunzip 233 ms, parse 837 ms, sort 101 ms, write 1703 ms, index 572 ms: 11 candidates, 80121 repo-hours, 116 releases; waiting 520 ms; commit 1108 ms)
2026-11-07T06:17:38Z [load_day 2026-05-24] 2026-05-24 hour 17: 162637 events in 4 files, snapshot 7289623334698305399 (task 4217 ms: download 1555 ms overlapping gunzip 220 ms, parse 797 ms, sort 109 ms, write 1662 ms, index 586 ms: 10 candidates, 78777 repo-hours, 89 releases; waiting 522 ms; commit 1174 ms)
2026-11-07T06:17:41Z [load_day 2026-05-24] 2026-05-24 hour 18: 159006 events in 4 files, snapshot 1304538641300565681 (task 4498 ms: download 1795 ms overlapping gunzip 242 ms, parse 866 ms, sort 118 ms, write 1825 ms, index 636 ms: 4 candidates, 77596 repo-hours, 208 releases; waiting 520 ms; commit 1159 ms)
2026-11-07T06:17:43Z [load_day 2026-05-24] 2026-05-24 hour 19: 159375 events in 4 files, snapshot 6403853005686328798 (task 4811 ms: download 1773 ms overlapping gunzip 270 ms, parse 955 ms, sort 121 ms, write 2091 ms, index 536 ms: 7 candidates, 76150 repo-hours, 343 releases; waiting 522 ms; commit 1159 ms)
2026-11-07T06:17:47Z [load_day 2026-05-24] 2026-05-24 hour 20: 158833 events in 4 files, snapshot 7933185256121161293 (task 4942 ms: download 1446 ms overlapping gunzip 285 ms, parse 986 ms, sort 136 ms, write 2239 ms, index 498 ms: 10 candidates, 74083 repo-hours, 376 releases; waiting 527 ms; commit 1243 ms)
2026-11-07T06:17:49Z [load_day 2026-05-24] 2026-05-24 hour 21: 157394 events in 4 files, snapshot 9164796418169463701 (task 4871 ms: download 1591 ms overlapping gunzip 294 ms, parse 977 ms, sort 119 ms, write 2216 ms, index 475 ms: 5 candidates, 71734 repo-hours, 423 releases; waiting 532 ms; commit 1313 ms)
2026-11-07T06:17:53Z [load_day 2026-05-24] 2026-05-24 hour 22: 151067 events in 4 files, snapshot 5887130555186086170 (task 5056 ms: download 1505 ms overlapping gunzip 327 ms, parse 1071 ms, sort 187 ms, write 2274 ms, index 448 ms: 3 candidates, 69328 repo-hours, 625 releases; waiting 530 ms; commit 1147 ms)
2026-11-07T06:17:55Z [load_day 2026-05-24] 2026-05-24 hour 23: 148260 events in 3 files, snapshot 7178154140860229719 (task 5564 ms: download 1907 ms overlapping gunzip 374 ms, parse 1241 ms, sort 159 ms, write 2412 ms, index 526 ms: 9 candidates, 66516 repo-hours, 814 releases; waiting 548 ms; commit 1120 ms)
2026-11-07T06:18:03Z [load_day 2026-05-24] 2026-05-24: repo_hour merged from 24 files to 1 (1790046 rows, 7515 ms)
2026-11-07T06:18:04Z [load_day 2026-05-24] 2026-05-24: index committed in 9189 ms (24 + 1 + 24 files)
2026-11-07T06:18:04Z [load_day 2026-05-24] 2026-05-24: 3744933 events in 24 hours
2026-11-07T06:18:04Z [load_day 2026-05-24] attempt 1 succeeded