orcaLog in

Runs · run 113

load_day 2026-10-11, attempt 1 succeeded

Host
4e84322b8c45:20863
Started
2026-11-07T03:37:09Z
Ended
2026-11-07T03:37:57Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/113/load_day/2026-10-11/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:37:09Z [load_day 2026-10-11] attempt 1 started
2026-11-07T03:37:14Z [load_day 2026-10-11] 2026-10-11 hour 0: 30993 events in 1 files, snapshot 6231204566531320708 (task 2345 ms: download 1098 ms overlapping gunzip 137 ms, parse 435 ms, sort 35 ms, write 681 ms, index 139 ms: 0 candidates, 21122 repo-hours, 322 releases; waiting 613 ms; commit 625 ms)
2026-11-07T03:37:14Z [load_day 2026-10-11] 2026-10-11 hour 1: 32100 events in 1 files, snapshot 1619582070338645024 (task 2089 ms: download 865 ms overlapping gunzip 99 ms, parse 319 ms, sort 35 ms, write 707 ms, index 164 ms: 4 candidates, 21830 repo-hours, 335 releases; waiting 527 ms; commit 544 ms)
2026-11-07T03:37:16Z [load_day 2026-10-11] 2026-10-11 hour 2: 34517 events in 1 files, snapshot 8378567725572519649 (task 2308 ms: download 959 ms overlapping gunzip 112 ms, parse 332 ms, sort 25 ms, write 718 ms, index 234 ms: 4 candidates, 23929 repo-hours, 352 releases; waiting 572 ms; commit 639 ms)
2026-11-07T03:37:17Z [load_day 2026-10-11] 2026-10-11 hour 3: 34185 events in 1 files, snapshot 2510668867324199541 (task 2208 ms: download 888 ms overlapping gunzip 136 ms, parse 415 ms, sort 39 ms, write 638 ms, index 171 ms: 3 candidates, 23871 repo-hours, 420 releases; waiting 504 ms; commit 516 ms)
2026-11-07T03:37:19Z [load_day 2026-10-11] 2026-10-11 hour 4: 46023 events in 1 files, snapshot 5916162865247142971 (task 1929 ms: download 480 ms overlapping gunzip 117 ms, parse 375 ms, sort 37 ms, write 738 ms, index 221 ms: 4 candidates, 31190 repo-hours, 365 releases; waiting 192 ms; commit 646 ms)
2026-11-07T03:37:20Z [load_day 2026-10-11] 2026-10-11 hour 5: 47258 events in 1 files, snapshot 7747760271567602622 (task 2490 ms: download 1079 ms overlapping gunzip 130 ms, parse 400 ms, sort 34 ms, write 804 ms, index 209 ms: 6 candidates, 31513 repo-hours, 431 releases; waiting 606 ms; commit 528 ms)
2026-11-07T03:37:22Z [load_day 2026-10-11] 2026-10-11 hour 6: 50013 events in 2 files, snapshot 6671103592845015802 (task 2554 ms: download 1099 ms overlapping gunzip 125 ms, parse 399 ms, sort 43 ms, write 788 ms, index 236 ms: 5 candidates, 32372 repo-hours, 402 releases; waiting 623 ms; commit 638 ms)
2026-11-07T03:37:23Z [load_day 2026-10-11] 2026-10-11 hour 7: 72172 events in 2 files, snapshot 3760101825544608075 (task 2703 ms: download 1009 ms overlapping gunzip 140 ms, parse 455 ms, sort 62 ms, write 946 ms, index 290 ms: 5 candidates, 42612 repo-hours, 292 releases; waiting 565 ms; commit 620 ms)
2026-11-07T03:37:26Z [load_day 2026-10-11] 2026-10-11 hour 8: 85444 events in 2 files, snapshot 6430694910383450578 (task 3255 ms: download 1391 ms overlapping gunzip 176 ms, parse 588 ms, sort 73 ms, write 1213 ms, index 344 ms: 8 candidates, 49305 repo-hours, 285 releases; waiting 536 ms; commit 689 ms)
2026-11-07T03:37:27Z [load_day 2026-10-11] 2026-10-11 hour 9: 87473 events in 2 files, snapshot 5668126039827879885 (task 3074 ms: download 1171 ms overlapping gunzip 172 ms, parse 557 ms, sort 73 ms, write 1114 ms, index 334 ms: 12 candidates, 51191 repo-hours, 224 releases; waiting 526 ms; commit 608 ms)
2026-11-07T03:37:30Z [load_day 2026-10-11] 2026-10-11 hour 10: 86451 events in 2 files, snapshot 6781277585088931395 (task 3633 ms: download 1469 ms overlapping gunzip 157 ms, parse 509 ms, sort 72 ms, write 1451 ms, index 340 ms: 11 candidates, 49936 repo-hours, 220 releases; waiting 693 ms; commit 574 ms)
2026-11-07T03:37:30Z [load_day 2026-10-11] 2026-10-11 hour 11: 85862 events in 2 files, snapshot 1215298139372679002 (task 2603 ms: download 320 ms overlapping gunzip 145 ms, parse 472 ms, sort 70 ms, write 1382 ms, index 328 ms: 3 candidates, 51773 repo-hours, 188 releases; waiting 14 ms; commit 409 ms)
2026-11-07T03:37:33Z [load_day 2026-10-11] 2026-10-11 hour 12: 86163 events in 2 files, snapshot 1933129077571669210 (task 2311 ms: download 291 ms overlapping gunzip 142 ms, parse 478 ms, sort 62 ms, write 1052 ms, index 366 ms: 6 candidates, 52080 repo-hours, 174 releases; waiting 20 ms; commit 525 ms)
2026-11-07T03:37:33Z [load_day 2026-10-11] 2026-10-11 hour 13: 84302 events in 2 files, snapshot 3669193826964602199 (task 2302 ms: download 279 ms overlapping gunzip 140 ms, parse 439 ms, sort 63 ms, write 1085 ms, index 354 ms: 5 candidates, 51648 repo-hours, 141 releases; waiting 19 ms; commit 651 ms)
2026-11-07T03:37:35Z [load_day 2026-10-11] 2026-10-11 hour 14: 86701 events in 2 files, snapshot 6098810806960819233 (task 2262 ms: download 267 ms overlapping gunzip 138 ms, parse 464 ms, sort 62 ms, write 1035 ms, index 357 ms: 10 candidates, 53063 repo-hours, 163 releases; waiting 15 ms; commit 559 ms)
2026-11-07T03:37:36Z [load_day 2026-10-11] 2026-10-11 hour 15: 87331 events in 2 files, snapshot 5914503734038635345 (task 2414 ms: download 363 ms overlapping gunzip 147 ms, parse 473 ms, sort 61 ms, write 1143 ms, index 372 ms: 6 candidates, 53700 repo-hours, 237 releases; waiting 27 ms; commit 777 ms)
2026-11-07T03:37:38Z [load_day 2026-10-11] 2026-10-11 hour 16: 87210 events in 2 files, snapshot 9285750991619360 (task 2270 ms: download 315 ms overlapping gunzip 141 ms, parse 449 ms, sort 66 ms, write 1065 ms, index 339 ms: 9 candidates, 53598 repo-hours, 144 releases; waiting 16 ms; commit 535 ms)
2026-11-07T03:37:39Z [load_day 2026-10-11] 2026-10-11 hour 17: 87021 events in 2 files, snapshot 9043680039288361143 (task 2470 ms: download 296 ms overlapping gunzip 148 ms, parse 476 ms, sort 79 ms, write 1042 ms, index 358 ms: 11 candidates, 56371 repo-hours, 125 releases; waiting 26 ms; commit 636 ms)
2026-11-07T03:37:42Z [load_day 2026-10-11] 2026-10-11 hour 18: 84065 events in 2 files, snapshot 3823261486200594599 (task 3094 ms: download 1032 ms overlapping gunzip 148 ms, parse 482 ms, sort 57 ms, write 1214 ms, index 362 ms: 10 candidates, 51555 repo-hours, 185 releases; waiting 532 ms; commit 665 ms)
2026-11-07T03:37:43Z [load_day 2026-10-11] 2026-10-11 hour 19: 82922 events in 2 files, snapshot 5317419474546259475 (task 3189 ms: download 1198 ms overlapping gunzip 150 ms, parse 474 ms, sort 66 ms, write 1153 ms, index 323 ms: 8 candidates, 50084 repo-hours, 175 releases; waiting 700 ms; commit 597 ms)
2026-11-07T03:37:45Z [load_day 2026-10-11] 2026-10-11 hour 20: 79974 events in 2 files, snapshot 2361240994526160343 (task 2193 ms: download 257 ms overlapping gunzip 136 ms, parse 431 ms, sort 61 ms, write 1008 ms, index 351 ms: 9 candidates, 47140 repo-hours, 181 releases; waiting 15 ms; commit 769 ms)
2026-11-07T03:37:46Z [load_day 2026-10-11] 2026-10-11 hour 21: 78940 events in 2 files, snapshot 2524944266292330221 (task 2911 ms: download 1105 ms overlapping gunzip 144 ms, parse 461 ms, sort 62 ms, write 966 ms, index 311 ms: 24 candidates, 47369 repo-hours, 161 releases; waiting 539 ms; commit 773 ms)
2026-11-07T03:37:48Z [load_day 2026-10-11] 2026-10-11 hour 22: 72584 events in 2 files, snapshot 4953822146847475663 (task 2822 ms: download 1071 ms overlapping gunzip 140 ms, parse 448 ms, sort 51 ms, write 966 ms, index 337 ms: 15 candidates, 42209 repo-hours, 154 releases; waiting 555 ms; commit 711 ms)
2026-11-07T03:37:50Z [load_day 2026-10-11] 2026-10-11 hour 23: 71174 events in 2 files, snapshot 7819187874024584232 (task 2876 ms: download 1253 ms overlapping gunzip 151 ms, parse 484 ms, sort 48 ms, write 999 ms, index 301 ms: 18 candidates, 40783 repo-hours, 218 releases; waiting 562 ms; commit 747 ms)
2026-11-07T03:37:55Z [load_day 2026-10-11] 2026-10-11: repo_hour merged from 24 files to 1 (1030244 rows, 4789 ms)
2026-11-07T03:37:57Z [load_day 2026-10-11] 2026-10-11: index committed in 6950 ms (23 + 1 + 24 files)
2026-11-07T03:37:57Z [load_day 2026-10-11] 2026-10-11: 1680878 events in 24 hours
2026-11-07T03:37:57Z [load_day 2026-10-11] attempt 1 succeeded