orcaLog in

Runs · run 663

load_day 2026-04-11, attempt 1 succeeded

Host
4e84322b8c45:162591
Started
2026-11-07T12:58:40Z
Ended
2026-11-07T13:00:22Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/663/load_day/2026-04-11/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T12:58:40Z [load_day 2026-04-11] attempt 1 started
2026-11-07T12:58:49Z [load_day 2026-04-11] 2026-04-11 hour 0: 148087 events in 3 files, snapshot 2283254523974505778 (task 6177 ms: download 2042 ms overlapping gunzip 409 ms, parse 1372 ms, sort 159 ms, write 3066 ms, index 453 ms: 8 candidates, 65863 repo-hours, 827 releases; waiting 425 ms; commit 1242 ms)
2026-11-07T12:58:51Z [load_day 2026-04-11] 2026-04-11 hour 1: 155144 events in 4 files, snapshot 1588976525510659270 (task 6495 ms: download 2296 ms overlapping gunzip 392 ms, parse 1330 ms, sort 172 ms, write 3162 ms, index 549 ms: 7 candidates, 84905 repo-hours, 656 releases; waiting 532 ms; commit 1274 ms)
2026-11-07T12:58:58Z [load_day 2026-04-11] 2026-04-11 hour 2: 157688 events in 4 files, snapshot 1112959059674580748 (task 7764 ms: download 1977 ms overlapping gunzip 546 ms, parse 1934 ms, sort 214 ms, write 3860 ms, index 519 ms: 8 candidates, 86668 repo-hours, 648 releases; waiting 333 ms; commit 1422 ms)
2026-11-07T12:59:01Z [load_day 2026-04-11] 2026-04-11 hour 3: 148260 events in 3 files, snapshot 3632500679817617807 (task 9415 ms: download 2810 ms overlapping gunzip 680 ms, parse 2579 ms, sort 193 ms, write 4586 ms, index 468 ms: 8 candidates, 65472 repo-hours, 722 releases; waiting 602 ms; commit 1335 ms)
2026-11-07T12:59:08Z [load_day 2026-04-11] 2026-04-11 hour 4: 151833 events in 4 files, snapshot 2917101006315406989 (task 9898 ms: download 3039 ms overlapping gunzip 766 ms, parse 2879 ms, sort 303 ms, write 4606 ms, index 465 ms: 13 candidates, 69446 repo-hours, 624 releases; waiting 579 ms; commit 1295 ms)
2026-11-07T12:59:10Z [load_day 2026-04-11] 2026-04-11 hour 5: 155269 events in 4 files, snapshot 8166883004245259188 (task 7284 ms: download 2467 ms overlapping gunzip 514 ms, parse 1770 ms, sort 170 ms, write 3412 ms, index 496 ms: 8 candidates, 72487 repo-hours, 828 releases; waiting 568 ms; commit 1303 ms)
2026-11-07T12:59:15Z [load_day 2026-04-11] 2026-04-11 hour 6: 157144 events in 4 files, snapshot 7108923211048513873 (task 6247 ms: download 2061 ms overlapping gunzip 461 ms, parse 1511 ms, sort 178 ms, write 2631 ms, index 523 ms: 8 candidates, 75101 repo-hours, 818 releases; waiting 530 ms; commit 1114 ms)
2026-11-07T12:59:16Z [load_day 2026-04-11] 2026-04-11 hour 7: 159794 events in 4 files, snapshot 8633799398826325898 (task 6233 ms: download 2160 ms overlapping gunzip 431 ms, parse 1481 ms, sort 158 ms, write 2771 ms, index 528 ms: 8 candidates, 76171 repo-hours, 786 releases; waiting 568 ms; commit 1072 ms)
2026-11-07T12:59:24Z [load_day 2026-04-11] 2026-04-11 hour 8: 157030 events in 4 files, snapshot 7230321908674756993 (task 8051 ms: download 2391 ms overlapping gunzip 622 ms, parse 2186 ms, sort 224 ms, write 3659 ms, index 477 ms: 12 candidates, 73506 repo-hours, 854 releases; waiting 541 ms; commit 1314 ms)
2026-11-07T12:59:25Z [load_day 2026-04-11] 2026-04-11 hour 9: 158004 events in 4 files, snapshot 2738023954058018602 (task 6610 ms: download 2183 ms overlapping gunzip 497 ms, parse 1656 ms, sort 184 ms, write 2926 ms, index 513 ms: 8 candidates, 74221 repo-hours, 842 releases; waiting 507 ms; commit 1221 ms)
2026-11-07T12:59:31Z [load_day 2026-04-11] 2026-04-11 hour 10: 157100 events in 4 files, snapshot 2108517684214430453 (task 5957 ms: download 1663 ms overlapping gunzip 421 ms, parse 1389 ms, sort 175 ms, write 2946 ms, index 508 ms: 6 candidates, 72525 repo-hours, 804 releases; waiting 231 ms; commit 1199 ms)
2026-11-07T12:59:32Z [load_day 2026-04-11] 2026-04-11 hour 11: 159952 events in 4 files, snapshot 8208990699607566780 (task 5774 ms: download 1668 ms overlapping gunzip 410 ms, parse 1317 ms, sort 138 ms, write 2923 ms, index 486 ms: 11 candidates, 71933 repo-hours, 645 releases; waiting 236 ms; commit 1401 ms)
2026-11-07T12:59:38Z [load_day 2026-04-11] 2026-04-11 hour 12: 159982 events in 4 files, snapshot 7789913490314518665 (task 6118 ms: download 1830 ms overlapping gunzip 377 ms, parse 1280 ms, sort 160 ms, write 2949 ms, index 554 ms: 4 candidates, 83470 repo-hours, 732 releases; waiting 554 ms; commit 1345 ms)
2026-11-07T12:59:39Z [load_day 2026-04-11] 2026-04-11 hour 13: 157131 events in 4 files, snapshot 6487040405829767050 (task 6197 ms: download 2002 ms overlapping gunzip 405 ms, parse 1258 ms, sort 130 ms, write 3029 ms, index 572 ms: 9 candidates, 85878 repo-hours, 754 releases; waiting 563 ms; commit 1236 ms)
2026-11-07T12:59:44Z [load_day 2026-04-11] 2026-04-11 hour 14: 151997 events in 4 files, snapshot 4831092769238648649 (task 6292 ms: download 2095 ms overlapping gunzip 413 ms, parse 1365 ms, sort 230 ms, write 2786 ms, index 555 ms: 9 candidates, 78236 repo-hours, 745 releases; waiting 608 ms; commit 1250 ms)
2026-11-07T12:59:46Z [load_day 2026-04-11] 2026-04-11 hour 15: 155982 events in 4 files, snapshot 5233576278449201139 (task 6057 ms: download 2168 ms overlapping gunzip 365 ms, parse 1180 ms, sort 153 ms, write 2944 ms, index 596 ms: 11 candidates, 80485 repo-hours, 865 releases; waiting 539 ms; commit 1171 ms)
2026-11-07T12:59:51Z [load_day 2026-04-11] 2026-04-11 hour 16: 153157 events in 4 files, snapshot 2497102071732823962 (task 5919 ms: download 2068 ms overlapping gunzip 371 ms, parse 1247 ms, sort 133 ms, write 2795 ms, index 567 ms: 15 candidates, 78609 repo-hours, 710 releases; waiting 526 ms; commit 1311 ms)
2026-11-07T12:59:52Z [load_day 2026-04-11] 2026-04-11 hour 17: 151308 events in 4 files, snapshot 2111006691987116578 (task 5686 ms: download 2026 ms overlapping gunzip 351 ms, parse 1152 ms, sort 213 ms, write 2658 ms, index 536 ms: 14 candidates, 77350 repo-hours, 807 releases; waiting 555 ms; commit 1030 ms)
2026-11-07T12:59:58Z [load_day 2026-04-11] 2026-04-11 hour 18: 156679 events in 4 files, snapshot 6101225379431172116 (task 6187 ms: download 1948 ms overlapping gunzip 368 ms, parse 1237 ms, sort 197 ms, write 2984 ms, index 569 ms: 15 candidates, 80952 repo-hours, 844 releases; waiting 537 ms; commit 1181 ms)
2026-11-07T12:59:59Z [load_day 2026-04-11] 2026-04-11 hour 19: 149563 events in 3 files, snapshot 4284928108142289452 (task 6149 ms: download 1814 ms overlapping gunzip 352 ms, parse 1211 ms, sort 156 ms, write 3030 ms, index 519 ms: 3 candidates, 75922 repo-hours, 885 releases; waiting 544 ms; commit 1268 ms)
2026-11-07T13:00:05Z [load_day 2026-04-11] 2026-04-11 hour 20: 147087 events in 3 files, snapshot 3286697944001740546 (task 6123 ms: download 2120 ms overlapping gunzip 353 ms, parse 1193 ms, sort 242 ms, write 2681 ms, index 556 ms: 5 candidates, 72302 repo-hours, 868 releases; waiting 655 ms; commit 1270 ms)
2026-11-07T13:00:06Z [load_day 2026-04-11] 2026-04-11 hour 21: 145327 events in 3 files, snapshot 3361897490941337009 (task 5998 ms: download 1894 ms overlapping gunzip 376 ms, parse 1314 ms, sort 157 ms, write 2871 ms, index 492 ms: 6 candidates, 67823 repo-hours, 907 releases; waiting 428 ms; commit 1254 ms)
2026-11-07T13:00:11Z [load_day 2026-04-11] 2026-04-11 hour 22: 145204 events in 3 files, snapshot 3224779515155381931 (task 5998 ms: download 1986 ms overlapping gunzip 365 ms, parse 1200 ms, sort 153 ms, write 3013 ms, index 477 ms: 13 candidates, 69362 repo-hours, 912 releases; waiting 427 ms; commit 1259 ms)
2026-11-07T13:00:12Z [load_day 2026-04-11] 2026-04-11 hour 23: 142032 events in 3 files, snapshot 8650409899415613532 (task 5949 ms: download 2070 ms overlapping gunzip 351 ms, parse 1291 ms, sort 129 ms, write 2895 ms, index 440 ms: 10 candidates, 65675 repo-hours, 1103 releases; waiting 553 ms; commit 1145 ms)
2026-11-07T13:00:20Z [load_day 2026-04-11] 2026-04-11: repo_hour merged from 24 files to 1 (1804362 rows, 7670 ms)
2026-11-07T13:00:22Z [load_day 2026-04-11] 2026-04-11: index committed in 9539 ms (24 + 1 + 24 files)
2026-11-07T13:00:22Z [load_day 2026-04-11] 2026-04-11: 3680754 events in 24 hours
2026-11-07T13:00:22Z [load_day 2026-04-11] attempt 1 succeeded