--- start 1 resuming run 2 with 0 steps done and 0 interrupted [load_day 2023-01-02] 2023-01-02 hour 0: 115497 events in 3 files, snapshot 664908790431328739 (task 31173 ms: download 12084 ms overlapping gunzip 3399 ms, parse 14885 ms, sort 1014 ms, write 10094 ms, index 936 ms: 3 candidates, 54476 repo-hours, 754 releases; waiting 520 ms; commit 659 ms) [load_day 2023-01-02] 2023-01-02 hour 1: 129221 events in 3 files, snapshot 2479795563949775181 (task 24858 ms: download 6043 ms overlapping gunzip 3199 ms, parse 12125 ms, sort 807 ms, write 7934 ms, index 662 ms: 2 candidates, 63433 repo-hours, 665 releases; waiting 38 ms; commit 385 ms) [load_day 2023-01-02] 2023-01-02 hour 2: 105042 events in 3 files, snapshot 4702157015056934880 (task 30678 ms: download 10976 ms overlapping gunzip 3254 ms, parse 15212 ms, sort 1098 ms, write 9629 ms, index 744 ms: 7 candidates, 45221 repo-hours, 551 releases; waiting 403 ms; commit 487 ms) [load_day 2023-01-02] 2023-01-02 hour 3: 108428 events in 3 files, snapshot 3662453985329214734 (task 19397 ms: download 4373 ms overlapping gunzip 2076 ms, parse 7745 ms, sort 431 ms, write 8484 ms, index 562 ms: 5 candidates, 38463 repo-hours, 665 releases; waiting 18 ms; commit 439 ms) [load_day 2023-01-02] 2023-01-02 hour 4: 116077 events in 3 files, snapshot 5003405790979857671 (task 34788 ms: download 12693 ms overlapping gunzip 4650 ms, parse 19786 ms, sort 1748 ms, write 7111 ms, index 794 ms: 2 candidates, 40887 repo-hours, 504 releases; waiting 352 ms; commit 441 ms) [load_day 2023-01-02] 2023-01-02 hour 5: 115545 events in 3 files, snapshot 3964256378403946185 (task 19996 ms: download 4554 ms overlapping gunzip 2052 ms, parse 8251 ms, sort 773 ms, write 7935 ms, index 866 ms: 3 candidates, 42275 repo-hours, 719 releases; waiting 30 ms; commit 541 ms) [load_day 2023-01-02] 2023-01-02 hour 6: 123358 events in 3 files, snapshot 423553976742493579 (task 31374 ms: download 10776 ms overlapping gunzip 3914 ms, parse 16210 ms, sort 891 ms, write 9133 ms, index 447 ms: 3 candidates, 49028 repo-hours, 664 releases; waiting 426 ms; commit 561 ms) [load_day 2023-01-02] 2023-01-02 hour 7: 125572 events in 3 files, snapshot 6045386513615888103 (task 16866 ms: download 2984 ms overlapping gunzip 1583 ms, parse 6457 ms, sort 322 ms, write 7592 ms, index 710 ms: 1 candidates, 47311 repo-hours, 647 releases; waiting 15 ms; commit 733 ms) [load_day 2023-01-02] 2023-01-02 hour 8: 147723 events in 3 files, snapshot 8695946472740691595 (task 37438 ms: download 14214 ms overlapping gunzip 3931 ms, parse 18004 ms, sort 1770 ms, write 11778 ms, index 1170 ms: 8 candidates, 58005 repo-hours, 736 releases; waiting 420 ms; commit 625 ms) [load_day 2023-01-02] 2023-01-02 hour 9: 154885 events in 4 files, snapshot 5739888823249078102 (task 26339 ms: download 6612 ms overlapping gunzip 2943 ms, parse 11179 ms, sort 729 ms, write 10297 ms, index 1081 ms: 6 candidates, 59841 repo-hours, 763 releases; waiting 23 ms; commit 443 ms) [load_day 2023-01-02] 2023-01-02 hour 10: 156363 events in 4 files, snapshot 5020925499881071027 (task 37317 ms: download 14472 ms overlapping gunzip 3767 ms, parse 16007 ms, sort 1352 ms, write 14236 ms, index 1244 ms: 8 candidates, 61714 repo-hours, 752 releases; waiting 402 ms; commit 466 ms) [load_day 2023-01-02] 2023-01-02 hour 11: 162247 events in 4 files, snapshot 1646504994185972951 (task 28990 ms: download 5984 ms overlapping gunzip 3248 ms, parse 12813 ms, sort 860 ms, write 11502 ms, index 476 ms: 1 candidates, 61324 repo-hours, 741 releases; waiting 21 ms; commit 622 ms) [load_day 2023-01-02] 2023-01-02 hour 12: 193890 events in 4 files, snapshot 7321437007035338248 (task 41207 ms: download 14000 ms overlapping gunzip 4336 ms, parse 19025 ms, sort 1358 ms, write 13248 ms, index 2445 ms: 5 candidates, 88161 repo-hours, 878 releases; waiting 339 ms; commit 580 ms) [load_day 2023-01-02] 2023-01-02 hour 13: 187362 events in 4 files, snapshot 1959819249202548533 (task 29543 ms: download 5934 ms overlapping gunzip 3107 ms, parse 12201 ms, sort 836 ms, write 11119 ms, index 2131 ms: 6 candidates, 85981 repo-hours, 818 releases; waiting 42 ms; commit 597 ms) [load_day 2023-01-02] 2023-01-02 hour 14: 178645 events in 4 files, snapshot 3132681548395440980 (task 42831 ms: download 14514 ms overlapping gunzip 4420 ms, parse 19250 ms, sort 1758 ms, write 15109 ms, index 1490 ms: 8 candidates, 71710 repo-hours, 907 releases; waiting 431 ms; commit 437 ms) [load_day 2023-01-02] 2023-01-02 hour 15: 178095 events in 4 files, snapshot 3574880658174892115 (task 29506 ms: download 5632 ms overlapping gunzip 3152 ms, parse 12551 ms, sort 913 ms, write 11900 ms, index 844 ms: 4 candidates, 73011 repo-hours, 1012 releases; waiting 22 ms; commit 508 ms) [load_day 2023-01-02] attempt 1 failed: 2023-01-02 hour 16: orca: can't write data files for gharchive.events: objectstore.http: PUT https://nbg1.your-objectstorage.com/census-mlake-dev/warehouse/gharchive/events/data/created_day%3D2023-01-02/040979b2-f8d9-48e6-973e-5c14e453fbbf-00000.parquet failed: Timeout was reached: Resolving timed out after 10079 milliseconds [load_day 2023-01-02] found its commit 664908790431328739 to s3://census-mlake-dev/warehouse/gharchive/events [load_day 2023-01-02] found its commit 2479795563949775181 to s3://census-mlake-dev/warehouse/gharchive/events [load_day 2023-01-02] found its commit 4702157015056934880 to s3://census-mlake-dev/warehouse/gharchive/events [load_day 2023-01-02] found its commit 3662453985329214734 to s3://census-mlake-dev/warehouse/gharchive/events [load_day 2023-01-02] found its commit 5003405790979857671 to s3://census-mlake-dev/warehouse/gharchive/events [load_day 2023-01-02] found its commit 3964256378403946185 to s3://census-mlake-dev/warehouse/gharchive/events [load_day 2023-01-02] found its commit 423553976742493579 to s3://census-mlake-dev/warehouse/gharchive/events [load_day 2023-01-02] found its commit 6045386513615888103 to s3://census-mlake-dev/warehouse/gharchive/events [load_day 2023-01-02] found its commit 8695946472740691595 to s3://census-mlake-dev/warehouse/gharchive/events [load_day 2023-01-02] found its commit 5739888823249078102 to s3://census-mlake-dev/warehouse/gharchive/events [load_day 2023-01-02] found its commit 5020925499881071027 to s3://census-mlake-dev/warehouse/gharchive/events [load_day 2023-01-02] found its commit 1646504994185972951 to s3://census-mlake-dev/warehouse/gharchive/events [load_day 2023-01-02] found its commit 7321437007035338248 to s3://census-mlake-dev/warehouse/gharchive/events [load_day 2023-01-02] found its commit 1959819249202548533 to s3://census-mlake-dev/warehouse/gharchive/events [load_day 2023-01-02] found its commit 3132681548395440980 to s3://census-mlake-dev/warehouse/gharchive/events [load_day 2023-01-02] found its commit 3574880658174892115 to s3://census-mlake-dev/warehouse/gharchive/events [load_day 2023-01-02] 2023-01-02: 16 hours already committed [load_day 2023-01-02] 2023-01-02: rebuilding the index of the 16 committed hours from the events (snapshot 3574880658174892115) [load_day 2023-01-02] 2023-01-02: rebuilt 16 hours of the index in 192898 ms [load_day 2023-01-02] 2023-01-02 hour 16: 172038 events in 4 files, snapshot 4473126361874795262 (task 15145 ms: download 4492 ms overlapping gunzip 1348 ms, parse 5300 ms, sort 391 ms, write 7437 ms, index 544 ms: 5 candidates, 71290 repo-hours, 828 releases; waiting 17 ms; commit 472 ms) [load_day 2023-01-02] 2023-01-02 hour 17: 167120 events in 4 files, snapshot 871182775636974131 (task 15738 ms: download 5008 ms overlapping gunzip 1428 ms, parse 5852 ms, sort 659 ms, write 7264 ms, index 422 ms: 11 candidates, 66434 repo-hours, 863 releases; waiting 43 ms; commit 397 ms) [load_day 2023-01-02] 2023-01-02 hour 18: 163468 events in 4 files, snapshot 7023384001925207164 (task 15407 ms: download 3280 ms overlapping gunzip 1282 ms, parse 5046 ms, sort 563 ms, write 7973 ms, index 455 ms: 6 candidates, 67404 repo-hours, 845 releases; waiting 24 ms; commit 535 ms) [load_day 2023-01-02] 2023-01-02 hour 19: 152868 events in 4 files, snapshot 9063159474114970265 (task 14958 ms: download 4004 ms overlapping gunzip 1205 ms, parse 4805 ms, sort 448 ms, write 7905 ms, index 482 ms: 6 candidates, 58997 repo-hours, 840 releases; waiting 38 ms; commit 429 ms) [load_day 2023-01-02] 2023-01-02 hour 20: 152111 events in 4 files, snapshot 2219742520369518777 (task 13042 ms: download 2909 ms overlapping gunzip 1269 ms, parse 4752 ms, sort 270 ms, write 6250 ms, index 424 ms: 1 candidates, 58910 repo-hours, 797 releases; waiting 18 ms; commit 591 ms) [load_day 2023-01-02] 2023-01-02 hour 21: 150773 events in 4 files, snapshot 6940775111159622619 (task 13590 ms: download 3142 ms overlapping gunzip 1423 ms, parse 5239 ms, sort 257 ms, write 6269 ms, index 320 ms: 4 candidates, 55031 repo-hours, 830 releases; waiting 15 ms; commit 550 ms) [load_day 2023-01-02] 2023-01-02 hour 22: 135883 events in 3 files, snapshot 838677795167931137 (task 12946 ms: download 3335 ms overlapping gunzip 1508 ms, parse 5985 ms, sort 250 ms, write 4739 ms, index 360 ms: 2 candidates, 49840 repo-hours, 789 releases; waiting 19 ms; commit 432 ms) [load_day 2023-01-02] 2023-01-02 hour 23: 127112 events in 3 files, snapshot 7128341358294698966 (task 11705 ms: download 3243 ms overlapping gunzip 1256 ms, parse 4980 ms, sort 257 ms, write 4472 ms, index 639 ms: 3 candidates, 48281 repo-hours, 709 releases; waiting 20 ms; commit 415 ms) [load_day 2023-01-02] 2023-01-02: repo_hour merged from 24 files to 1 (1417028 rows, 5549 ms) [load_day 2023-01-02] 2023-01-02: index committed in 7191 ms (24 + 1 + 24 files) [load_day 2023-01-02] 2023-01-02: 1221373 events in 8 hours load_day 2023-01-02 succeeded after 2 attempts run succeeded