orcaLog in

Runs · run 590

load_day 2026-05-05, attempt 1 succeeded

Host
4e84322b8c45:132405
Started
2026-11-07T06:41:28Z
Ended
2026-11-07T06:42:45Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/590/load_day/2026-05-05/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:41:28Z [load_day 2026-05-05] attempt 1 started
2026-11-07T06:41:37Z [load_day 2026-05-05] 2026-05-05 hour 0: 141872 events in 3 files, snapshot 2910888193599746478 (task 5845 ms: download 2112 ms overlapping gunzip 353 ms, parse 1193 ms, sort 147 ms, write 2878 ms, index 428 ms: 4 candidates, 67312 repo-hours, 625 releases; waiting 523 ms; commit 961 ms)
2026-11-07T06:41:38Z [load_day 2026-05-05] 2026-05-05 hour 1: 145710 events in 3 files, snapshot 5252388827355742284 (task 5952 ms: download 2282 ms overlapping gunzip 324 ms, parse 1110 ms, sort 158 ms, write 2880 ms, index 458 ms: 6 candidates, 73409 repo-hours, 468 releases; waiting 683 ms; commit 960 ms)
2026-11-07T06:41:43Z [load_day 2026-05-05] 2026-05-05 hour 2: 153242 events in 4 files, snapshot 1675974710810789701 (task 5055 ms: download 1745 ms overlapping gunzip 288 ms, parse 952 ms, sort 120 ms, write 2249 ms, index 525 ms: 6 candidates, 84663 repo-hours, 317 releases; waiting 538 ms; commit 1290 ms)
2026-11-07T06:41:44Z [load_day 2026-05-05] 2026-05-05 hour 3: 149725 events in 3 files, snapshot 8913400695076932897 (task 5365 ms: download 1901 ms overlapping gunzip 336 ms, parse 1164 ms, sort 122 ms, write 2425 ms, index 495 ms: 8 candidates, 75422 repo-hours, 522 releases; waiting 554 ms; commit 1121 ms)
2026-11-07T06:41:49Z [load_day 2026-05-05] 2026-05-05 hour 4: 150321 events in 4 files, snapshot 2474562341679719671 (task 5839 ms: download 2295 ms overlapping gunzip 449 ms, parse 1439 ms, sort 142 ms, write 2363 ms, index 470 ms: 7 candidates, 68451 repo-hours, 738 releases; waiting 630 ms; commit 1133 ms)
2026-11-07T06:41:50Z [load_day 2026-05-05] 2026-05-05 hour 5: 146984 events in 3 files, snapshot 6585406422088333815 (task 5225 ms: download 1804 ms overlapping gunzip 344 ms, parse 1158 ms, sort 141 ms, write 2346 ms, index 464 ms: 5 candidates, 70706 repo-hours, 647 releases; waiting 497 ms; commit 1141 ms)
2026-11-07T06:41:55Z [load_day 2026-05-05] 2026-05-05 hour 6: 155525 events in 4 files, snapshot 5870097040914812012 (task 4936 ms: download 1896 ms overlapping gunzip 295 ms, parse 952 ms, sort 109 ms, write 2093 ms, index 597 ms: 3 candidates, 77602 repo-hours, 414 releases; waiting 560 ms; commit 1187 ms)
2026-11-07T06:41:56Z [load_day 2026-05-05] 2026-05-05 hour 7: 155471 events in 4 files, snapshot 4358373879023630652 (task 4287 ms: download 1435 ms overlapping gunzip 231 ms, parse 825 ms, sort 108 ms, write 1780 ms, index 496 ms: 2 candidates, 76623 repo-hours, 171 releases; waiting 550 ms; commit 1223 ms)
2026-11-07T06:42:00Z [load_day 2026-05-05] 2026-05-05 hour 8: 151509 events in 4 files, snapshot 6272015308900760756 (task 4313 ms: download 1910 ms overlapping gunzip 273 ms, parse 914 ms, sort 117 ms, write 1631 ms, index 505 ms: 7 candidates, 79817 repo-hours, 193 releases; waiting 530 ms; commit 1223 ms)
2026-11-07T06:42:01Z [load_day 2026-05-05] 2026-05-05 hour 9: 153236 events in 4 files, snapshot 2856775229779262435 (task 4285 ms: download 1385 ms overlapping gunzip 265 ms, parse 915 ms, sort 100 ms, write 1599 ms, index 564 ms: 6 candidates, 81692 repo-hours, 175 releases; waiting 499 ms; commit 1090 ms)
2026-11-07T06:42:05Z [load_day 2026-05-05] 2026-05-05 hour 10: 155346 events in 4 files, snapshot 8725301168997179386 (task 4485 ms: download 1828 ms overlapping gunzip 246 ms, parse 844 ms, sort 108 ms, write 1913 ms, index 526 ms: 7 candidates, 81855 repo-hours, 160 releases; waiting 537 ms; commit 1222 ms)
2026-11-07T06:42:06Z [load_day 2026-05-05] 2026-05-05 hour 11: 156156 events in 4 files, snapshot 4050278460158657347 (task 4168 ms: download 1380 ms overlapping gunzip 222 ms, parse 788 ms, sort 114 ms, write 1737 ms, index 536 ms: 9 candidates, 83592 repo-hours, 114 releases; waiting 528 ms; commit 1061 ms)
2026-11-07T06:42:10Z [load_day 2026-05-05] 2026-05-05 hour 12: 155652 events in 4 files, snapshot 380798067308457972 (task 4168 ms: download 1722 ms overlapping gunzip 227 ms, parse 803 ms, sort 108 ms, write 1589 ms, index 562 ms: 8 candidates, 83927 repo-hours, 123 releases; waiting 537 ms; commit 1033 ms)
2026-11-07T06:42:11Z [load_day 2026-05-05] 2026-05-05 hour 13: 150569 events in 4 files, snapshot 7916204651122345996 (task 3829 ms: download 1424 ms overlapping gunzip 206 ms, parse 789 ms, sort 110 ms, write 1344 ms, index 555 ms: 7 candidates, 85064 repo-hours, 68 releases; waiting 501 ms; commit 1073 ms)
2026-11-07T06:42:15Z [load_day 2026-05-05] 2026-05-05 hour 14: 150715 events in 4 files, snapshot 2523465836152413797 (task 4445 ms: download 1686 ms overlapping gunzip 209 ms, parse 766 ms, sort 99 ms, write 1694 ms, index 538 ms: 4 candidates, 80666 repo-hours, 82 releases; waiting 533 ms; commit 1171 ms)
2026-11-07T06:42:16Z [load_day 2026-05-05] 2026-05-05 hour 15: 150403 events in 4 files, snapshot 4495259612214498645 (task 4069 ms: download 1550 ms overlapping gunzip 208 ms, parse 761 ms, sort 99 ms, write 1602 ms, index 585 ms: 12 candidates, 77646 repo-hours, 83 releases; waiting 528 ms; commit 1091 ms)
2026-11-07T06:42:19Z [load_day 2026-05-05] 2026-05-05 hour 16: 152961 events in 4 files, snapshot 7421444247418698685 (task 4145 ms: download 1735 ms overlapping gunzip 214 ms, parse 794 ms, sort 118 ms, write 1635 ms, index 586 ms: 9 candidates, 79400 repo-hours, 77 releases; waiting 523 ms; commit 1112 ms)
2026-11-07T06:42:21Z [load_day 2026-05-05] 2026-05-05 hour 17: 155357 events in 4 files, snapshot 1367426600045070022 (task 4123 ms: download 1651 ms overlapping gunzip 219 ms, parse 805 ms, sort 111 ms, write 1582 ms, index 584 ms: 10 candidates, 82401 repo-hours, 105 releases; waiting 537 ms; commit 1433 ms)
2026-11-07T06:42:24Z [load_day 2026-05-05] 2026-05-05 hour 18: 155570 events in 4 files, snapshot 5179592337864565090 (task 4055 ms: download 1634 ms overlapping gunzip 237 ms, parse 805 ms, sort 105 ms, write 1518 ms, index 549 ms: 13 candidates, 80933 repo-hours, 85 releases; waiting 534 ms; commit 995 ms)
2026-11-07T06:42:25Z [load_day 2026-05-05] 2026-05-05 hour 19: 152422 events in 4 files, snapshot 9011022804397290457 (task 3931 ms: download 1592 ms overlapping gunzip 225 ms, parse 825 ms, sort 109 ms, write 1387 ms, index 514 ms: 6 candidates, 76007 repo-hours, 56 releases; waiting 512 ms; commit 1157 ms)
2026-11-07T06:42:29Z [load_day 2026-05-05] 2026-05-05 hour 20: 148721 events in 3 files, snapshot 4530467681848906347 (task 4267 ms: download 1498 ms overlapping gunzip 251 ms, parse 872 ms, sort 124 ms, write 1711 ms, index 514 ms: 8 candidates, 73745 repo-hours, 164 releases; waiting 522 ms; commit 1225 ms)
2026-11-07T06:42:30Z [load_day 2026-05-05] 2026-05-05 hour 21: 148633 events in 3 files, snapshot 8571514737021191088 (task 4245 ms: download 1702 ms overlapping gunzip 250 ms, parse 866 ms, sort 128 ms, write 1713 ms, index 472 ms: 17 candidates, 72033 repo-hours, 285 releases; waiting 514 ms; commit 1250 ms)
2026-11-07T06:42:35Z [load_day 2026-05-05] 2026-05-05 hour 22: 148285 events in 3 files, snapshot 6383530026599861093 (task 4850 ms: download 1861 ms overlapping gunzip 293 ms, parse 1013 ms, sort 124 ms, write 2055 ms, index 490 ms: 7 candidates, 71635 repo-hours, 325 releases; waiting 526 ms; commit 1233 ms)
2026-11-07T06:42:36Z [load_day 2026-05-05] 2026-05-05 hour 23: 148475 events in 3 files, snapshot 6445909725549468816 (task 4885 ms: download 1674 ms overlapping gunzip 295 ms, parse 1001 ms, sort 128 ms, write 2168 ms, index 463 ms: 4 candidates, 70535 repo-hours, 493 releases; waiting 539 ms; commit 931 ms)
2026-11-07T06:42:43Z [load_day 2026-05-05] 2026-05-05: repo_hour merged from 24 files to 1 (1855136 rows, 7689 ms)
2026-11-07T06:42:45Z [load_day 2026-05-05] 2026-05-05: index committed in 9539 ms (24 + 1 + 24 files)
2026-11-07T06:42:45Z [load_day 2026-05-05] 2026-05-05: 3632860 events in 24 hours
2026-11-07T06:42:45Z [load_day 2026-05-05] attempt 1 succeeded