orcaLog in

Runs · run 473

load_day 2026-06-13, attempt 1 succeeded

Host
4e84322b8c45:100909
Started
2026-11-07T05:50:26Z
Ended
2026-11-07T05:51:38Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/473/load_day/2026-06-13/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:50:26Z [load_day 2026-06-13] attempt 1 started
2026-11-07T05:50:34Z [load_day 2026-06-13] 2026-06-13 hour 0: 150783 events in 4 files, snapshot 8322728604658873812 (task 4917 ms: download 1501 ms overlapping gunzip 332 ms, parse 1099 ms, sort 128 ms, write 2105 ms, index 451 ms: 4 candidates, 69884 repo-hours, 502 releases; waiting 531 ms; commit 1103 ms)
2026-11-07T05:50:35Z [load_day 2026-06-13] 2026-06-13 hour 1: 146884 events in 3 files, snapshot 6947217234901810045 (task 4957 ms: download 2032 ms overlapping gunzip 344 ms, parse 1196 ms, sort 150 ms, write 1951 ms, index 409 ms: 7 candidates, 65604 repo-hours, 535 releases; waiting 528 ms; commit 977 ms)
2026-11-07T05:50:39Z [load_day 2026-06-13] 2026-06-13 hour 2: 155942 events in 4 files, snapshot 3639234152215897634 (task 4288 ms: download 1316 ms overlapping gunzip 278 ms, parse 907 ms, sort 116 ms, write 1695 ms, index 500 ms: 6 candidates, 82225 repo-hours, 236 releases; waiting 573 ms; commit 1138 ms)
2026-11-07T05:50:40Z [load_day 2026-06-13] 2026-06-13 hour 3: 159651 events in 4 files, snapshot 44486766759032795 (task 4177 ms: download 1546 ms overlapping gunzip 247 ms, parse 856 ms, sort 107 ms, write 1478 ms, index 492 ms: 7 candidates, 76068 repo-hours, 132 releases; waiting 794 ms; commit 1037 ms)
2026-11-07T05:50:44Z [load_day 2026-06-13] 2026-06-13 hour 4: 162276 events in 4 files, snapshot 337221430946374237 (task 4143 ms: download 1265 ms overlapping gunzip 261 ms, parse 867 ms, sort 111 ms, write 1673 ms, index 490 ms: 4 candidates, 77951 repo-hours, 233 releases; waiting 522 ms; commit 997 ms)
2026-11-07T05:50:45Z [load_day 2026-06-13] 2026-06-13 hour 5: 157402 events in 4 files, snapshot 3963735311513279124 (task 4259 ms: download 1571 ms overlapping gunzip 265 ms, parse 965 ms, sort 122 ms, write 1666 ms, index 394 ms: 8 candidates, 65332 repo-hours, 252 releases; waiting 535 ms; commit 827 ms)
2026-11-07T05:50:48Z [load_day 2026-06-13] 2026-06-13 hour 6: 161973 events in 4 files, snapshot 8871649293754347207 (task 4157 ms: download 1540 ms overlapping gunzip 250 ms, parse 930 ms, sort 148 ms, write 1534 ms, index 479 ms: 5 candidates, 69169 repo-hours, 197 releases; waiting 539 ms; commit 1019 ms)
2026-11-07T05:50:49Z [load_day 2026-06-13] 2026-06-13 hour 7: 161509 events in 4 files, snapshot 2355392926966655352 (task 3741 ms: download 1336 ms overlapping gunzip 193 ms, parse 742 ms, sort 102 ms, write 1506 ms, index 467 ms: 2 candidates, 68634 repo-hours, 110 releases; waiting 513 ms; commit 917 ms)
2026-11-07T05:50:53Z [load_day 2026-06-13] 2026-06-13 hour 8: 158494 events in 4 files, snapshot 5008064223861804313 (task 4085 ms: download 1331 ms overlapping gunzip 219 ms, parse 816 ms, sort 113 ms, write 1648 ms, index 476 ms: 3 candidates, 71974 repo-hours, 189 releases; waiting 538 ms; commit 1007 ms)
2026-11-07T05:50:54Z [load_day 2026-06-13] 2026-06-13 hour 9: 165943 events in 4 files, snapshot 4308000798131293524 (task 3862 ms: download 1209 ms overlapping gunzip 186 ms, parse 747 ms, sort 103 ms, write 1612 ms, index 490 ms: 7 candidates, 70283 repo-hours, 54 releases; waiting 513 ms; commit 1099 ms)
2026-11-07T05:50:58Z [load_day 2026-06-13] 2026-06-13 hour 10: 163380 events in 4 files, snapshot 8183042941998630091 (task 4001 ms: download 1544 ms overlapping gunzip 220 ms, parse 832 ms, sort 116 ms, write 1479 ms, index 520 ms: 8 candidates, 76059 repo-hours, 108 releases; waiting 529 ms; commit 1105 ms)
2026-11-07T05:50:59Z [load_day 2026-06-13] 2026-06-13 hour 11: 163697 events in 4 files, snapshot 3593981362345076718 (task 3989 ms: download 1517 ms overlapping gunzip 270 ms, parse 879 ms, sort 110 ms, write 1438 ms, index 502 ms: 5 candidates, 76851 repo-hours, 93 releases; waiting 509 ms; commit 1193 ms)
2026-11-07T05:51:02Z [load_day 2026-06-13] 2026-06-13 hour 12: 165944 events in 4 files, snapshot 2431507248286768147 (task 4102 ms: download 1462 ms overlapping gunzip 247 ms, parse 883 ms, sort 111 ms, write 1515 ms, index 501 ms: 6 candidates, 75523 repo-hours, 50 releases; waiting 515 ms; commit 1233 ms)
2026-11-07T05:51:04Z [load_day 2026-06-13] 2026-06-13 hour 13: 164171 events in 4 files, snapshot 5266589788720335304 (task 3918 ms: download 1338 ms overlapping gunzip 198 ms, parse 751 ms, sort 104 ms, write 1466 ms, index 560 ms: 3 candidates, 83652 repo-hours, 43 releases; waiting 539 ms; commit 1142 ms)
2026-11-07T05:51:07Z [load_day 2026-06-13] 2026-06-13 hour 14: 166136 events in 4 files, snapshot 5269630396617724817 (task 4119 ms: download 1308 ms overlapping gunzip 209 ms, parse 792 ms, sort 114 ms, write 1619 ms, index 562 ms: 9 candidates, 82833 repo-hours, 37 releases; waiting 530 ms; commit 1089 ms)
2026-11-07T05:51:08Z [load_day 2026-06-13] 2026-06-13 hour 15: 164338 events in 4 files, snapshot 7839788293062827965 (task 4132 ms: download 1248 ms overlapping gunzip 207 ms, parse 774 ms, sort 106 ms, write 1630 ms, index 520 ms: 10 candidates, 79591 repo-hours, 55 releases; waiting 513 ms; commit 910 ms)
2026-11-07T05:51:12Z [load_day 2026-06-13] 2026-06-13 hour 16: 165351 events in 4 files, snapshot 6523720896285341316 (task 4038 ms: download 1860 ms overlapping gunzip 223 ms, parse 813 ms, sort 104 ms, write 1500 ms, index 567 ms: 13 candidates, 78947 repo-hours, 31 releases; waiting 526 ms; commit 1059 ms)
2026-11-07T05:51:13Z [load_day 2026-06-13] 2026-06-13 hour 17: 163352 events in 4 files, snapshot 7512313942635238704 (task 4153 ms: download 1355 ms overlapping gunzip 203 ms, parse 748 ms, sort 104 ms, write 1651 ms, index 594 ms: 15 candidates, 77658 repo-hours, 46 releases; waiting 530 ms; commit 1087 ms)
2026-11-07T05:51:16Z [load_day 2026-06-13] 2026-06-13 hour 18: 163044 events in 4 files, snapshot 723474169443449783 (task 3760 ms: download 920 ms overlapping gunzip 208 ms, parse 760 ms, sort 112 ms, write 1629 ms, index 560 ms: 8 candidates, 75294 repo-hours, 65 releases; waiting 234 ms; commit 925 ms)
2026-11-07T05:51:18Z [load_day 2026-06-13] 2026-06-13 hour 19: 164998 events in 4 files, snapshot 3885380608532648168 (task 4083 ms: download 1828 ms overlapping gunzip 216 ms, parse 798 ms, sort 107 ms, write 1620 ms, index 534 ms: 8 candidates, 78930 repo-hours, 93 releases; waiting 514 ms; commit 968 ms)
2026-11-07T05:51:21Z [load_day 2026-06-13] 2026-06-13 hour 20: 164348 events in 4 files, snapshot 3312130704649043286 (task 4279 ms: download 1569 ms overlapping gunzip 225 ms, parse 813 ms, sort 110 ms, write 1661 ms, index 494 ms: 8 candidates, 71159 repo-hours, 114 releases; waiting 685 ms; commit 983 ms)
2026-11-07T05:51:23Z [load_day 2026-06-13] 2026-06-13 hour 21: 158049 events in 4 files, snapshot 8107194526148903246 (task 4283 ms: download 1597 ms overlapping gunzip 266 ms, parse 953 ms, sort 119 ms, write 1649 ms, index 450 ms: 2 candidates, 69345 repo-hours, 285 releases; waiting 528 ms; commit 1021 ms)
2026-11-07T05:51:26Z [load_day 2026-06-13] 2026-06-13 hour 22: 158822 events in 4 files, snapshot 5834862760384417140 (task 4701 ms: download 1569 ms overlapping gunzip 303 ms, parse 1015 ms, sort 127 ms, write 1973 ms, index 443 ms: 5 candidates, 66420 repo-hours, 459 releases; waiting 534 ms; commit 1278 ms)
2026-11-07T05:51:29Z [load_day 2026-06-13] 2026-06-13 hour 23: 155614 events in 4 files, snapshot 7111767978403465586 (task 5224 ms: download 2141 ms overlapping gunzip 363 ms, parse 1241 ms, sort 116 ms, write 2227 ms, index 421 ms: 6 candidates, 67044 repo-hours, 753 releases; waiting 527 ms; commit 1024 ms)
2026-11-07T05:51:36Z [load_day 2026-06-13] 2026-06-13: repo_hour merged from 24 files to 1 (1776430 rows, 7013 ms)
2026-11-07T05:51:38Z [load_day 2026-06-13] 2026-06-13: index committed in 8766 ms (24 + 1 + 24 files)
2026-11-07T05:51:38Z [load_day 2026-06-13] 2026-06-13: 3862101 events in 24 hours
2026-11-07T05:51:38Z [load_day 2026-06-13] attempt 1 succeeded