orcaLog in

Runs · run 633

load_day 2026-04-21, attempt 1 succeeded

Host
4e84322b8c45:154363
Started
2026-11-07T12:43:23Z
Ended
2026-11-07T12:44:46Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/633/load_day/2026-04-21/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T12:43:23Z [load_day 2026-04-21] attempt 1 started
2026-11-07T12:43:33Z [load_day 2026-04-21] 2026-04-21 hour 0: 141629 events in 3 files, snapshot 8535358195753222478 (task 5498 ms: download 1716 ms overlapping gunzip 369 ms, parse 1221 ms, sort 132 ms, write 2391 ms, index 475 ms: 10 candidates, 69240 repo-hours, 731 releases; waiting 533 ms; commit 1763 ms)
2026-11-07T12:43:35Z [load_day 2026-04-21] 2026-04-21 hour 1: 148491 events in 3 files, snapshot 9176179256499101536 (task 5754 ms: download 2056 ms overlapping gunzip 316 ms, parse 1106 ms, sort 148 ms, write 2168 ms, index 542 ms: 8 candidates, 82149 repo-hours, 748 releases; waiting 1119 ms; commit 1968 ms)
2026-11-07T12:43:37Z [load_day 2026-04-21] 2026-04-21 hour 2: 147846 events in 3 files, snapshot 346620583826661457 (task 4939 ms: download 1991 ms overlapping gunzip 286 ms, parse 969 ms, sort 120 ms, write 2070 ms, index 596 ms: 9 candidates, 86830 repo-hours, 559 releases; waiting 553 ms; commit 1058 ms)
2026-11-07T12:43:40Z [load_day 2026-04-21] 2026-04-21 hour 3: 146599 events in 3 files, snapshot 8037289665112419404 (task 5105 ms: download 1845 ms overlapping gunzip 319 ms, parse 1100 ms, sort 151 ms, write 2054 ms, index 543 ms: 10 candidates, 79603 repo-hours, 646 releases; waiting 586 ms; commit 1211 ms)
2026-11-07T12:43:44Z [load_day 2026-04-21] 2026-04-21 hour 4: 140814 events in 3 files, snapshot 8752090126621324495 (task 5297 ms: download 1951 ms overlapping gunzip 355 ms, parse 1110 ms, sort 122 ms, write 2415 ms, index 460 ms: 4 candidates, 70349 repo-hours, 938 releases; waiting 515 ms; commit 1233 ms)
2026-11-07T12:43:46Z [load_day 2026-04-21] 2026-04-21 hour 5: 143683 events in 3 files, snapshot 4397263488446827339 (task 5098 ms: download 2039 ms overlapping gunzip 317 ms, parse 1035 ms, sort 133 ms, write 2152 ms, index 524 ms: 10 candidates, 73405 repo-hours, 819 releases; waiting 601 ms; commit 969 ms)
2026-11-07T12:43:49Z [load_day 2026-04-21] 2026-04-21 hour 6: 151717 events in 4 files, snapshot 367670263655490345 (task 4918 ms: download 2106 ms overlapping gunzip 287 ms, parse 984 ms, sort 133 ms, write 2012 ms, index 542 ms: 10 candidates, 82682 repo-hours, 545 releases; waiting 589 ms; commit 1312 ms)
2026-11-07T12:43:51Z [load_day 2026-04-21] 2026-04-21 hour 7: 154487 events in 4 files, snapshot 8237662395426665310 (task 4520 ms: download 1645 ms overlapping gunzip 276 ms, parse 921 ms, sort 114 ms, write 1738 ms, index 586 ms: 5 candidates, 85758 repo-hours, 294 releases; waiting 561 ms; commit 1175 ms)
2026-11-07T12:43:54Z [load_day 2026-04-21] 2026-04-21 hour 8: 148293 events in 3 files, snapshot 4966814227966913020 (task 4616 ms: download 1389 ms overlapping gunzip 233 ms, parse 809 ms, sort 124 ms, write 1971 ms, index 608 ms: 6 candidates, 81920 repo-hours, 230 releases; waiting 555 ms; commit 1109 ms)
2026-11-07T12:43:56Z [load_day 2026-04-21] 2026-04-21 hour 9: 153759 events in 4 files, snapshot 702548986100031354 (task 4519 ms: download 1534 ms overlapping gunzip 239 ms, parse 830 ms, sort 138 ms, write 1850 ms, index 611 ms: 9 candidates, 86735 repo-hours, 196 releases; waiting 539 ms; commit 1229 ms)
2026-11-07T12:44:00Z [load_day 2026-04-21] 2026-04-21 hour 10: 153040 events in 4 files, snapshot 1285405517332670316 (task 4861 ms: download 1961 ms overlapping gunzip 265 ms, parse 906 ms, sort 145 ms, write 2037 ms, index 597 ms: 4 candidates, 83890 repo-hours, 337 releases; waiting 608 ms; commit 1327 ms)
2026-11-07T12:44:02Z [load_day 2026-04-21] 2026-04-21 hour 11: 151855 events in 4 files, snapshot 2980862344700030193 (task 5066 ms: download 1607 ms overlapping gunzip 282 ms, parse 931 ms, sort 128 ms, write 1958 ms, index 660 ms: 11 candidates, 84183 repo-hours, 294 releases; waiting 534 ms; commit 1282 ms)
2026-11-07T12:44:05Z [load_day 2026-04-21] 2026-04-21 hour 12: 156136 events in 4 files, snapshot 4616938335391835086 (task 4553 ms: download 1584 ms overlapping gunzip 235 ms, parse 838 ms, sort 119 ms, write 1843 ms, index 667 ms: 13 candidates, 89347 repo-hours, 174 releases; waiting 532 ms; commit 1187 ms)
2026-11-07T12:44:07Z [load_day 2026-04-21] 2026-04-21 hour 13: 155127 events in 4 files, snapshot 6676579162527498987 (task 4096 ms: download 1327 ms overlapping gunzip 221 ms, parse 791 ms, sort 108 ms, write 1549 ms, index 637 ms: 12 candidates, 97364 repo-hours, 52 releases; waiting 523 ms; commit 1295 ms)
2026-11-07T12:44:11Z [load_day 2026-04-21] 2026-04-21 hour 14: 150902 events in 4 files, snapshot 5174813380750822337 (task 4276 ms: download 1402 ms overlapping gunzip 216 ms, parse 773 ms, sort 117 ms, write 1639 ms, index 654 ms: 9 candidates, 87420 repo-hours, 73 releases; waiting 531 ms; commit 1323 ms)
2026-11-07T12:44:12Z [load_day 2026-04-21] 2026-04-21 hour 15: 152808 events in 4 files, snapshot 5584647629534435632 (task 4219 ms: download 1449 ms overlapping gunzip 222 ms, parse 775 ms, sort 116 ms, write 1633 ms, index 612 ms: 9 candidates, 87962 repo-hours, 121 releases; waiting 542 ms; commit 1113 ms)
2026-11-07T12:44:15Z [load_day 2026-04-21] 2026-04-21 hour 16: 151187 events in 4 files, snapshot 3557216550502465519 (task 4119 ms: download 1441 ms overlapping gunzip 211 ms, parse 768 ms, sort 121 ms, write 1577 ms, index 605 ms: 9 candidates, 86030 repo-hours, 94 releases; waiting 509 ms; commit 1223 ms)
2026-11-07T12:44:18Z [load_day 2026-04-21] 2026-04-21 hour 17: 155930 events in 4 files, snapshot 1128972681252532412 (task 4652 ms: download 1407 ms overlapping gunzip 238 ms, parse 834 ms, sort 127 ms, write 1941 ms, index 652 ms: 9 candidates, 85943 repo-hours, 167 releases; waiting 553 ms; commit 1386 ms)
2026-11-07T12:44:21Z [load_day 2026-04-21] 2026-04-21 hour 18: 153561 events in 4 files, snapshot 3226198405525189073 (task 4703 ms: download 1467 ms overlapping gunzip 252 ms, parse 881 ms, sort 152 ms, write 1965 ms, index 633 ms: 10 candidates, 86087 repo-hours, 219 releases; waiting 553 ms; commit 1316 ms)
2026-11-07T12:44:23Z [load_day 2026-04-21] 2026-04-21 hour 19: 157017 events in 4 files, snapshot 193077134635583680 (task 4985 ms: download 2033 ms overlapping gunzip 272 ms, parse 967 ms, sort 193 ms, write 2021 ms, index 617 ms: 8 candidates, 87037 repo-hours, 270 releases; waiting 546 ms; commit 1266 ms)
2026-11-07T12:44:26Z [load_day 2026-04-21] 2026-04-21 hour 20: 155271 events in 4 files, snapshot 5075215727743019937 (task 4864 ms: download 1778 ms overlapping gunzip 283 ms, parse 933 ms, sort 140 ms, write 2104 ms, index 562 ms: 5 candidates, 81619 repo-hours, 275 releases; waiting 532 ms; commit 988 ms)
2026-11-07T12:44:29Z [load_day 2026-04-21] 2026-04-21 hour 21: 153135 events in 4 files, snapshot 7069640856587506777 (task 4929 ms: download 1436 ms overlapping gunzip 324 ms, parse 1097 ms, sort 153 ms, write 2354 ms, index 553 ms: 7 candidates, 78669 repo-hours, 428 releases; waiting 222 ms; commit 1956 ms)
2026-11-07T12:44:33Z [load_day 2026-04-21] 2026-04-21 hour 22: 152637 events in 4 files, snapshot 3707270976823837146 (task 6038 ms: download 1649 ms overlapping gunzip 351 ms, parse 1161 ms, sort 184 ms, write 2987 ms, index 529 ms: 9 candidates, 77412 repo-hours, 481 releases; waiting 519 ms; commit 1182 ms)
2026-11-07T12:44:36Z [load_day 2026-04-21] 2026-04-21 hour 23: 145973 events in 3 files, snapshot 2196018933482535740 (task 5697 ms: download 1611 ms overlapping gunzip 363 ms, parse 1215 ms, sort 144 ms, write 2699 ms, index 514 ms: 5 candidates, 72415 repo-hours, 817 releases; waiting 277 ms; commit 1242 ms)
2026-11-07T12:44:44Z [load_day 2026-04-21] 2026-04-21: repo_hour merged from 24 files to 1 (1984049 rows, 8276 ms)
2026-11-07T12:44:46Z [load_day 2026-04-21] 2026-04-21: index committed in 10187 ms (24 + 1 + 24 files)
2026-11-07T12:44:46Z [load_day 2026-04-21] 2026-04-21: 3621897 events in 24 hours
2026-11-07T12:44:46Z [load_day 2026-04-21] attempt 1 succeeded