orcaLog in

Runs · run 230

load_day 2026-09-02, attempt 1 succeeded

Host
4e84322b8c45:39125
Started
2026-11-07T04:19:48Z
Ended
2026-11-07T04:20:15Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/230/load_day/2026-09-02/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:19:48Z [load_day 2026-09-02] attempt 1 started
2026-11-07T04:19:51Z [load_day 2026-09-02] 2026-09-02 hour 0: 1551 events in 1 files, snapshot 3245972841859918678 (task 1148 ms: download 597 ms overlapping gunzip 20 ms, parse 70 ms, sort 1 ms, write 206 ms, index 39 ms: 1 candidates, 1403 repo-hours, 53 releases; waiting 515 ms; commit 671 ms)
2026-11-07T04:19:52Z [load_day 2026-09-02] 2026-09-02 hour 1: 1450 events in 1 files, snapshot 1089997321554987679 (task 1057 ms: download 537 ms overlapping gunzip 17 ms, parse 58 ms, sort 1 ms, write 187 ms, index 27 ms: 0 candidates, 1322 repo-hours, 44 releases; waiting 473 ms; commit 769 ms)
2026-11-07T04:19:53Z [load_day 2026-09-02] 2026-09-02 hour 2: 1528 events in 1 files, snapshot 7235444898940449819 (task 1065 ms: download 462 ms overlapping gunzip 18 ms, parse 58 ms, sort 1 ms, write 186 ms, index 30 ms: 0 candidates, 1407 repo-hours, 38 releases; waiting 395 ms; commit 782 ms)
2026-11-07T04:19:53Z [load_day 2026-09-02] 2026-09-02 hour 3: 1398 events in 1 files, snapshot 7920785177824271389 (task 1078 ms: download 584 ms overlapping gunzip 24 ms, parse 69 ms, sort 1 ms, write 195 ms, index 31 ms: 0 candidates, 1266 repo-hours, 29 releases; waiting 507 ms; commit 595 ms)
2026-11-07T04:19:55Z [load_day 2026-09-02] 2026-09-02 hour 4: 1517 events in 1 files, snapshot 470983763806044755 (task 1194 ms: download 548 ms overlapping gunzip 21 ms, parse 63 ms, sort 2 ms, write 213 ms, index 52 ms: 0 candidates, 1360 repo-hours, 36 releases; waiting 476 ms; commit 752 ms)
2026-11-07T04:19:55Z [load_day 2026-09-02] 2026-09-02 hour 5: 1479 events in 1 files, snapshot 8973441145974296738 (task 1116 ms: download 591 ms overlapping gunzip 19 ms, parse 56 ms, sort 1 ms, write 197 ms, index 31 ms: 0 candidates, 1367 repo-hours, 40 releases; waiting 525 ms; commit 636 ms)
2026-11-07T04:19:56Z [load_day 2026-09-02] 2026-09-02 hour 6: 1328 events in 1 files, snapshot 5987291041603726239 (task 1272 ms: download 572 ms overlapping gunzip 17 ms, parse 50 ms, sort 1 ms, write 184 ms, index 28 ms: 0 candidates, 1223 repo-hours, 30 releases; waiting 514 ms; commit 634 ms)
2026-11-07T04:19:57Z [load_day 2026-09-02] 2026-09-02 hour 7: 1463 events in 1 files, snapshot 603400703238599259 (task 692 ms: download 230 ms overlapping gunzip 14 ms, parse 39 ms, sort 1 ms, write 181 ms, index 27 ms: 0 candidates, 1375 repo-hours, 38 releases; waiting 188 ms; commit 636 ms)
2026-11-07T04:19:58Z [load_day 2026-09-02] 2026-09-02 hour 8: 1711 events in 1 files, snapshot 5919749406902129927 (task 1187 ms: download 621 ms overlapping gunzip 24 ms, parse 64 ms, sort 1 ms, write 224 ms, index 28 ms: 0 candidates, 1595 repo-hours, 53 releases; waiting 542 ms; commit 780 ms)
2026-11-07T04:19:59Z [load_day 2026-09-02] 2026-09-02 hour 9: 1550 events in 1 files, snapshot 6461285624577164025 (task 926 ms: download 462 ms overlapping gunzip 19 ms, parse 55 ms, sort 1 ms, write 178 ms, index 26 ms: 0 candidates, 1410 repo-hours, 36 releases; waiting 396 ms; commit 708 ms)
2026-11-07T04:20:00Z [load_day 2026-09-02] 2026-09-02 hour 10: 1712 events in 1 files, snapshot 6957578330094375479 (task 1080 ms: download 612 ms overlapping gunzip 20 ms, parse 57 ms, sort 1 ms, write 204 ms, index 40 ms: 2 candidates, 1553 repo-hours, 51 releases; waiting 542 ms; commit 625 ms)
2026-11-07T04:20:01Z [load_day 2026-09-02] 2026-09-02 hour 11: 1619 events in 1 files, snapshot 5951842036959736151 (task 1169 ms: download 612 ms overlapping gunzip 21 ms, parse 60 ms, sort 2 ms, write 204 ms, index 37 ms: 0 candidates, 1477 repo-hours, 48 releases; waiting 543 ms; commit 810 ms)
2026-11-07T04:20:02Z [load_day 2026-09-02] 2026-09-02 hour 12: 2138 events in 1 files, snapshot 32658767055662143 (task 555 ms: download 55 ms overlapping gunzip 18 ms, parse 54 ms, sort 2 ms, write 224 ms, index 51 ms: 1 candidates, 1929 repo-hours, 59 releases; waiting 18 ms; commit 897 ms)
2026-11-07T04:20:03Z [load_day 2026-09-02] 2026-09-02 hour 13: 2287 events in 1 files, snapshot 7352689711490464534 (task 1346 ms: download 653 ms overlapping gunzip 28 ms, parse 85 ms, sort 3 ms, write 295 ms, index 30 ms: 0 candidates, 2089 repo-hours, 82 releases; waiting 554 ms; commit 850 ms)
2026-11-07T04:20:04Z [load_day 2026-09-02] 2026-09-02 hour 14: 1942 events in 1 files, snapshot 7014618372356600920 (task 1191 ms: download 644 ms overlapping gunzip 25 ms, parse 78 ms, sort 2 ms, write 203 ms, index 40 ms: 1 candidates, 1814 repo-hours, 69 releases; waiting 558 ms; commit 839 ms)
2026-11-07T04:20:05Z [load_day 2026-09-02] 2026-09-02 hour 15: 1797 events in 1 files, snapshot 7247272688684126921 (task 1196 ms: download 641 ms overlapping gunzip 26 ms, parse 69 ms, sort 2 ms, write 239 ms, index 46 ms: 0 candidates, 1655 repo-hours, 42 releases; waiting 556 ms; commit 872 ms)
2026-11-07T04:20:05Z [load_day 2026-09-02] 2026-09-02 hour 16: 2266 events in 1 files, snapshot 7057681803846521110 (task 1265 ms: download 658 ms overlapping gunzip 28 ms, parse 88 ms, sort 3 ms, write 245 ms, index 31 ms: 0 candidates, 2069 repo-hours, 66 releases; waiting 552 ms; commit 716 ms)
2026-11-07T04:20:06Z [load_day 2026-09-02] 2026-09-02 hour 17: 2177 events in 1 files, snapshot 6251382352559019386 (task 1045 ms: download 511 ms overlapping gunzip 26 ms, parse 84 ms, sort 3 ms, write 254 ms, index 41 ms: 1 candidates, 2009 repo-hours, 51 releases; waiting 413 ms; commit 767 ms)
2026-11-07T04:20:07Z [load_day 2026-09-02] 2026-09-02 hour 18: 1947 events in 1 files, snapshot 4485200568588979697 (task 1234 ms: download 653 ms overlapping gunzip 27 ms, parse 83 ms, sort 2 ms, write 241 ms, index 46 ms: 2 candidates, 1786 repo-hours, 52 releases; waiting 554 ms; commit 858 ms)
2026-11-07T04:20:08Z [load_day 2026-09-02] 2026-09-02 hour 19: 1981 events in 1 files, snapshot 240685587042909960 (task 1327 ms: download 645 ms overlapping gunzip 26 ms, parse 74 ms, sort 2 ms, write 234 ms, index 29 ms: 0 candidates, 1819 repo-hours, 60 releases; waiting 558 ms; commit 890 ms)
2026-11-07T04:20:09Z [load_day 2026-09-02] 2026-09-02 hour 20: 2789 events in 1 files, snapshot 2866389586983324122 (task 1365 ms: download 698 ms overlapping gunzip 36 ms, parse 107 ms, sort 3 ms, write 268 ms, index 73 ms: 1 candidates, 2477 repo-hours, 63 releases; waiting 563 ms; commit 873 ms)
2026-11-07T04:20:10Z [load_day 2026-09-02] 2026-09-02 hour 21: 2944 events in 1 files, snapshot 1114383356279267293 (task 1250 ms: download 698 ms overlapping gunzip 36 ms, parse 102 ms, sort 3 ms, write 280 ms, index 45 ms: 2 candidates, 2617 repo-hours, 69 releases; waiting 569 ms; commit 803 ms)
2026-11-07T04:20:11Z [load_day 2026-09-02] 2026-09-02 hour 22: 2530 events in 1 files, snapshot 3621437213382675175 (task 1317 ms: download 671 ms overlapping gunzip 30 ms, parse 89 ms, sort 2 ms, write 250 ms, index 87 ms: 1 candidates, 2253 repo-hours, 62 releases; waiting 560 ms; commit 782 ms)
2026-11-07T04:20:12Z [load_day 2026-09-02] 2026-09-02 hour 23: 2867 events in 1 files, snapshot 8261396638918064804 (task 1306 ms: download 684 ms overlapping gunzip 34 ms, parse 98 ms, sort 3 ms, write 265 ms, index 31 ms: 0 candidates, 2546 repo-hours, 64 releases; waiting 569 ms; commit 723 ms)
2026-11-07T04:20:14Z [load_day 2026-09-02] 2026-09-02: repo_hour merged from 24 files to 1 (41821 rows, 1290 ms)
2026-11-07T04:20:15Z [load_day 2026-09-02] 2026-09-02: index committed in 3043 ms (9 + 1 + 24 files)
2026-11-07T04:20:15Z [load_day 2026-09-02] 2026-09-02: 45971 events in 24 hours
2026-11-07T04:20:15Z [load_day 2026-09-02] attempt 1 succeeded