orcaLog in

Runs · run 206

load_day 2026-09-10, attempt 1 succeeded

Host
4e84322b8c45:35623
Started
2026-11-07T04:08:51Z
Ended
2026-11-07T04:09:59Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/206/load_day/2026-09-10/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:08:51Z [load_day 2026-09-10] attempt 1 started
2026-11-07T04:08:57Z [load_day 2026-09-10] 2026-09-10 hour 0: 12267 events in 1 files, snapshot 795454528733662689 (task 2867 ms: download 1058 ms overlapping gunzip 137 ms, parse 497 ms, sort 39 ms, write 1132 ms, index 114 ms: 1 candidates, 9158 repo-hours, 341 releases; waiting 529 ms; commit 807 ms)
2026-11-07T04:08:58Z [load_day 2026-09-10] 2026-09-10 hour 1: 9978 events in 1 files, snapshot 6895638712088168812 (task 2195 ms: download 887 ms overlapping gunzip 99 ms, parse 314 ms, sort 27 ms, write 882 ms, index 68 ms: 5 candidates, 7711 repo-hours, 295 releases; waiting 538 ms; commit 700 ms)
2026-11-07T04:09:00Z [load_day 2026-09-10] 2026-09-10 hour 2: 11727 events in 1 files, snapshot 5413499334844309680 (task 2105 ms: download 893 ms overlapping gunzip 102 ms, parse 284 ms, sort 13 ms, write 724 ms, index 82 ms: 1 candidates, 9261 repo-hours, 296 releases; waiting 622 ms; commit 741 ms)
2026-11-07T04:09:01Z [load_day 2026-09-10] 2026-09-10 hour 3: 18517 events in 1 files, snapshot 7355020671502831296 (task 2370 ms: download 952 ms overlapping gunzip 108 ms, parse 329 ms, sort 34 ms, write 903 ms, index 111 ms: 3 candidates, 14079 repo-hours, 339 releases; waiting 579 ms; commit 686 ms)
2026-11-07T04:09:04Z [load_day 2026-09-10] 2026-09-10 hour 4: 27290 events in 1 files, snapshot 8913432864702210467 (task 3159 ms: download 1386 ms overlapping gunzip 165 ms, parse 466 ms, sort 50 ms, write 1328 ms, index 139 ms: 2 candidates, 18737 repo-hours, 435 releases; waiting 804 ms; commit 919 ms)
2026-11-07T04:09:05Z [load_day 2026-09-10] 2026-09-10 hour 5: 28759 events in 1 files, snapshot 6202739316986606938 (task 2951 ms: download 1044 ms overlapping gunzip 201 ms, parse 582 ms, sort 53 ms, write 1149 ms, index 144 ms: 4 candidates, 19453 repo-hours, 383 releases; waiting 559 ms; commit 692 ms)
2026-11-07T04:09:07Z [load_day 2026-09-10] 2026-09-10 hour 6: 32172 events in 1 files, snapshot 7300493515870275303 (task 2719 ms: download 1158 ms overlapping gunzip 147 ms, parse 414 ms, sort 27 ms, write 1081 ms, index 158 ms: 2 candidates, 20838 repo-hours, 295 releases; waiting 653 ms; commit 660 ms)
2026-11-07T04:09:08Z [load_day 2026-09-10] 2026-09-10 hour 7: 32654 events in 1 files, snapshot 5818042099191601986 (task 2971 ms: download 1103 ms overlapping gunzip 154 ms, parse 451 ms, sort 28 ms, write 1174 ms, index 165 ms: 4 candidates, 22119 repo-hours, 440 releases; waiting 605 ms; commit 590 ms)
2026-11-07T04:09:11Z [load_day 2026-09-10] 2026-09-10 hour 8: 36938 events in 1 files, snapshot 6143999858776788191 (task 2852 ms: download 1032 ms overlapping gunzip 150 ms, parse 442 ms, sort 52 ms, write 1170 ms, index 149 ms: 4 candidates, 23525 repo-hours, 367 releases; waiting 553 ms; commit 905 ms)
2026-11-07T04:09:12Z [load_day 2026-09-10] 2026-09-10 hour 9: 37862 events in 1 files, snapshot 4394197639467152279 (task 2918 ms: download 1399 ms overlapping gunzip 121 ms, parse 350 ms, sort 28 ms, write 906 ms, index 150 ms: 3 candidates, 24328 repo-hours, 244 releases; waiting 980 ms; commit 694 ms)
2026-11-07T04:09:14Z [load_day 2026-09-10] 2026-09-10 hour 10: 38753 events in 1 files, snapshot 7670156710749557535 (task 2482 ms: download 1054 ms overlapping gunzip 130 ms, parse 386 ms, sort 29 ms, write 865 ms, index 160 ms: 5 candidates, 25137 repo-hours, 268 releases; waiting 591 ms; commit 682 ms)
2026-11-07T04:09:15Z [load_day 2026-09-10] 2026-09-10 hour 11: 37662 events in 1 files, snapshot 7602132072108286168 (task 2619 ms: download 1042 ms overlapping gunzip 129 ms, parse 387 ms, sort 49 ms, write 961 ms, index 159 ms: 4 candidates, 26069 repo-hours, 279 releases; waiting 578 ms; commit 665 ms)
2026-11-07T04:09:17Z [load_day 2026-09-10] 2026-09-10 hour 12: 38602 events in 1 files, snapshot 8333527594215032462 (task 2598 ms: download 1094 ms overlapping gunzip 132 ms, parse 409 ms, sort 33 ms, write 928 ms, index 177 ms: 2 candidates, 27062 repo-hours, 259 releases; waiting 577 ms; commit 927 ms)
2026-11-07T04:09:18Z [load_day 2026-09-10] 2026-09-10 hour 13: 37824 events in 1 files, snapshot 3214307260949536449 (task 2350 ms: download 963 ms overlapping gunzip 114 ms, parse 342 ms, sort 28 ms, write 825 ms, index 168 ms: 3 candidates, 26290 repo-hours, 263 releases; waiting 568 ms; commit 814 ms)
2026-11-07T04:09:20Z [load_day 2026-09-10] 2026-09-10 hour 14: 37604 events in 1 files, snapshot 6034841326011301678 (task 2330 ms: download 887 ms overlapping gunzip 129 ms, parse 370 ms, sort 28 ms, write 872 ms, index 151 ms: 0 candidates, 26692 repo-hours, 249 releases; waiting 511 ms; commit 870 ms)
2026-11-07T04:09:21Z [load_day 2026-09-10] 2026-09-10 hour 15: 36654 events in 1 files, snapshot 4154815597334237854 (task 2415 ms: download 965 ms overlapping gunzip 118 ms, parse 363 ms, sort 45 ms, write 892 ms, index 160 ms: 1 candidates, 26464 repo-hours, 268 releases; waiting 559 ms; commit 699 ms)
2026-11-07T04:09:23Z [load_day 2026-09-10] 2026-09-10 hour 16: 37445 events in 1 files, snapshot 1217837474766393122 (task 2600 ms: download 1069 ms overlapping gunzip 130 ms, parse 380 ms, sort 45 ms, write 979 ms, index 161 ms: 0 candidates, 26089 repo-hours, 254 releases; waiting 611 ms; commit 794 ms)
2026-11-07T04:09:25Z [load_day 2026-09-10] 2026-09-10 hour 17: 46116 events in 1 files, snapshot 4456306226508306849 (task 3023 ms: download 1160 ms overlapping gunzip 159 ms, parse 499 ms, sort 63 ms, write 1237 ms, index 176 ms: 3 candidates, 28637 repo-hours, 396 releases; waiting 569 ms; commit 887 ms)
2026-11-07T04:09:31Z [load_day 2026-09-10] 2026-09-10 hour 18: 67335 events in 2 files, snapshot 6433282560914614082 (task 7232 ms: download 2504 ms overlapping gunzip 469 ms, parse 1378 ms, sort 158 ms, write 3636 ms, index 253 ms: 1 candidates, 40251 repo-hours, 1317 releases; waiting 1019 ms; commit 929 ms)
2026-11-07T04:09:33Z [load_day 2026-09-10] 2026-09-10 hour 19: 81710 events in 2 files, snapshot 5241826760731132032 (task 8426 ms: download 3283 ms overlapping gunzip 650 ms, parse 1918 ms, sort 163 ms, write 4172 ms, index 275 ms: 5 candidates, 44765 repo-hours, 1935 releases; waiting 849 ms; commit 691 ms)
2026-11-07T04:09:41Z [load_day 2026-09-10] 2026-09-10 hour 20: 92344 events in 2 files, snapshot 6522259477575052462 (task 9175 ms: download 2658 ms overlapping gunzip 729 ms, parse 2212 ms, sort 270 ms, write 4855 ms, index 290 ms: 4 candidates, 48086 repo-hours, 2171 releases; waiting 545 ms; commit 743 ms)
2026-11-07T04:09:44Z [load_day 2026-09-10] 2026-09-10 hour 21: 91079 events in 2 files, snapshot 971564345604550323 (task 9576 ms: download 3565 ms overlapping gunzip 693 ms, parse 2033 ms, sort 198 ms, write 5164 ms, index 285 ms: 4 candidates, 46356 repo-hours, 1930 releases; waiting 873 ms; commit 1052 ms)
2026-11-07T04:09:51Z [load_day 2026-09-10] 2026-09-10 hour 22: 91842 events in 2 files, snapshot 4351778497403590084 (task 9815 ms: download 3151 ms overlapping gunzip 750 ms, parse 2273 ms, sort 298 ms, write 5034 ms, index 273 ms: 8 candidates, 45114 repo-hours, 2015 releases; waiting 787 ms; commit 707 ms)
2026-11-07T04:09:54Z [load_day 2026-09-10] 2026-09-10 hour 23: 92154 events in 2 files, snapshot 2264100270720203972 (task 9902 ms: download 3171 ms overlapping gunzip 750 ms, parse 2340 ms, sort 231 ms, write 5271 ms, index 282 ms: 8 candidates, 45015 repo-hours, 2262 releases; waiting 708 ms; commit 916 ms)
2026-11-07T04:09:58Z [load_day 2026-09-10] 2026-09-10: repo_hour merged from 24 files to 1 (651236 rows, 3216 ms)
2026-11-07T04:09:59Z [load_day 2026-09-10] 2026-09-10: index committed in 4735 ms (22 + 1 + 24 files)
2026-11-07T04:09:59Z [load_day 2026-09-10] 2026-09-10: 1075288 events in 24 hours
2026-11-07T04:09:59Z [load_day 2026-09-10] attempt 1 succeeded