orcaLog in

Runs · run 557

load_day 2026-05-16, attempt 1 succeeded

Host
4e84322b8c45:123825
Started
2026-11-07T06:27:00Z
Ended
2026-11-07T06:28:23Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/557/load_day/2026-05-16/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:27:00Z [load_day 2026-05-16] attempt 1 started
2026-11-07T06:27:10Z [load_day 2026-05-16] 2026-05-16 hour 0: 143701 events in 3 files, snapshot 7901420533190570081 (task 6280 ms: download 1975 ms overlapping gunzip 391 ms, parse 1348 ms, sort 146 ms, write 3199 ms, index 502 ms: 5 candidates, 66197 repo-hours, 879 releases; waiting 460 ms; commit 992 ms)
2026-11-07T06:27:11Z [load_day 2026-05-16] 2026-05-16 hour 1: 148444 events in 3 files, snapshot 7163561542545084468 (task 6192 ms: download 2114 ms overlapping gunzip 386 ms, parse 1333 ms, sort 136 ms, write 3130 ms, index 458 ms: 5 candidates, 71369 repo-hours, 737 releases; waiting 499 ms; commit 1056 ms)
2026-11-07T06:27:16Z [load_day 2026-05-16] 2026-05-16 hour 2: 152416 events in 4 files, snapshot 5487768134794426698 (task 4927 ms: download 1632 ms overlapping gunzip 295 ms, parse 998 ms, sort 121 ms, write 2105 ms, index 565 ms: 3 candidates, 82536 repo-hours, 390 releases; waiting 528 ms; commit 1143 ms)
2026-11-07T06:27:17Z [load_day 2026-05-16] 2026-05-16 hour 3: 150333 events in 4 files, snapshot 3365912758839091436 (task 4780 ms: download 1066 ms overlapping gunzip 323 ms, parse 1055 ms, sort 114 ms, write 2264 ms, index 505 ms: 7 candidates, 77810 repo-hours, 610 releases; waiting 189 ms; commit 1177 ms)
2026-11-07T06:27:22Z [load_day 2026-05-16] 2026-05-16 hour 4: 144897 events in 3 files, snapshot 616225174499313919 (task 5577 ms: download 2077 ms overlapping gunzip 412 ms, parse 1286 ms, sort 123 ms, write 2402 ms, index 394 ms: 5 candidates, 62622 repo-hours, 860 releases; waiting 535 ms; commit 1175 ms)
2026-11-07T06:27:23Z [load_day 2026-05-16] 2026-05-16 hour 5: 145707 events in 3 files, snapshot 7446743941268179674 (task 5270 ms: download 1919 ms overlapping gunzip 337 ms, parse 1095 ms, sort 125 ms, write 2244 ms, index 428 ms: 5 candidates, 67816 repo-hours, 698 releases; waiting 720 ms; commit 1249 ms)
2026-11-07T06:27:28Z [load_day 2026-05-16] 2026-05-16 hour 6: 147557 events in 3 files, snapshot 5703314828576904175 (task 5143 ms: download 1596 ms overlapping gunzip 317 ms, parse 1013 ms, sort 166 ms, write 2254 ms, index 558 ms: 4 candidates, 71223 repo-hours, 673 releases; waiting 543 ms; commit 1129 ms)
2026-11-07T06:27:29Z [load_day 2026-05-16] 2026-05-16 hour 7: 154164 events in 4 files, snapshot 8383856664879200594 (task 5194 ms: download 1573 ms overlapping gunzip 325 ms, parse 1092 ms, sort 140 ms, write 2358 ms, index 506 ms: 6 candidates, 76131 repo-hours, 530 releases; waiting 545 ms; commit 1252 ms)
2026-11-07T06:27:34Z [load_day 2026-05-16] 2026-05-16 hour 8: 152258 events in 4 files, snapshot 6225796967318479303 (task 5385 ms: download 2016 ms overlapping gunzip 306 ms, parse 1015 ms, sort 140 ms, write 2484 ms, index 589 ms: 8 candidates, 77156 repo-hours, 455 releases; waiting 537 ms; commit 1098 ms)
2026-11-07T06:27:35Z [load_day 2026-05-16] 2026-05-16 hour 9: 157659 events in 4 files, snapshot 4326662329964547562 (task 5204 ms: download 1446 ms overlapping gunzip 294 ms, parse 986 ms, sort 137 ms, write 2315 ms, index 519 ms: 7 candidates, 78242 repo-hours, 447 releases; waiting 705 ms; commit 1220 ms)
2026-11-07T06:27:40Z [load_day 2026-05-16] 2026-05-16 hour 10: 156607 events in 4 files, snapshot 1780249379961166216 (task 5030 ms: download 1849 ms overlapping gunzip 286 ms, parse 997 ms, sort 113 ms, write 2159 ms, index 561 ms: 5 candidates, 77358 repo-hours, 390 releases; waiting 524 ms; commit 1053 ms)
2026-11-07T06:27:41Z [load_day 2026-05-16] 2026-05-16 hour 11: 153164 events in 4 files, snapshot 1717635046472445403 (task 4689 ms: download 1645 ms overlapping gunzip 289 ms, parse 998 ms, sort 187 ms, write 1914 ms, index 484 ms: 10 candidates, 75707 repo-hours, 402 releases; waiting 515 ms; commit 1144 ms)
2026-11-07T06:27:45Z [load_day 2026-05-16] 2026-05-16 hour 12: 158456 events in 4 files, snapshot 632837741673187433 (task 4444 ms: download 1376 ms overlapping gunzip 250 ms, parse 880 ms, sort 126 ms, write 1894 ms, index 526 ms: 10 candidates, 82954 repo-hours, 258 releases; waiting 539 ms; commit 1230 ms)
2026-11-07T06:27:46Z [load_day 2026-05-16] 2026-05-16 hour 13: 166748 events in 4 files, snapshot 3120133506211880686 (task 4514 ms: download 1403 ms overlapping gunzip 230 ms, parse 848 ms, sort 105 ms, write 1882 ms, index 635 ms: 12 candidates, 95155 repo-hours, 91 releases; waiting 522 ms; commit 1063 ms)
2026-11-07T06:27:50Z [load_day 2026-05-16] 2026-05-16 hour 14: 162305 events in 4 files, snapshot 4901386199674189150 (task 4201 ms: download 1341 ms overlapping gunzip 238 ms, parse 858 ms, sort 112 ms, write 1638 ms, index 526 ms: 10 candidates, 81500 repo-hours, 125 releases; waiting 542 ms; commit 1115 ms)
2026-11-07T06:27:51Z [load_day 2026-05-16] 2026-05-16 hour 15: 160255 events in 4 files, snapshot 1522899541218546723 (task 4344 ms: download 1435 ms overlapping gunzip 229 ms, parse 824 ms, sort 113 ms, write 1671 ms, index 544 ms: 8 candidates, 83008 repo-hours, 171 releases; waiting 534 ms; commit 1055 ms)
2026-11-07T06:27:55Z [load_day 2026-05-16] 2026-05-16 hour 16: 161505 events in 4 files, snapshot 3976219477300749089 (task 4318 ms: download 1468 ms overlapping gunzip 260 ms, parse 884 ms, sort 124 ms, write 1635 ms, index 597 ms: 9 candidates, 83210 repo-hours, 156 releases; waiting 521 ms; commit 1075 ms)
2026-11-07T06:27:56Z [load_day 2026-05-16] 2026-05-16 hour 17: 157267 events in 4 files, snapshot 374254708879744485 (task 4445 ms: download 1612 ms overlapping gunzip 269 ms, parse 908 ms, sort 116 ms, write 1760 ms, index 538 ms: 4 candidates, 80253 repo-hours, 255 releases; waiting 547 ms; commit 1078 ms)
2026-11-07T06:28:00Z [load_day 2026-05-16] 2026-05-16 hour 18: 150310 events in 4 files, snapshot 6260727365550374003 (task 4940 ms: download 1641 ms overlapping gunzip 300 ms, parse 1017 ms, sort 122 ms, write 2121 ms, index 504 ms: 8 candidates, 76305 repo-hours, 490 releases; waiting 526 ms; commit 995 ms)
2026-11-07T06:28:02Z [load_day 2026-05-16] 2026-05-16 hour 19: 152341 events in 4 files, snapshot 6822515133627336387 (task 4745 ms: download 1480 ms overlapping gunzip 311 ms, parse 1039 ms, sort 113 ms, write 1926 ms, index 508 ms: 9 candidates, 77745 repo-hours, 360 releases; waiting 415 ms; commit 1119 ms)
2026-11-07T06:28:06Z [load_day 2026-05-16] 2026-05-16 hour 20: 150619 events in 4 files, snapshot 7062141239135052056 (task 5154 ms: download 1612 ms overlapping gunzip 288 ms, parse 990 ms, sort 133 ms, write 2374 ms, index 526 ms: 8 candidates, 75284 repo-hours, 419 releases; waiting 532 ms; commit 1025 ms)
2026-11-07T06:28:07Z [load_day 2026-05-16] 2026-05-16 hour 21: 151543 events in 4 files, snapshot 2014915827818115287 (task 5020 ms: download 1607 ms overlapping gunzip 314 ms, parse 1018 ms, sort 112 ms, write 2339 ms, index 461 ms: 4 candidates, 70986 repo-hours, 561 releases; waiting 532 ms; commit 1046 ms)
2026-11-07T06:28:13Z [load_day 2026-05-16] 2026-05-16 hour 22: 149808 events in 3 files, snapshot 5039676593730012393 (task 5780 ms: download 1926 ms overlapping gunzip 385 ms, parse 1272 ms, sort 172 ms, write 2748 ms, index 452 ms: 8 candidates, 68313 repo-hours, 780 releases; waiting 531 ms; commit 1164 ms)
2026-11-07T06:28:14Z [load_day 2026-05-16] 2026-05-16 hour 23: 148275 events in 3 files, snapshot 2011017797215454798 (task 5850 ms: download 1949 ms overlapping gunzip 376 ms, parse 1294 ms, sort 121 ms, write 2815 ms, index 429 ms: 5 candidates, 67075 repo-hours, 966 releases; waiting 557 ms; commit 1014 ms)
2026-11-07T06:28:21Z [load_day 2026-05-16] 2026-05-16: repo_hour merged from 24 files to 1 (1825955 rows, 7217 ms)
2026-11-07T06:28:23Z [load_day 2026-05-16] 2026-05-16: index committed in 8696 ms (24 + 1 + 24 files)
2026-11-07T06:28:23Z [load_day 2026-05-16] 2026-05-16: 3676339 events in 24 hours
2026-11-07T06:28:23Z [load_day 2026-05-16] attempt 1 succeeded