orcaLog in

Runs · run 173

load_day 2026-09-21, attempt 1 succeeded

Host
4e84322b8c45:29661
Started
2026-11-07T03:54:43Z
Ended
2026-11-07T03:55:34Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/173/load_day/2026-09-21/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:54:43Z [load_day 2026-09-21] attempt 1 started
2026-11-07T03:54:49Z [load_day 2026-09-21] 2026-09-21 hour 0: 125556 events in 3 files, snapshot 283838372539099293 (task 3320 ms: download 1049 ms overlapping gunzip 170 ms, parse 651 ms, sort 90 ms, write 1365 ms, index 310 ms: 8 candidates, 46002 repo-hours, 48 releases; waiting 500 ms; commit 609 ms)
2026-11-07T03:54:50Z [load_day 2026-09-21] 2026-09-21 hour 1: 129497 events in 3 files, snapshot 3279873215158869552 (task 3795 ms: download 1249 ms overlapping gunzip 187 ms, parse 696 ms, sort 92 ms, write 1482 ms, index 343 ms: 9 candidates, 46935 repo-hours, 34 releases; waiting 493 ms; commit 723 ms)
2026-11-07T03:54:53Z [load_day 2026-09-21] 2026-09-21 hour 2: 131407 events in 3 files, snapshot 2959906899467120526 (task 3336 ms: download 1064 ms overlapping gunzip 174 ms, parse 658 ms, sort 86 ms, write 1274 ms, index 357 ms: 5 candidates, 52794 repo-hours, 37 releases; waiting 523 ms; commit 754 ms)
2026-11-07T03:54:54Z [load_day 2026-09-21] 2026-09-21 hour 3: 134700 events in 3 files, snapshot 7941611203540661227 (task 2913 ms: download 748 ms overlapping gunzip 163 ms, parse 598 ms, sort 88 ms, write 1286 ms, index 341 ms: 3 candidates, 56917 repo-hours, 26 releases; waiting 226 ms; commit 613 ms)
2026-11-07T03:54:57Z [load_day 2026-09-21] 2026-09-21 hour 4: 126822 events in 3 files, snapshot 7865550163193336918 (task 3368 ms: download 1333 ms overlapping gunzip 165 ms, parse 605 ms, sort 83 ms, write 1256 ms, index 339 ms: 2 candidates, 52987 repo-hours, 28 releases; waiting 533 ms; commit 616 ms)
2026-11-07T03:54:57Z [load_day 2026-09-21] 2026-09-21 hour 5: 127392 events in 3 files, snapshot 6412917183080328919 (task 3354 ms: download 1362 ms overlapping gunzip 181 ms, parse 647 ms, sort 80 ms, write 1297 ms, index 349 ms: 7 candidates, 53676 repo-hours, 30 releases; waiting 523 ms; commit 500 ms)
2026-11-07T03:55:01Z [load_day 2026-09-21] 2026-09-21 hour 6: 128275 events in 3 files, snapshot 4531729471674571261 (task 3274 ms: download 1132 ms overlapping gunzip 162 ms, parse 606 ms, sort 78 ms, write 1253 ms, index 320 ms: 6 candidates, 52227 repo-hours, 21 releases; waiting 527 ms; commit 626 ms)
2026-11-07T03:55:01Z [load_day 2026-09-21] 2026-09-21 hour 7: 133793 events in 3 files, snapshot 814478092727547697 (task 2874 ms: download 870 ms overlapping gunzip 189 ms, parse 617 ms, sort 89 ms, write 1206 ms, index 331 ms: 7 candidates, 53733 repo-hours, 32 releases; waiting 187 ms; commit 779 ms)
2026-11-07T03:55:05Z [load_day 2026-09-21] 2026-09-21 hour 8: 123553 events in 3 files, snapshot 203120422680353071 (task 3246 ms: download 1056 ms overlapping gunzip 193 ms, parse 648 ms, sort 76 ms, write 1252 ms, index 302 ms: 5 candidates, 51924 repo-hours, 38 releases; waiting 532 ms; commit 822 ms)
2026-11-07T03:55:05Z [load_day 2026-09-21] 2026-09-21 hour 9: 111087 events in 3 files, snapshot 3605706334575242274 (task 2927 ms: download 1156 ms overlapping gunzip 163 ms, parse 539 ms, sort 68 ms, write 1105 ms, index 304 ms: 3 candidates, 46718 repo-hours, 41 releases; waiting 534 ms; commit 594 ms)
2026-11-07T03:55:08Z [load_day 2026-09-21] 2026-09-21 hour 10: 84120 events in 2 files, snapshot 426129156524545905 (task 2593 ms: download 973 ms overlapping gunzip 129 ms, parse 441 ms, sort 53 ms, write 907 ms, index 245 ms: 5 candidates, 38344 repo-hours, 73 releases; waiting 547 ms; commit 720 ms)
2026-11-07T03:55:08Z [load_day 2026-09-21] 2026-09-21 hour 11: 65820 events in 2 files, snapshot 7773753073977160885 (task 2385 ms: download 911 ms overlapping gunzip 108 ms, parse 357 ms, sort 41 ms, write 823 ms, index 225 ms: 4 candidates, 33084 repo-hours, 68 releases; waiting 556 ms; commit 710 ms)
2026-11-07T03:55:10Z [load_day 2026-09-21] 2026-09-21 hour 12: 48771 events in 1 files, snapshot 4626867031350217401 (task 2015 ms: download 896 ms overlapping gunzip 86 ms, parse 293 ms, sort 33 ms, write 508 ms, index 185 ms: 3 candidates, 26547 repo-hours, 68 releases; waiting 600 ms; commit 663 ms)
2026-11-07T03:55:11Z [load_day 2026-09-21] 2026-09-21 hour 13: 25664 events in 1 files, snapshot 6371095612465155442 (task 1462 ms: download 633 ms overlapping gunzip 51 ms, parse 163 ms, sort 15 ms, write 399 ms, index 114 ms: 1 candidates, 15927 repo-hours, 52 releases; waiting 447 ms; commit 534 ms)
2026-11-07T03:55:12Z [load_day 2026-09-21] 2026-09-21 hour 14: 7891 events in 1 files, snapshot 6293005954389930257 (task 1429 ms: download 700 ms overlapping gunzip 40 ms, parse 114 ms, sort 5 ms, write 256 ms, index 162 ms: 1 candidates, 6065 repo-hours, 61 releases; waiting 555 ms; commit 852 ms)
2026-11-07T03:55:13Z [load_day 2026-09-21] 2026-09-21 hour 15: 2348 events in 1 files, snapshot 1609021931855437662 (task 1422 ms: download 680 ms overlapping gunzip 33 ms, parse 88 ms, sort 2 ms, write 238 ms, index 32 ms: 0 candidates, 2202 repo-hours, 80 releases; waiting 568 ms; commit 603 ms)
2026-11-07T03:55:14Z [load_day 2026-09-21] 2026-09-21 hour 16: 2619 events in 1 files, snapshot 6562976882705727195 (task 931 ms: download 284 ms overlapping gunzip 26 ms, parse 64 ms, sort 2 ms, write 269 ms, index 39 ms: 0 candidates, 2418 repo-hours, 70 releases; waiting 211 ms; commit 690 ms)
2026-11-07T03:55:15Z [load_day 2026-09-21] 2026-09-21 hour 17: 3381 events in 1 files, snapshot 6906716223138613424 (task 1366 ms: download 721 ms overlapping gunzip 44 ms, parse 124 ms, sort 4 ms, write 294 ms, index 44 ms: 1 candidates, 3022 repo-hours, 96 releases; waiting 562 ms; commit 649 ms)
2026-11-07T03:55:19Z [load_day 2026-09-21] 2026-09-21 hour 18: 20528 events in 1 files, snapshot 6450406313024935603 (task 3937 ms: download 1674 ms overlapping gunzip 189 ms, parse 581 ms, sort 60 ms, write 1694 ms, index 169 ms: 2 candidates, 13998 repo-hours, 589 releases; waiting 947 ms; commit 871 ms)
2026-11-07T03:55:21Z [load_day 2026-09-21] 2026-09-21 hour 19: 35440 events in 1 files, snapshot 5287371001893332547 (task 5043 ms: download 1771 ms overlapping gunzip 383 ms, parse 1188 ms, sort 109 ms, write 2402 ms, index 141 ms: 9 candidates, 21732 repo-hours, 1008 releases; waiting 580 ms; commit 688 ms)
2026-11-07T03:55:24Z [load_day 2026-09-21] 2026-09-21 hour 20: 33243 events in 1 files, snapshot 2147940570205318593 (task 4907 ms: download 1770 ms overlapping gunzip 309 ms, parse 911 ms, sort 103 ms, write 2370 ms, index 238 ms: 5 candidates, 20541 repo-hours, 949 releases; waiting 662 ms; commit 754 ms)
2026-11-07T03:55:25Z [load_day 2026-09-21] 2026-09-21 hour 21: 22143 events in 1 files, snapshot 4461208308544973482 (task 3751 ms: download 1503 ms overlapping gunzip 235 ms, parse 695 ms, sort 31 ms, write 1665 ms, index 116 ms: 2 candidates, 14711 repo-hours, 613 releases; waiting 728 ms; commit 652 ms)
2026-11-07T03:55:28Z [load_day 2026-09-21] 2026-09-21 hour 22: 32275 events in 1 files, snapshot 5807618581394548206 (task 3890 ms: download 1882 ms overlapping gunzip 189 ms, parse 518 ms, sort 32 ms, write 1459 ms, index 160 ms: 5 candidates, 21715 repo-hours, 398 releases; waiting 1224 ms; commit 733 ms)
2026-11-07T03:55:29Z [load_day 2026-09-21] 2026-09-21 hour 23: 42629 events in 1 files, snapshot 5384368144459775680 (task 3340 ms: download 1395 ms overlapping gunzip 218 ms, parse 664 ms, sort 41 ms, write 1324 ms, index 171 ms: 3 candidates, 26724 repo-hours, 380 releases; waiting 621 ms; commit 556 ms)
2026-11-07T03:55:32Z [load_day 2026-09-21] 2026-09-21: repo_hour merged from 24 files to 1 (760943 rows, 3468 ms)
2026-11-07T03:55:34Z [load_day 2026-09-21] 2026-09-21: index committed in 5003 ms (22 + 1 + 24 files)
2026-11-07T03:55:34Z [load_day 2026-09-21] 2026-09-21: 1698954 events in 24 hours
2026-11-07T03:55:34Z [load_day 2026-09-21] attempt 1 succeeded