orcaLog in

Runs · run 161

load_day 2026-09-25, attempt 1 succeeded

Host
4e84322b8c45:27827
Started
2026-11-07T03:50:58Z
Ended
2026-11-07T03:51:49Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/161/load_day/2026-09-25/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:50:58Z [load_day 2026-09-25] attempt 1 started
2026-11-07T03:51:04Z [load_day 2026-09-25] 2026-09-25 hour 0: 36699 events in 1 files, snapshot 3296881381438684995 (task 2646 ms: download 938 ms overlapping gunzip 119 ms, parse 371 ms, sort 45 ms, write 1020 ms, index 189 ms: 1 candidates, 23033 repo-hours, 262 releases; waiting 574 ms; commit 705 ms)
2026-11-07T03:51:04Z [load_day 2026-09-25] 2026-09-25 hour 1: 37958 events in 1 files, snapshot 8032280292902353852 (task 2703 ms: download 1099 ms overlapping gunzip 132 ms, parse 418 ms, sort 46 ms, write 1104 ms, index 183 ms: 2 candidates, 23700 repo-hours, 464 releases; waiting 588 ms; commit 570 ms)
2026-11-07T03:51:07Z [load_day 2026-09-25] 2026-09-25 hour 2: 45805 events in 1 files, snapshot 2734517126901690938 (task 2642 ms: download 1043 ms overlapping gunzip 143 ms, parse 442 ms, sort 61 ms, write 928 ms, index 194 ms: 2 candidates, 28412 repo-hours, 542 releases; waiting 582 ms; commit 719 ms)
2026-11-07T03:51:08Z [load_day 2026-09-25] 2026-09-25 hour 3: 57567 events in 2 files, snapshot 5483731985894193962 (task 2745 ms: download 1078 ms overlapping gunzip 163 ms, parse 511 ms, sort 53 ms, write 893 ms, index 250 ms: 5 candidates, 33769 repo-hours, 448 releases; waiting 551 ms; commit 732 ms)
2026-11-07T03:51:11Z [load_day 2026-09-25] 2026-09-25 hour 4: 66050 events in 2 files, snapshot 8746677731217008356 (task 2723 ms: download 990 ms overlapping gunzip 152 ms, parse 501 ms, sort 55 ms, write 1008 ms, index 266 ms: 4 candidates, 38542 repo-hours, 344 releases; waiting 531 ms; commit 822 ms)
2026-11-07T03:51:11Z [load_day 2026-09-25] 2026-09-25 hour 5: 75724 events in 2 files, snapshot 1154545878139379582 (task 2635 ms: download 1248 ms overlapping gunzip 139 ms, parse 443 ms, sort 52 ms, write 893 ms, index 287 ms: 7 candidates, 41951 repo-hours, 264 releases; waiting 555 ms; commit 717 ms)
2026-11-07T03:51:14Z [load_day 2026-09-25] 2026-09-25 hour 6: 79168 events in 2 files, snapshot 435569417601910156 (task 2720 ms: download 1008 ms overlapping gunzip 143 ms, parse 480 ms, sort 54 ms, write 974 ms, index 288 ms: 4 candidates, 43357 repo-hours, 179 releases; waiting 546 ms; commit 613 ms)
2026-11-07T03:51:14Z [load_day 2026-09-25] 2026-09-25 hour 7: 79477 events in 2 files, snapshot 317678792393727668 (task 2851 ms: download 1245 ms overlapping gunzip 133 ms, parse 454 ms, sort 52 ms, write 937 ms, index 304 ms: 4 candidates, 45988 repo-hours, 152 releases; waiting 637 ms; commit 658 ms)
2026-11-07T03:51:17Z [load_day 2026-09-25] 2026-09-25 hour 8: 76823 events in 2 files, snapshot 6469734221435527237 (task 2654 ms: download 1024 ms overlapping gunzip 135 ms, parse 436 ms, sort 54 ms, write 943 ms, index 297 ms: 3 candidates, 44898 repo-hours, 172 releases; waiting 535 ms; commit 786 ms)
2026-11-07T03:51:18Z [load_day 2026-09-25] 2026-09-25 hour 9: 79679 events in 2 files, snapshot 2013241924707736547 (task 2680 ms: download 949 ms overlapping gunzip 129 ms, parse 416 ms, sort 55 ms, write 963 ms, index 298 ms: 8 candidates, 45422 repo-hours, 81 releases; waiting 543 ms; commit 828 ms)
2026-11-07T03:51:21Z [load_day 2026-09-25] 2026-09-25 hour 10: 84754 events in 2 files, snapshot 638211455669040566 (task 2745 ms: download 967 ms overlapping gunzip 142 ms, parse 503 ms, sort 65 ms, write 931 ms, index 324 ms: 3 candidates, 47685 repo-hours, 101 releases; waiting 537 ms; commit 764 ms)
2026-11-07T03:51:21Z [load_day 2026-09-25] 2026-09-25 hour 11: 89852 events in 2 files, snapshot 3768514276678935940 (task 2770 ms: download 1190 ms overlapping gunzip 136 ms, parse 451 ms, sort 62 ms, write 927 ms, index 335 ms: 1 candidates, 49701 repo-hours, 40 releases; waiting 555 ms; commit 545 ms)
2026-11-07T03:51:24Z [load_day 2026-09-25] 2026-09-25 hour 12: 93655 events in 2 files, snapshot 3125028288376630215 (task 2998 ms: download 1128 ms overlapping gunzip 164 ms, parse 580 ms, sort 64 ms, write 1023 ms, index 334 ms: 6 candidates, 52346 repo-hours, 63 releases; waiting 529 ms; commit 655 ms)
2026-11-07T03:51:25Z [load_day 2026-09-25] 2026-09-25 hour 13: 76373 events in 2 files, snapshot 8017320221464477407 (task 2524 ms: download 1001 ms overlapping gunzip 119 ms, parse 413 ms, sort 55 ms, write 854 ms, index 302 ms: 4 candidates, 46105 repo-hours, 71 releases; waiting 513 ms; commit 846 ms)
2026-11-07T03:51:28Z [load_day 2026-09-25] 2026-09-25 hour 14: 64796 events in 2 files, snapshot 7290669346847807394 (task 2594 ms: download 959 ms overlapping gunzip 122 ms, parse 388 ms, sort 40 ms, write 901 ms, index 256 ms: 6 candidates, 40444 repo-hours, 95 releases; waiting 550 ms; commit 720 ms)
2026-11-07T03:51:28Z [load_day 2026-09-25] 2026-09-25 hour 15: 72191 events in 2 files, snapshot 1931176089965228184 (task 2552 ms: download 667 ms overlapping gunzip 155 ms, parse 474 ms, sort 52 ms, write 1056 ms, index 300 ms: 4 candidates, 44976 repo-hours, 177 releases; waiting 179 ms; commit 713 ms)
2026-11-07T03:51:31Z [load_day 2026-09-25] 2026-09-25 hour 16: 83638 events in 2 files, snapshot 8639141398685283804 (task 2863 ms: download 1214 ms overlapping gunzip 145 ms, parse 513 ms, sort 57 ms, write 1011 ms, index 331 ms: 7 candidates, 52393 repo-hours, 79 releases; waiting 539 ms; commit 777 ms)
2026-11-07T03:51:32Z [load_day 2026-09-25] 2026-09-25 hour 17: 87410 events in 2 files, snapshot 6505013653721370469 (task 2921 ms: download 1200 ms overlapping gunzip 166 ms, parse 557 ms, sort 76 ms, write 996 ms, index 326 ms: 7 candidates, 49746 repo-hours, 119 releases; waiting 504 ms; commit 760 ms)
2026-11-07T03:51:35Z [load_day 2026-09-25] 2026-09-25 hour 18: 89144 events in 2 files, snapshot 6811953047662272422 (task 2940 ms: download 1171 ms overlapping gunzip 164 ms, parse 502 ms, sort 59 ms, write 1067 ms, index 324 ms: 4 candidates, 49785 repo-hours, 111 releases; waiting 551 ms; commit 709 ms)
2026-11-07T03:51:35Z [load_day 2026-09-25] 2026-09-25 hour 19: 82624 events in 2 files, snapshot 6441540276692793440 (task 2621 ms: download 1073 ms overlapping gunzip 150 ms, parse 453 ms, sort 55 ms, write 910 ms, index 296 ms: 6 candidates, 46497 repo-hours, 95 releases; waiting 538 ms; commit 648 ms)
2026-11-07T03:51:38Z [load_day 2026-09-25] 2026-09-25 hour 20: 79702 events in 2 files, snapshot 8952181150908538376 (task 2663 ms: download 996 ms overlapping gunzip 129 ms, parse 443 ms, sort 58 ms, write 923 ms, index 265 ms: 6 candidates, 41380 repo-hours, 89 releases; waiting 537 ms; commit 1247 ms)
2026-11-07T03:51:39Z [load_day 2026-09-25] 2026-09-25 hour 21: 81565 events in 2 files, snapshot 7549626618658071918 (task 2832 ms: download 1014 ms overlapping gunzip 147 ms, parse 479 ms, sort 59 ms, write 1020 ms, index 274 ms: 4 candidates, 43672 repo-hours, 123 releases; waiting 532 ms; commit 725 ms)
2026-11-07T03:51:42Z [load_day 2026-09-25] 2026-09-25 hour 22: 77853 events in 2 files, snapshot 139906002815154778 (task 2778 ms: download 1195 ms overlapping gunzip 150 ms, parse 480 ms, sort 62 ms, write 1059 ms, index 274 ms: 6 candidates, 40450 repo-hours, 113 releases; waiting 538 ms; commit 841 ms)
2026-11-07T03:51:43Z [load_day 2026-09-25] 2026-09-25 hour 23: 75804 events in 2 files, snapshot 2437822803451125833 (task 2664 ms: download 991 ms overlapping gunzip 146 ms, parse 463 ms, sort 49 ms, write 983 ms, index 261 ms: 5 candidates, 39427 repo-hours, 123 releases; waiting 541 ms; commit 651 ms)
2026-11-07T03:51:47Z [load_day 2026-09-25] 2026-09-25: repo_hour merged from 24 files to 1 (1013679 rows, 4811 ms)
2026-11-07T03:51:49Z [load_day 2026-09-25] 2026-09-25: index committed in 6639 ms (24 + 1 + 24 files)
2026-11-07T03:51:49Z [load_day 2026-09-25] 2026-09-25: 1774311 events in 24 hours
2026-11-07T03:51:49Z [load_day 2026-09-25] attempt 1 succeeded