orcaLog in

Runs · run 71

load_day 2026-10-25, attempt 1 succeeded

Host
4e84322b8c45:16053
Started
2026-11-07T03:27:56Z
Ended
2026-11-07T03:28:43Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/71/load_day/2026-10-25/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:27:56Z [load_day 2026-10-25] attempt 1 started
2026-11-07T03:28:02Z [load_day 2026-10-25] 2026-10-25 hour 0: 34719 events in 1 files, snapshot 1606284785022439560 (task 2263 ms: download 881 ms overlapping gunzip 91 ms, parse 322 ms, sort 34 ms, write 800 ms, index 180 ms: 9 candidates, 23932 repo-hours, 109 releases; waiting 534 ms; commit 690 ms)
2026-11-07T03:28:02Z [load_day 2026-10-25] 2026-10-25 hour 1: 34464 events in 1 files, snapshot 9165489611104402800 (task 2150 ms: download 843 ms overlapping gunzip 82 ms, parse 275 ms, sort 32 ms, write 761 ms, index 162 ms: 4 candidates, 23190 repo-hours, 111 releases; waiting 549 ms; commit 595 ms)
2026-11-07T03:28:04Z [load_day 2026-10-25] 2026-10-25 hour 2: 41896 events in 1 files, snapshot 7235843877363042777 (task 2050 ms: download 880 ms overlapping gunzip 88 ms, parse 283 ms, sort 27 ms, write 616 ms, index 191 ms: 6 candidates, 28422 repo-hours, 104 releases; waiting 560 ms; commit 763 ms)
2026-11-07T03:28:05Z [load_day 2026-10-25] 2026-10-25 hour 3: 46725 events in 1 files, snapshot 1332261615949566887 (task 2078 ms: download 868 ms overlapping gunzip 85 ms, parse 281 ms, sort 38 ms, write 611 ms, index 200 ms: 5 candidates, 31188 repo-hours, 102 releases; waiting 578 ms; commit 617 ms)
2026-11-07T03:28:07Z [load_day 2026-10-25] 2026-10-25 hour 4: 54377 events in 2 files, snapshot 2376671186093354594 (task 2361 ms: download 1034 ms overlapping gunzip 101 ms, parse 347 ms, sort 37 ms, write 714 ms, index 245 ms: 6 candidates, 33684 repo-hours, 101 releases; waiting 637 ms; commit 662 ms)
2026-11-07T03:28:08Z [load_day 2026-10-25] 2026-10-25 hour 5: 56838 events in 2 files, snapshot 7360431131823705231 (task 2366 ms: download 906 ms overlapping gunzip 114 ms, parse 371 ms, sort 42 ms, write 754 ms, index 242 ms: 5 candidates, 35135 repo-hours, 88 releases; waiting 548 ms; commit 537 ms)
2026-11-07T03:28:11Z [load_day 2026-10-25] 2026-10-25 hour 6: 54801 events in 2 files, snapshot 5427544263222813151 (task 3007 ms: download 1165 ms overlapping gunzip 116 ms, parse 392 ms, sort 36 ms, write 827 ms, index 239 ms: 8 candidates, 32985 repo-hours, 121 releases; waiting 686 ms; commit 678 ms)
2026-11-07T03:28:11Z [load_day 2026-10-25] 2026-10-25 hour 7: 66027 events in 2 files, snapshot 1339264575189035569 (task 2511 ms: download 945 ms overlapping gunzip 114 ms, parse 383 ms, sort 45 ms, write 853 ms, index 286 ms: 6 candidates, 39204 repo-hours, 95 releases; waiting 544 ms; commit 609 ms)
2026-11-07T03:28:14Z [load_day 2026-10-25] 2026-10-25 hour 8: 73144 events in 2 files, snapshot 1729287330591245023 (task 2727 ms: download 1004 ms overlapping gunzip 128 ms, parse 428 ms, sort 51 ms, write 912 ms, index 302 ms: 3 candidates, 43559 repo-hours, 126 releases; waiting 527 ms; commit 751 ms)
2026-11-07T03:28:15Z [load_day 2026-10-25] 2026-10-25 hour 9: 72884 events in 2 files, snapshot 7667646327989830043 (task 1939 ms: download 272 ms overlapping gunzip 131 ms, parse 419 ms, sort 48 ms, write 877 ms, index 281 ms: 5 candidates, 43796 repo-hours, 102 releases; waiting 18 ms; commit 594 ms)
2026-11-07T03:28:17Z [load_day 2026-10-25] 2026-10-25 hour 10: 74888 events in 2 files, snapshot 4441749913051770912 (task 2763 ms: download 963 ms overlapping gunzip 136 ms, parse 445 ms, sort 51 ms, write 982 ms, index 298 ms: 6 candidates, 46854 repo-hours, 106 releases; waiting 553 ms; commit 625 ms)
2026-11-07T03:28:18Z [load_day 2026-10-25] 2026-10-25 hour 11: 76944 events in 2 files, snapshot 9181895088078954125 (task 2632 ms: download 969 ms overlapping gunzip 123 ms, parse 418 ms, sort 47 ms, write 917 ms, index 304 ms: 6 candidates, 47134 repo-hours, 106 releases; waiting 530 ms; commit 511 ms)
2026-11-07T03:28:21Z [load_day 2026-10-25] 2026-10-25 hour 12: 81569 events in 2 files, snapshot 3902305200762500293 (task 2947 ms: download 999 ms overlapping gunzip 141 ms, parse 457 ms, sort 70 ms, write 1042 ms, index 328 ms: 9 candidates, 49024 repo-hours, 82 releases; waiting 528 ms; commit 708 ms)
2026-11-07T03:28:22Z [load_day 2026-10-25] 2026-10-25 hour 13: 85732 events in 2 files, snapshot 3845406183816170037 (task 2170 ms: download 228 ms overlapping gunzip 124 ms, parse 408 ms, sort 58 ms, write 1055 ms, index 320 ms: 2 candidates, 51866 repo-hours, 102 releases; waiting 16 ms; commit 760 ms)
2026-11-07T03:28:23Z [load_day 2026-10-25] 2026-10-25 hour 14: 83002 events in 2 files, snapshot 4183676767630443651 (task 1993 ms: download 247 ms overlapping gunzip 125 ms, parse 403 ms, sort 50 ms, write 858 ms, index 346 ms: 9 candidates, 52220 repo-hours, 93 releases; waiting 15 ms; commit 710 ms)
2026-11-07T03:28:24Z [load_day 2026-10-25] 2026-10-25 hour 15: 85835 events in 2 files, snapshot 6782735169618040578 (task 2094 ms: download 222 ms overlapping gunzip 132 ms, parse 435 ms, sort 62 ms, write 884 ms, index 377 ms: 7 candidates, 56800 repo-hours, 90 releases; waiting 14 ms; commit 644 ms)
2026-11-07T03:28:26Z [load_day 2026-10-25] 2026-10-25 hour 16: 83152 events in 2 files, snapshot 1255190691139438305 (task 2229 ms: download 216 ms overlapping gunzip 130 ms, parse 414 ms, sort 49 ms, write 1014 ms, index 407 ms: 8 candidates, 51234 repo-hours, 102 releases; waiting 17 ms; commit 770 ms)
2026-11-07T03:28:27Z [load_day 2026-10-25] 2026-10-25 hour 17: 82023 events in 2 files, snapshot 6746429519691207492 (task 2155 ms: download 234 ms overlapping gunzip 138 ms, parse 457 ms, sort 57 ms, write 917 ms, index 377 ms: 8 candidates, 50612 repo-hours, 89 releases; waiting 18 ms; commit 664 ms)
2026-11-07T03:28:28Z [load_day 2026-10-25] 2026-10-25 hour 18: 79713 events in 2 files, snapshot 5769567438770870342 (task 1974 ms: download 223 ms overlapping gunzip 126 ms, parse 413 ms, sort 56 ms, write 830 ms, index 336 ms: 10 candidates, 51253 repo-hours, 83 releases; waiting 15 ms; commit 677 ms)
2026-11-07T03:28:30Z [load_day 2026-10-25] 2026-10-25 hour 19: 78636 events in 2 files, snapshot 6913586558159457626 (task 1988 ms: download 202 ms overlapping gunzip 125 ms, parse 415 ms, sort 57 ms, write 876 ms, index 308 ms: 7 candidates, 47756 repo-hours, 85 releases; waiting 17 ms; commit 1216 ms)
2026-11-07T03:28:32Z [load_day 2026-10-25] 2026-10-25 hour 20: 79732 events in 2 files, snapshot 7753957102895691667 (task 2763 ms: download 1395 ms overlapping gunzip 127 ms, parse 431 ms, sort 51 ms, write 936 ms, index 303 ms: 7 candidates, 49340 repo-hours, 83 releases; waiting 620 ms; commit 543 ms)
2026-11-07T03:28:33Z [load_day 2026-10-25] 2026-10-25 hour 21: 81789 events in 2 files, snapshot 5343325781472130539 (task 2699 ms: download 967 ms overlapping gunzip 137 ms, parse 448 ms, sort 58 ms, write 869 ms, index 319 ms: 10 candidates, 47985 repo-hours, 115 releases; waiting 540 ms; commit 665 ms)
2026-11-07T03:28:35Z [load_day 2026-10-25] 2026-10-25 hour 22: 81595 events in 2 files, snapshot 2895298023692749199 (task 2723 ms: download 1122 ms overlapping gunzip 135 ms, parse 444 ms, sort 50 ms, write 940 ms, index 358 ms: 8 candidates, 47735 repo-hours, 103 releases; waiting 538 ms; commit 741 ms)
2026-11-07T03:28:36Z [load_day 2026-10-25] 2026-10-25 hour 23: 79915 events in 2 files, snapshot 1399596081490642189 (task 2777 ms: download 1151 ms overlapping gunzip 138 ms, parse 450 ms, sort 58 ms, write 957 ms, index 300 ms: 4 candidates, 45878 repo-hours, 93 releases; waiting 550 ms; commit 491 ms)
2026-11-07T03:28:41Z [load_day 2026-10-25] 2026-10-25: repo_hour merged from 24 files to 1 (1030786 rows, 4762 ms)
2026-11-07T03:28:43Z [load_day 2026-10-25] 2026-10-25: index committed in 6455 ms (24 + 1 + 24 files)
2026-11-07T03:28:43Z [load_day 2026-10-25] 2026-10-25: 1670400 events in 24 hours
2026-11-07T03:28:43Z [load_day 2026-10-25] attempt 1 succeeded