orcaLog in

Runs · run 233

load_day 2026-09-01, attempt 1 succeeded

Host
4e84322b8c45:39403
Started
2026-11-07T04:20:16Z
Ended
2026-11-07T04:20:49Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/233/load_day/2026-09-01/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:20:16Z [load_day 2026-09-01] attempt 1 started
2026-11-07T04:20:21Z [load_day 2026-09-01] 2026-09-01 hour 0: 51582 events in 2 files, snapshot 4405265584371959105 (task 1526 ms: download 316 ms overlapping gunzip 67 ms, parse 261 ms, sort 41 ms, write 554 ms, index 104 ms: 1 candidates, 12330 repo-hours, 23 releases; waiting 178 ms; commit 835 ms)
2026-11-07T04:20:22Z [load_day 2026-09-01] 2026-09-01 hour 1: 56955 events in 2 files, snapshot 5154669540812316420 (task 1897 ms: download 819 ms overlapping gunzip 80 ms, parse 303 ms, sort 37 ms, write 540 ms, index 102 ms: 1 candidates, 13474 repo-hours, 14 releases; waiting 521 ms; commit 789 ms)
2026-11-07T04:20:24Z [load_day 2026-09-01] 2026-09-01 hour 2: 64044 events in 2 files, snapshot 7349543624952096937 (task 2446 ms: download 1215 ms overlapping gunzip 82 ms, parse 333 ms, sort 41 ms, write 671 ms, index 129 ms: 1 candidates, 14519 repo-hours, 20 releases; waiting 870 ms; commit 749 ms)
2026-11-07T04:20:24Z [load_day 2026-09-01] 2026-09-01 hour 3: 81826 events in 2 files, snapshot 7517147747694797426 (task 2245 ms: download 1183 ms overlapping gunzip 104 ms, parse 409 ms, sort 54 ms, write 766 ms, index 110 ms: 0 candidates, 16906 repo-hours, 46 releases; waiting 514 ms; commit 726 ms)
2026-11-07T04:20:27Z [load_day 2026-09-01] 2026-09-01 hour 4: 88639 events in 2 files, snapshot 5732758792781749182 (task 2562 ms: download 977 ms overlapping gunzip 140 ms, parse 499 ms, sort 61 ms, write 901 ms, index 121 ms: 1 candidates, 16911 repo-hours, 47 releases; waiting 525 ms; commit 774 ms)
2026-11-07T04:20:28Z [load_day 2026-09-01] 2026-09-01 hour 5: 85558 events in 2 files, snapshot 9040017075511756236 (task 2343 ms: download 895 ms overlapping gunzip 105 ms, parse 412 ms, sort 56 ms, write 910 ms, index 118 ms: 2 candidates, 16591 repo-hours, 22 releases; waiting 522 ms; commit 841 ms)
2026-11-07T04:20:30Z [load_day 2026-09-01] 2026-09-01 hour 6: 79562 events in 2 files, snapshot 7849813382794964989 (task 2340 ms: download 891 ms overlapping gunzip 107 ms, parse 402 ms, sort 51 ms, write 800 ms, index 159 ms: 1 candidates, 15482 repo-hours, 44 releases; waiting 526 ms; commit 758 ms)
2026-11-07T04:20:31Z [load_day 2026-09-01] 2026-09-01 hour 7: 51611 events in 2 files, snapshot 4750182692585650846 (task 1776 ms: download 805 ms overlapping gunzip 70 ms, parse 270 ms, sort 33 ms, write 467 ms, index 90 ms: 0 candidates, 12916 repo-hours, 31 releases; waiting 536 ms; commit 952 ms)
2026-11-07T04:20:32Z [load_day 2026-09-01] 2026-09-01 hour 8: 30154 events in 1 files, snapshot 8913963425487931529 (task 1611 ms: download 722 ms overlapping gunzip 55 ms, parse 195 ms, sort 16 ms, write 353 ms, index 89 ms: 0 candidates, 11199 repo-hours, 54 releases; waiting 495 ms; commit 667 ms)
2026-11-07T04:20:33Z [load_day 2026-09-01] 2026-09-01 hour 9: 17313 events in 1 files, snapshot 8714312060345900289 (task 1289 ms: download 689 ms overlapping gunzip 35 ms, parse 126 ms, sort 9 ms, write 272 ms, index 61 ms: 0 candidates, 8473 repo-hours, 40 releases; waiting 539 ms; commit 743 ms)
2026-11-07T04:20:35Z [load_day 2026-09-01] 2026-09-01 hour 10: 6373 events in 1 files, snapshot 5333637397607243984 (task 1182 ms: download 606 ms overlapping gunzip 21 ms, parse 66 ms, sort 3 ms, write 203 ms, index 43 ms: 0 candidates, 4722 repo-hours, 30 releases; waiting 529 ms; commit 1505 ms)
2026-11-07T04:20:35Z [load_day 2026-09-01] 2026-09-01 hour 11: 3071 events in 1 files, snapshot 2397002791626605942 (task 1458 ms: download 900 ms overlapping gunzip 21 ms, parse 64 ms, sort 2 ms, write 213 ms, index 33 ms: 0 candidates, 2840 repo-hours, 52 releases; waiting 824 ms; commit 791 ms)
2026-11-07T04:20:36Z [load_day 2026-09-01] 2026-09-01 hour 12: 1387 events in 1 files, snapshot 110690359530711056 (task 1154 ms: download 587 ms overlapping gunzip 19 ms, parse 53 ms, sort 1 ms, write 173 ms, index 29 ms: 0 candidates, 1311 repo-hours, 55 releases; waiting 523 ms; commit 682 ms)
2026-11-07T04:20:37Z [load_day 2026-09-01] 2026-09-01 hour 13: 1843 events in 1 files, snapshot 8753434701639873479 (task 1079 ms: download 612 ms overlapping gunzip 22 ms, parse 70 ms, sort 2 ms, write 192 ms, index 48 ms: 0 candidates, 1740 repo-hours, 72 releases; waiting 528 ms; commit 696 ms)
2026-11-07T04:20:38Z [load_day 2026-09-01] 2026-09-01 hour 14: 2248 events in 1 files, snapshot 8573699786129888515 (task 1197 ms: download 639 ms overlapping gunzip 27 ms, parse 85 ms, sort 2 ms, write 230 ms, index 41 ms: 2 candidates, 2130 repo-hours, 86 releases; waiting 539 ms; commit 742 ms)
2026-11-07T04:20:39Z [load_day 2026-09-01] 2026-09-01 hour 15: 1844 events in 1 files, snapshot 4123792060909287664 (task 1155 ms: download 621 ms overlapping gunzip 23 ms, parse 68 ms, sort 2 ms, write 186 ms, index 36 ms: 1 candidates, 1734 repo-hours, 67 releases; waiting 539 ms; commit 860 ms)
2026-11-07T04:20:40Z [load_day 2026-09-01] 2026-09-01 hour 16: 1442 events in 1 files, snapshot 1414323769356274849 (task 1199 ms: download 577 ms overlapping gunzip 17 ms, parse 52 ms, sort 1 ms, write 208 ms, index 34 ms: 0 candidates, 1374 repo-hours, 46 releases; waiting 516 ms; commit 741 ms)
2026-11-07T04:20:41Z [load_day 2026-09-01] 2026-09-01 hour 17: 1269 events in 1 files, snapshot 8738947580620570941 (task 1125 ms: download 577 ms overlapping gunzip 15 ms, parse 46 ms, sort 1 ms, write 179 ms, index 56 ms: 0 candidates, 1208 repo-hours, 41 releases; waiting 524 ms; commit 758 ms)
2026-11-07T04:20:42Z [load_day 2026-09-01] 2026-09-01 hour 18: 1727 events in 1 files, snapshot 5331407435799560241 (task 1186 ms: download 611 ms overlapping gunzip 19 ms, parse 57 ms, sort 2 ms, write 176 ms, index 42 ms: 0 candidates, 1609 repo-hours, 35 releases; waiting 543 ms; commit 774 ms)
2026-11-07T04:20:42Z [load_day 2026-09-01] 2026-09-01 hour 19: 1838 events in 1 files, snapshot 4966592059814237568 (task 1087 ms: download 593 ms overlapping gunzip 19 ms, parse 56 ms, sort 2 ms, write 179 ms, index 29 ms: 0 candidates, 1688 repo-hours, 58 releases; waiting 528 ms; commit 724 ms)
2026-11-07T04:20:43Z [load_day 2026-09-01] 2026-09-01 hour 20: 1977 events in 1 files, snapshot 7755002402883930930 (task 1149 ms: download 621 ms overlapping gunzip 23 ms, parse 70 ms, sort 2 ms, write 200 ms, index 38 ms: 0 candidates, 1807 repo-hours, 59 releases; waiting 536 ms; commit 860 ms)
2026-11-07T04:20:44Z [load_day 2026-09-01] 2026-09-01 hour 21: 1687 events in 1 files, snapshot 8404521337042859944 (task 1124 ms: download 596 ms overlapping gunzip 19 ms, parse 56 ms, sort 1 ms, write 187 ms, index 29 ms: 0 candidates, 1563 repo-hours, 40 releases; waiting 530 ms; commit 732 ms)
2026-11-07T04:20:45Z [load_day 2026-09-01] 2026-09-01 hour 22: 1632 events in 1 files, snapshot 5821273612664711065 (task 1239 ms: download 594 ms overlapping gunzip 20 ms, parse 58 ms, sort 1 ms, write 253 ms, index 32 ms: 0 candidates, 1491 repo-hours, 36 releases; waiting 526 ms; commit 787 ms)
2026-11-07T04:20:46Z [load_day 2026-09-01] 2026-09-01 hour 23: 1850 events in 1 files, snapshot 3049573743297617214 (task 1211 ms: download 622 ms overlapping gunzip 25 ms, parse 70 ms, sort 3 ms, write 205 ms, index 30 ms: 0 candidates, 1665 repo-hours, 53 releases; waiting 536 ms; commit 811 ms)
2026-11-07T04:20:48Z [load_day 2026-09-01] 2026-09-01: repo_hour merged from 24 files to 1 (165683 rows, 1765 ms)
2026-11-07T04:20:49Z [load_day 2026-09-01] 2026-09-01: index committed in 3276 ms (8 + 1 + 24 files)
2026-11-07T04:20:49Z [load_day 2026-09-01] 2026-09-01: 637432 events in 24 hours
2026-11-07T04:20:49Z [load_day 2026-09-01] attempt 1 succeeded