orcaLog in

Runs · run 212

load_day 2026-09-08, attempt 1 succeeded

Host
4e84322b8c45:36315
Started
2026-11-07T04:10:49Z
Ended
2026-11-07T04:11:34Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/212/load_day/2026-09-08/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:10:49Z [load_day 2026-09-08] attempt 1 started
2026-11-07T04:10:55Z [load_day 2026-09-08] 2026-09-08 hour 0: 83301 events in 2 files, snapshot 8428831084400849747 (task 3078 ms: download 1183 ms overlapping gunzip 156 ms, parse 546 ms, sort 74 ms, write 1285 ms, index 159 ms: 4 candidates, 22251 repo-hours, 135 releases; waiting 546 ms; commit 666 ms)
2026-11-07T04:10:56Z [load_day 2026-09-08] 2026-09-08 hour 1: 83456 events in 2 files, snapshot 7049314510619387675 (task 2955 ms: download 1119 ms overlapping gunzip 151 ms, parse 541 ms, sort 76 ms, write 1135 ms, index 165 ms: 4 candidates, 24327 repo-hours, 137 releases; waiting 506 ms; commit 666 ms)
2026-11-07T04:10:59Z [load_day 2026-09-08] 2026-09-08 hour 2: 81592 events in 2 files, snapshot 7859364284992399545 (task 2714 ms: download 1076 ms overlapping gunzip 149 ms, parse 496 ms, sort 66 ms, write 987 ms, index 158 ms: 7 candidates, 25117 repo-hours, 131 releases; waiting 537 ms; commit 836 ms)
2026-11-07T04:10:59Z [load_day 2026-09-08] 2026-09-08 hour 3: 74609 events in 2 files, snapshot 2031515769027304538 (task 2637 ms: download 995 ms overlapping gunzip 135 ms, parse 451 ms, sort 57 ms, write 1052 ms, index 165 ms: 1 candidates, 25767 repo-hours, 156 releases; waiting 552 ms; commit 548 ms)
2026-11-07T04:11:02Z [load_day 2026-09-08] 2026-09-08 hour 4: 76083 events in 2 files, snapshot 1114678771333331593 (task 2728 ms: download 1091 ms overlapping gunzip 163 ms, parse 536 ms, sort 65 ms, write 978 ms, index 163 ms: 6 candidates, 23564 repo-hours, 96 releases; waiting 558 ms; commit 665 ms)
2026-11-07T04:11:03Z [load_day 2026-09-08] 2026-09-08 hour 5: 74583 events in 2 files, snapshot 1315883964430430216 (task 2484 ms: download 862 ms overlapping gunzip 160 ms, parse 503 ms, sort 55 ms, write 931 ms, index 151 ms: 4 candidates, 22998 repo-hours, 95 releases; waiting 402 ms; commit 769 ms)
2026-11-07T04:11:05Z [load_day 2026-09-08] 2026-09-08 hour 6: 91165 events in 2 files, snapshot 5129822370189816396 (task 2754 ms: download 1132 ms overlapping gunzip 166 ms, parse 560 ms, sort 61 ms, write 1010 ms, index 180 ms: 4 candidates, 25323 repo-hours, 97 releases; waiting 544 ms; commit 736 ms)
2026-11-07T04:11:06Z [load_day 2026-09-08] 2026-09-08 hour 7: 84653 events in 2 files, snapshot 2677693906528496754 (task 2402 ms: download 869 ms overlapping gunzip 130 ms, parse 467 ms, sort 66 ms, write 897 ms, index 172 ms: 4 candidates, 23217 repo-hours, 67 releases; waiting 430 ms; commit 579 ms)
2026-11-07T04:11:09Z [load_day 2026-09-08] 2026-09-08 hour 8: 95812 events in 2 files, snapshot 5110049887608709165 (task 2809 ms: download 989 ms overlapping gunzip 143 ms, parse 525 ms, sort 72 ms, write 1004 ms, index 253 ms: 4 candidates, 26523 repo-hours, 78 releases; waiting 534 ms; commit 656 ms)
2026-11-07T04:11:09Z [load_day 2026-09-08] 2026-09-08 hour 9: 103699 events in 3 files, snapshot 2892434902838819309 (task 2842 ms: download 1076 ms overlapping gunzip 148 ms, parse 527 ms, sort 69 ms, write 1093 ms, index 170 ms: 2 candidates, 25603 repo-hours, 74 releases; waiting 534 ms; commit 671 ms)
2026-11-07T04:11:12Z [load_day 2026-09-08] 2026-09-08 hour 10: 106274 events in 3 files, snapshot 7084978580438729596 (task 2907 ms: download 1319 ms overlapping gunzip 151 ms, parse 531 ms, sort 68 ms, write 1144 ms, index 169 ms: 1 candidates, 26342 repo-hours, 77 releases; waiting 538 ms; commit 740 ms)
2026-11-07T04:11:13Z [load_day 2026-09-08] 2026-09-08 hour 11: 104689 events in 3 files, snapshot 1715190256196141168 (task 2842 ms: download 1153 ms overlapping gunzip 144 ms, parse 516 ms, sort 62 ms, write 1114 ms, index 180 ms: 5 candidates, 27106 repo-hours, 64 releases; waiting 538 ms; commit 629 ms)
2026-11-07T04:11:16Z [load_day 2026-09-08] 2026-09-08 hour 12: 112694 events in 3 files, snapshot 2253337827217319957 (task 3125 ms: download 1186 ms overlapping gunzip 167 ms, parse 582 ms, sort 87 ms, write 1266 ms, index 177 ms: 4 candidates, 25890 repo-hours, 77 releases; waiting 534 ms; commit 669 ms)
2026-11-07T04:11:16Z [load_day 2026-09-08] 2026-09-08 hour 13: 99477 events in 2 files, snapshot 6868294627156274856 (task 2709 ms: download 1134 ms overlapping gunzip 144 ms, parse 524 ms, sort 64 ms, write 989 ms, index 159 ms: 3 candidates, 24797 repo-hours, 71 releases; waiting 530 ms; commit 673 ms)
2026-11-07T04:11:19Z [load_day 2026-09-08] 2026-09-08 hour 14: 87563 events in 2 files, snapshot 3681856261524746936 (task 2519 ms: download 1104 ms overlapping gunzip 129 ms, parse 452 ms, sort 54 ms, write 890 ms, index 160 ms: 4 candidates, 22543 repo-hours, 78 releases; waiting 533 ms; commit 609 ms)
2026-11-07T04:11:20Z [load_day 2026-09-08] 2026-09-08 hour 15: 63057 events in 2 files, snapshot 743451363880492660 (task 2415 ms: download 918 ms overlapping gunzip 126 ms, parse 410 ms, sort 45 ms, write 837 ms, index 130 ms: 6 candidates, 18450 repo-hours, 97 releases; waiting 557 ms; commit 761 ms)
2026-11-07T04:11:21Z [load_day 2026-09-08] 2026-09-08 hour 16: 49488 events in 1 files, snapshot 6783446087775487844 (task 1885 ms: download 841 ms overlapping gunzip 87 ms, parse 296 ms, sort 41 ms, write 528 ms, index 113 ms: 3 candidates, 16107 repo-hours, 68 releases; waiting 547 ms; commit 705 ms)
2026-11-07T04:11:22Z [load_day 2026-09-08] 2026-09-08 hour 17: 41784 events in 1 files, snapshot 7020611091287237816 (task 1951 ms: download 885 ms overlapping gunzip 89 ms, parse 290 ms, sort 27 ms, write 623 ms, index 116 ms: 2 candidates, 14865 repo-hours, 99 releases; waiting 557 ms; commit 765 ms)
2026-11-07T04:11:23Z [load_day 2026-09-08] 2026-09-08 hour 18: 34139 events in 1 files, snapshot 4405203606081450489 (task 1862 ms: download 802 ms overlapping gunzip 77 ms, parse 247 ms, sort 21 ms, write 543 ms, index 103 ms: 3 candidates, 13665 repo-hours, 102 releases; waiting 545 ms; commit 679 ms)
2026-11-07T04:11:25Z [load_day 2026-09-08] 2026-09-08 hour 19: 13226 events in 1 files, snapshot 1615483411617236157 (task 1921 ms: download 819 ms overlapping gunzip 76 ms, parse 231 ms, sort 10 ms, write 590 ms, index 89 ms: 1 candidates, 9567 repo-hours, 150 releases; waiting 576 ms; commit 662 ms)
2026-11-07T04:11:26Z [load_day 2026-09-08] 2026-09-08 hour 20: 5010 events in 1 files, snapshot 1475728695888698678 (task 1664 ms: download 762 ms overlapping gunzip 58 ms, parse 165 ms, sort 6 ms, write 499 ms, index 64 ms: 0 candidates, 4329 repo-hours, 137 releases; waiting 569 ms; commit 737 ms)
2026-11-07T04:11:27Z [load_day 2026-09-08] 2026-09-08 hour 21: 5617 events in 1 files, snapshot 1263665838250737278 (task 1623 ms: download 791 ms overlapping gunzip 65 ms, parse 193 ms, sort 6 ms, write 475 ms, index 44 ms: 0 candidates, 4678 repo-hours, 177 releases; waiting 563 ms; commit 780 ms)
2026-11-07T04:11:28Z [load_day 2026-09-08] 2026-09-08 hour 22: 8979 events in 1 files, snapshot 7796765102344178291 (task 2105 ms: download 865 ms overlapping gunzip 98 ms, parse 294 ms, sort 26 ms, write 738 ms, index 65 ms: 2 candidates, 6870 repo-hours, 226 releases; waiting 555 ms; commit 752 ms)
2026-11-07T04:11:30Z [load_day 2026-09-08] 2026-09-08 hour 23: 14002 events in 1 files, snapshot 4152639411824084378 (task 2544 ms: download 1016 ms overlapping gunzip 128 ms, parse 380 ms, sort 35 ms, write 1077 ms, index 92 ms: 1 candidates, 10416 repo-hours, 353 releases; waiting 566 ms; commit 833 ms)
2026-11-07T04:11:33Z [load_day 2026-09-08] 2026-09-08: repo_hour merged from 24 files to 1 (470315 rows, 2663 ms)
2026-11-07T04:11:34Z [load_day 2026-09-08] 2026-09-08: index committed in 4265 ms (22 + 1 + 24 files)
2026-11-07T04:11:34Z [load_day 2026-09-08] 2026-09-08: 1594952 events in 24 hours
2026-11-07T04:11:34Z [load_day 2026-09-08] attempt 1 succeeded