orcaLog in

Runs · run 251

load_day 2026-08-26, attempt 1 succeeded

Host
4e84322b8c45:41513
Started
2026-11-07T04:24:17Z
Ended
2026-11-07T04:25:02Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/251/load_day/2026-08-26/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:24:17Z [load_day 2026-08-26] attempt 1 started
2026-11-07T04:24:22Z [load_day 2026-08-26] 2026-08-26 hour 0: 88054 events in 2 files, snapshot 7704916849016176433 (task 2598 ms: download 927 ms overlapping gunzip 110 ms, parse 441 ms, sort 60 ms, write 964 ms, index 136 ms: 1 candidates, 19475 repo-hours, 27 releases; waiting 530 ms; commit 865 ms)
2026-11-07T04:24:23Z [load_day 2026-08-26] 2026-08-26 hour 1: 96632 events in 2 files, snapshot 3164598331748834983 (task 2861 ms: download 1051 ms overlapping gunzip 137 ms, parse 546 ms, sort 92 ms, write 1046 ms, index 160 ms: 3 candidates, 22185 repo-hours, 28 releases; waiting 546 ms; commit 706 ms)
2026-11-07T04:24:25Z [load_day 2026-08-26] 2026-08-26 hour 2: 95605 events in 2 files, snapshot 3431628867189399357 (task 2495 ms: download 1176 ms overlapping gunzip 126 ms, parse 475 ms, sort 65 ms, write 847 ms, index 130 ms: 0 candidates, 20108 repo-hours, 22 releases; waiting 529 ms; commit 658 ms)
2026-11-07T04:24:26Z [load_day 2026-08-26] 2026-08-26 hour 3: 116246 events in 3 files, snapshot 6797208652485105856 (task 2875 ms: download 1087 ms overlapping gunzip 136 ms, parse 541 ms, sort 67 ms, write 1063 ms, index 135 ms: 3 candidates, 17776 repo-hours, 20 releases; waiting 530 ms; commit 752 ms)
2026-11-07T04:24:28Z [load_day 2026-08-26] 2026-08-26 hour 4: 112402 events in 3 files, snapshot 1855982333920061134 (task 2621 ms: download 1008 ms overlapping gunzip 133 ms, parse 516 ms, sort 70 ms, write 1027 ms, index 108 ms: 0 candidates, 16827 repo-hours, 11 releases; waiting 512 ms; commit 756 ms)
2026-11-07T04:24:30Z [load_day 2026-08-26] 2026-08-26 hour 5: 111663 events in 3 files, snapshot 5468779628305118615 (task 2776 ms: download 1055 ms overlapping gunzip 132 ms, parse 519 ms, sort 71 ms, write 1058 ms, index 134 ms: 2 candidates, 18214 repo-hours, 12 releases; waiting 521 ms; commit 976 ms)
2026-11-07T04:24:31Z [load_day 2026-08-26] 2026-08-26 hour 6: 105937 events in 3 files, snapshot 3470743570262909310 (task 2813 ms: download 726 ms overlapping gunzip 123 ms, parse 493 ms, sort 70 ms, write 981 ms, index 163 ms: 2 candidates, 19771 repo-hours, 17 releases; waiting 240 ms; commit 858 ms)
2026-11-07T04:24:34Z [load_day 2026-08-26] 2026-08-26 hour 7: 106657 events in 3 files, snapshot 844261471541183010 (task 2881 ms: download 1097 ms overlapping gunzip 133 ms, parse 546 ms, sort 73 ms, write 1089 ms, index 162 ms: 3 candidates, 20866 repo-hours, 18 releases; waiting 520 ms; commit 972 ms)
2026-11-07T04:24:35Z [load_day 2026-08-26] 2026-08-26 hour 8: 108079 events in 3 files, snapshot 8721491343711479510 (task 2686 ms: download 1281 ms overlapping gunzip 128 ms, parse 493 ms, sort 66 ms, write 1004 ms, index 146 ms: 3 candidates, 21193 repo-hours, 16 releases; waiting 554 ms; commit 779 ms)
2026-11-07T04:24:37Z [load_day 2026-08-26] 2026-08-26 hour 9: 105622 events in 3 files, snapshot 1312282871224247306 (task 2695 ms: download 1014 ms overlapping gunzip 138 ms, parse 521 ms, sort 72 ms, write 955 ms, index 149 ms: 3 candidates, 20555 repo-hours, 15 releases; waiting 515 ms; commit 889 ms)
2026-11-07T04:24:38Z [load_day 2026-08-26] 2026-08-26 hour 10: 97438 events in 2 files, snapshot 45108275251397687 (task 2594 ms: download 1169 ms overlapping gunzip 121 ms, parse 460 ms, sort 60 ms, write 913 ms, index 158 ms: 1 candidates, 20635 repo-hours, 22 releases; waiting 537 ms; commit 873 ms)
2026-11-07T04:24:40Z [load_day 2026-08-26] 2026-08-26 hour 11: 94535 events in 2 files, snapshot 5415501090773221298 (task 2671 ms: download 967 ms overlapping gunzip 123 ms, parse 469 ms, sort 66 ms, write 890 ms, index 281 ms: 4 candidates, 21796 repo-hours, 32 releases; waiting 526 ms; commit 755 ms)
2026-11-07T04:24:41Z [load_day 2026-08-26] 2026-08-26 hour 12: 95536 events in 2 files, snapshot 4495086127475270929 (task 2534 ms: download 1080 ms overlapping gunzip 122 ms, parse 462 ms, sort 61 ms, write 885 ms, index 164 ms: 2 candidates, 23713 repo-hours, 36 releases; waiting 507 ms; commit 757 ms)
2026-11-07T04:24:43Z [load_day 2026-08-26] 2026-08-26 hour 13: 90325 events in 2 files, snapshot 9008763817132368748 (task 2563 ms: download 1050 ms overlapping gunzip 132 ms, parse 480 ms, sort 58 ms, write 871 ms, index 188 ms: 4 candidates, 23605 repo-hours, 39 releases; waiting 530 ms; commit 752 ms)
2026-11-07T04:24:44Z [load_day 2026-08-26] 2026-08-26 hour 14: 84380 events in 2 files, snapshot 5457675286782657800 (task 2468 ms: download 951 ms overlapping gunzip 124 ms, parse 459 ms, sort 54 ms, write 827 ms, index 154 ms: 2 candidates, 23093 repo-hours, 39 releases; waiting 546 ms; commit 958 ms)
2026-11-07T04:24:46Z [load_day 2026-08-26] 2026-08-26 hour 15: 84693 events in 2 files, snapshot 5886851828556412198 (task 2472 ms: download 1010 ms overlapping gunzip 119 ms, parse 443 ms, sort 60 ms, write 848 ms, index 162 ms: 2 candidates, 19012 repo-hours, 15 releases; waiting 545 ms; commit 912 ms)
2026-11-07T04:24:47Z [load_day 2026-08-26] 2026-08-26 hour 16: 90320 events in 2 files, snapshot 1599742833110561099 (task 2407 ms: download 994 ms overlapping gunzip 112 ms, parse 444 ms, sort 59 ms, write 846 ms, index 169 ms: 3 candidates, 21845 repo-hours, 30 releases; waiting 552 ms; commit 729 ms)
2026-11-07T04:24:49Z [load_day 2026-08-26] 2026-08-26 hour 17: 89401 events in 2 files, snapshot 7306638091352917220 (task 2611 ms: download 929 ms overlapping gunzip 121 ms, parse 452 ms, sort 58 ms, write 956 ms, index 167 ms: 1 candidates, 20659 repo-hours, 37 releases; waiting 522 ms; commit 767 ms)
2026-11-07T04:24:50Z [load_day 2026-08-26] 2026-08-26 hour 18: 87591 events in 2 files, snapshot 7716389860937244684 (task 2505 ms: download 962 ms overlapping gunzip 124 ms, parse 475 ms, sort 63 ms, write 847 ms, index 162 ms: 0 candidates, 21166 repo-hours, 37 releases; waiting 545 ms; commit 816 ms)
2026-11-07T04:24:52Z [load_day 2026-08-26] 2026-08-26 hour 19: 85183 events in 2 files, snapshot 4759291427524939624 (task 2420 ms: download 922 ms overlapping gunzip 115 ms, parse 450 ms, sort 56 ms, write 843 ms, index 161 ms: 2 candidates, 21366 repo-hours, 48 releases; waiting 524 ms; commit 806 ms)
2026-11-07T04:24:53Z [load_day 2026-08-26] 2026-08-26 hour 20: 80143 events in 2 files, snapshot 2869253256088212956 (task 2350 ms: download 1052 ms overlapping gunzip 108 ms, parse 412 ms, sort 51 ms, write 807 ms, index 146 ms: 3 candidates, 19940 repo-hours, 37 releases; waiting 528 ms; commit 1020 ms)
2026-11-07T04:24:55Z [load_day 2026-08-26] 2026-08-26 hour 21: 86574 events in 2 files, snapshot 9171920512582314972 (task 2436 ms: download 868 ms overlapping gunzip 127 ms, parse 494 ms, sort 67 ms, write 887 ms, index 153 ms: 5 candidates, 18336 repo-hours, 50 releases; waiting 412 ms; commit 837 ms)
2026-11-07T04:24:56Z [load_day 2026-08-26] 2026-08-26 hour 22: 86310 events in 2 files, snapshot 715800586958339120 (task 2428 ms: download 961 ms overlapping gunzip 113 ms, parse 421 ms, sort 59 ms, write 827 ms, index 127 ms: 2 candidates, 17354 repo-hours, 48 releases; waiting 530 ms; commit 722 ms)
2026-11-07T04:24:57Z [load_day 2026-08-26] 2026-08-26 hour 23: 83578 events in 2 files, snapshot 8509231911533349777 (task 1989 ms: download 560 ms overlapping gunzip 110 ms, parse 419 ms, sort 59 ms, write 806 ms, index 122 ms: 4 candidates, 16888 repo-hours, 36 releases; waiting 201 ms; commit 763 ms)
2026-11-07T04:25:00Z [load_day 2026-08-26] 2026-08-26: repo_hour merged from 24 files to 1 (486378 rows, 2860 ms)
2026-11-07T04:25:02Z [load_day 2026-08-26] 2026-08-26: index committed in 4579 ms (21 + 1 + 24 files)
2026-11-07T04:25:02Z [load_day 2026-08-26] 2026-08-26: 2282904 events in 24 hours
2026-11-07T04:25:02Z [load_day 2026-08-26] attempt 1 succeeded