orcaLog in

Runs · run 272

load_day 2026-08-19, attempt 1 succeeded

Host
4e84322b8c45:45287
Started
2026-11-07T04:29:44Z
Ended
2026-11-07T04:30:21Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/272/load_day/2026-08-19/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:29:44Z [load_day 2026-08-19] attempt 1 started
2026-11-07T04:29:49Z [load_day 2026-08-19] 2026-08-19 hour 0: 30580 events in 1 files, snapshot 3220208877978827929 (task 1912 ms: download 817 ms overlapping gunzip 71 ms, parse 253 ms, sort 26 ms, write 639 ms, index 99 ms: 0 candidates, 13801 repo-hours, 99 releases; waiting 542 ms; commit 847 ms)
2026-11-07T04:29:49Z [load_day 2026-08-19] 2026-08-19 hour 1: 55930 events in 2 files, snapshot 5862095908639284809 (task 2167 ms: download 856 ms overlapping gunzip 87 ms, parse 337 ms, sort 45 ms, write 705 ms, index 167 ms: 1 candidates, 20990 repo-hours, 56 releases; waiting 529 ms; commit 729 ms)
2026-11-07T04:29:52Z [load_day 2026-08-19] 2026-08-19 hour 2: 99476 events in 2 files, snapshot 7276404410969870913 (task 2673 ms: download 1164 ms overlapping gunzip 141 ms, parse 555 ms, sort 78 ms, write 962 ms, index 183 ms: 4 candidates, 22796 repo-hours, 23 releases; waiting 534 ms; commit 893 ms)
2026-11-07T04:29:53Z [load_day 2026-08-19] 2026-08-19 hour 3: 129803 events in 3 files, snapshot 4711824177735367316 (task 2958 ms: download 1199 ms overlapping gunzip 149 ms, parse 599 ms, sort 78 ms, write 1184 ms, index 149 ms: 2 candidates, 21213 repo-hours, 12 releases; waiting 525 ms; commit 896 ms)
2026-11-07T04:29:55Z [load_day 2026-08-19] 2026-08-19 hour 4: 137001 events in 3 files, snapshot 4725498548946725438 (task 2728 ms: download 727 ms overlapping gunzip 158 ms, parse 619 ms, sort 88 ms, write 1243 ms, index 138 ms: 0 candidates, 21277 repo-hours, 16 releases; waiting 178 ms; commit 883 ms)
2026-11-07T04:29:57Z [load_day 2026-08-19] 2026-08-19 hour 5: 143338 events in 3 files, snapshot 241184849592226330 (task 3198 ms: download 1158 ms overlapping gunzip 167 ms, parse 661 ms, sort 90 ms, write 1336 ms, index 149 ms: 1 candidates, 21021 repo-hours, 9 releases; waiting 524 ms; commit 789 ms)
2026-11-07T04:29:59Z [load_day 2026-08-19] 2026-08-19 hour 6: 130035 events in 3 files, snapshot 1705139079415671489 (task 3026 ms: download 1083 ms overlapping gunzip 160 ms, parse 617 ms, sort 87 ms, write 1210 ms, index 149 ms: 4 candidates, 21426 repo-hours, 13 releases; waiting 520 ms; commit 1082 ms)
2026-11-07T04:30:00Z [load_day 2026-08-19] 2026-08-19 hour 7: 101373 events in 3 files, snapshot 153443688910133891 (task 2548 ms: download 966 ms overlapping gunzip 125 ms, parse 473 ms, sort 69 ms, write 892 ms, index 157 ms: 1 candidates, 19266 repo-hours, 20 releases; waiting 541 ms; commit 817 ms)
2026-11-07T04:30:02Z [load_day 2026-08-19] 2026-08-19 hour 8: 76785 events in 2 files, snapshot 5324463365044427171 (task 2364 ms: download 897 ms overlapping gunzip 103 ms, parse 394 ms, sort 48 ms, write 812 ms, index 154 ms: 1 candidates, 17805 repo-hours, 29 releases; waiting 542 ms; commit 1116 ms)
2026-11-07T04:30:03Z [load_day 2026-08-19] 2026-08-19 hour 9: 61000 events in 2 files, snapshot 8230291871303883468 (task 2164 ms: download 862 ms overlapping gunzip 88 ms, parse 332 ms, sort 48 ms, write 663 ms, index 178 ms: 2 candidates, 16223 repo-hours, 37 releases; waiting 536 ms; commit 943 ms)
2026-11-07T04:30:05Z [load_day 2026-08-19] 2026-08-19 hour 10: 42597 events in 1 files, snapshot 3061512101397969534 (task 1737 ms: download 810 ms overlapping gunzip 67 ms, parse 250 ms, sort 27 ms, write 426 ms, index 92 ms: 0 candidates, 13595 repo-hours, 37 releases; waiting 551 ms; commit 889 ms)
2026-11-07T04:30:06Z [load_day 2026-08-19] 2026-08-19 hour 11: 35779 events in 1 files, snapshot 7330813559576184899 (task 1689 ms: download 793 ms overlapping gunzip 64 ms, parse 230 ms, sort 24 ms, write 417 ms, index 135 ms: 0 candidates, 12645 repo-hours, 35 releases; waiting 560 ms; commit 986 ms)
2026-11-07T04:30:07Z [load_day 2026-08-19] 2026-08-19 hour 12: 26242 events in 1 files, snapshot 4317640831463937350 (task 1596 ms: download 772 ms overlapping gunzip 54 ms, parse 188 ms, sort 15 ms, write 375 ms, index 74 ms: 0 candidates, 10512 repo-hours, 49 releases; waiting 563 ms; commit 889 ms)
2026-11-07T04:30:08Z [load_day 2026-08-19] 2026-08-19 hour 13: 8754 events in 1 files, snapshot 7823556510700658917 (task 1237 ms: download 630 ms overlapping gunzip 27 ms, parse 80 ms, sort 3 ms, write 230 ms, index 53 ms: 2 candidates, 5358 repo-hours, 39 releases; waiting 536 ms; commit 958 ms)
2026-11-07T04:30:09Z [load_day 2026-08-19] 2026-08-19 hour 14: 3511 events in 1 files, snapshot 85975524505301283 (task 1158 ms: download 586 ms overlapping gunzip 18 ms, parse 53 ms, sort 1 ms, write 172 ms, index 50 ms: 0 candidates, 2882 repo-hours, 35 releases; waiting 526 ms; commit 937 ms)
2026-11-07T04:30:10Z [load_day 2026-08-19] 2026-08-19 hour 15: 898 events in 1 files, snapshot 2605306285806777689 (task 768 ms: download 235 ms overlapping gunzip 11 ms, parse 27 ms, sort 0 ms, write 160 ms, index 48 ms: 0 candidates, 855 repo-hours, 37 releases; waiting 208 ms; commit 854 ms)
2026-11-07T04:30:11Z [load_day 2026-08-19] 2026-08-19 hour 16: 1441 events in 1 files, snapshot 7937123681736566489 (task 1110 ms: download 585 ms overlapping gunzip 18 ms, parse 47 ms, sort 1 ms, write 181 ms, index 35 ms: 0 candidates, 1345 repo-hours, 29 releases; waiting 531 ms; commit 896 ms)
2026-11-07T04:30:12Z [load_day 2026-08-19] 2026-08-19 hour 17: 1805 events in 1 files, snapshot 6046290267733562619 (task 967 ms: download 382 ms overlapping gunzip 20 ms, parse 59 ms, sort 2 ms, write 219 ms, index 29 ms: 0 candidates, 1603 repo-hours, 48 releases; waiting 315 ms; commit 993 ms)
2026-11-07T04:30:13Z [load_day 2026-08-19] 2026-08-19 hour 18: 1534 events in 1 files, snapshot 5963435148351573734 (task 1160 ms: download 610 ms overlapping gunzip 21 ms, parse 61 ms, sort 2 ms, write 189 ms, index 29 ms: 0 candidates, 1403 repo-hours, 46 releases; waiting 537 ms; commit 1021 ms)
2026-11-07T04:30:14Z [load_day 2026-08-19] 2026-08-19 hour 19: 1237 events in 1 files, snapshot 850435282870716861 (task 1083 ms: download 570 ms overlapping gunzip 17 ms, parse 48 ms, sort 1 ms, write 200 ms, index 29 ms: 0 candidates, 1157 repo-hours, 32 releases; waiting 515 ms; commit 770 ms)
2026-11-07T04:30:14Z [load_day 2026-08-19] 2026-08-19 hour 20: 1080 events in 1 files, snapshot 8825340141098843027 (task 1097 ms: download 579 ms overlapping gunzip 14 ms, parse 40 ms, sort 0 ms, write 170 ms, index 43 ms: 1 candidates, 1025 repo-hours, 23 releases; waiting 532 ms; commit 794 ms)
2026-11-07T04:30:15Z [load_day 2026-08-19] 2026-08-19 hour 21: 1004 events in 1 files, snapshot 4725381694283865648 (task 1123 ms: download 554 ms overlapping gunzip 14 ms, parse 39 ms, sort 0 ms, write 202 ms, index 28 ms: 0 candidates, 934 repo-hours, 17 releases; waiting 510 ms; commit 924 ms)
2026-11-07T04:30:16Z [load_day 2026-08-19] 2026-08-19 hour 22: 950 events in 1 files, snapshot 4475719618929968596 (task 1047 ms: download 558 ms overlapping gunzip 14 ms, parse 39 ms, sort 0 ms, write 161 ms, index 30 ms: 0 candidates, 875 repo-hours, 20 releases; waiting 512 ms; commit 859 ms)
2026-11-07T04:30:17Z [load_day 2026-08-19] 2026-08-19 hour 23: 1000 events in 1 files, snapshot 8219155789289236665 (task 1030 ms: download 246 ms overlapping gunzip 17 ms, parse 41 ms, sort 0 ms, write 173 ms, index 32 ms: 0 candidates, 900 repo-hours, 26 releases; waiting 198 ms; commit 931 ms)
2026-11-07T04:30:19Z [load_day 2026-08-19] 2026-08-19: repo_hour merged from 24 files to 1 (250907 rows, 1923 ms)
2026-11-07T04:30:21Z [load_day 2026-08-19] 2026-08-19: index committed in 3616 ms (10 + 1 + 24 files)
2026-11-07T04:30:21Z [load_day 2026-08-19] 2026-08-19: 1093153 events in 24 hours
2026-11-07T04:30:21Z [load_day 2026-08-19] attempt 1 succeeded