orcaLog in

Runs · run 1330

load_day 2023-07-25, attempt 1 succeeded

Host
3c2b29713ce8:158917
Started
2026-11-07T23:16:14Z
Ended
2026-11-07T23:20:14Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1330/load_day/2023-07-25/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T23:16:14Z [load_day 2023-07-25] attempt 1 started
2026-11-07T23:16:16Z [load_day 2023-07-25] 2023-07-25: 2 hours in flight, about 1200 MB
2026-11-07T23:16:35Z [load_day 2023-07-25] 2023-07-25 hour 0: 154141 events in 4 files, snapshot 2797865195298288910 (task 15662 ms: download 6895 ms overlapping gunzip 1001 ms, parse 4658 ms, sort 173 ms, write 8730 ms, index 490 ms: 3 candidates, 72140 repo-hours, 867 releases; waiting 275 ms; commit 2385 ms)
2026-11-07T23:16:38Z [load_day 2023-07-25] 2023-07-25 hour 1: 151060 events in 4 files, snapshot 5998879826318812848 (task 14787 ms: download 6025 ms overlapping gunzip 773 ms, parse 3672 ms, sort 193 ms, write 8764 ms, index 572 ms: 6 candidates, 83311 repo-hours, 799 releases; waiting 490 ms; commit 2318 ms)
2026-11-07T23:16:50Z [load_day 2023-07-25] 2023-07-25 hour 2: 145954 events in 3 files, snapshot 1032018380393875850 (task 14049 ms: download 6240 ms overlapping gunzip 862 ms, parse 3486 ms, sort 133 ms, write 7939 ms, index 480 ms: 4 candidates, 70177 repo-hours, 745 releases; waiting 912 ms; commit 2287 ms)
2026-11-07T23:16:55Z [load_day 2023-07-25] 2023-07-25 hour 3: 138168 events in 3 files, snapshot 3292254407701713870 (task 13826 ms: download 5942 ms overlapping gunzip 811 ms, parse 3598 ms, sort 146 ms, write 7835 ms, index 494 ms: 2 candidates, 57963 repo-hours, 883 releases; waiting 511 ms; commit 4223 ms)
2026-11-07T23:17:06Z [load_day 2023-07-25] 2023-07-25 hour 4: 130997 events in 3 files, snapshot 7927285942680422958 (task 12681 ms: download 5854 ms overlapping gunzip 780 ms, parse 3103 ms, sort 116 ms, write 7461 ms, index 387 ms: 5 candidates, 54636 repo-hours, 612 releases; waiting 535 ms; commit 4409 ms)
2026-11-07T23:17:09Z [load_day 2023-07-25] 2023-07-25 hour 5: 146281 events in 3 files, snapshot 7849679742242404987 (task 15189 ms: download 5991 ms overlapping gunzip 919 ms, parse 3746 ms, sort 102 ms, write 8981 ms, index 643 ms: 5 candidates, 63742 repo-hours, 878 releases; waiting 490 ms; commit 2283 ms)
2026-11-07T23:17:23Z [load_day 2023-07-25] 2023-07-25 hour 6: 168259 events in 4 files, snapshot 6237339153226143127 (task 17390 ms: download 10425 ms overlapping gunzip 1016 ms, parse 4470 ms, sort 117 ms, write 10404 ms, index 567 ms: 4 candidates, 77582 repo-hours, 835 releases; waiting 489 ms; commit 2497 ms)
2026-11-07T23:17:31Z [load_day 2023-07-25] 2023-07-25 hour 7: 178170 events in 4 files, snapshot 8037017983261203191 (task 19697 ms: download 11212 ms overlapping gunzip 1131 ms, parse 4854 ms, sort 169 ms, write 11587 ms, index 1180 ms: 4 candidates, 77121 repo-hours, 877 releases; waiting 453 ms; commit 3089 ms)
2026-11-07T23:17:44Z [load_day 2023-07-25] 2023-07-25 hour 8: 184174 events in 4 files, snapshot 180895512784406222 (task 20353 ms: download 11398 ms overlapping gunzip 1091 ms, parse 4865 ms, sort 162 ms, write 12819 ms, index 606 ms: 9 candidates, 82394 repo-hours, 1052 releases; waiting 482 ms; commit 2704 ms)
2026-11-07T23:17:53Z [load_day 2023-07-25] 2023-07-25 hour 9: 178854 events in 4 files, snapshot 3075689652789913642 (task 20883 ms: download 12299 ms overlapping gunzip 1075 ms, parse 4763 ms, sort 126 ms, write 13054 ms, index 1049 ms: 5 candidates, 81200 repo-hours, 1122 releases; waiting 499 ms; commit 2697 ms)
2026-11-07T23:18:04Z [load_day 2023-07-25] 2023-07-25 hour 10: 177122 events in 4 files, snapshot 5805010490401404581 (task 18959 ms: download 11246 ms overlapping gunzip 1130 ms, parse 5071 ms, sort 145 ms, write 10970 ms, index 822 ms: 3 candidates, 77453 repo-hours, 1059 releases; waiting 492 ms; commit 2505 ms)
2026-11-07T23:18:13Z [load_day 2023-07-25] 2023-07-25 hour 11: 182196 events in 4 files, snapshot 6167438180654012641 (task 18511 ms: download 10691 ms overlapping gunzip 962 ms, parse 4340 ms, sort 111 ms, write 11751 ms, index 598 ms: 3 candidates, 77624 repo-hours, 1113 releases; waiting 468 ms; commit 2859 ms)
2026-11-07T23:18:25Z [load_day 2023-07-25] 2023-07-25 hour 12: 217989 events in 5 files, snapshot 4920616257438921566 (task 20542 ms: download 10701 ms overlapping gunzip 1140 ms, parse 5146 ms, sort 128 ms, write 12398 ms, index 964 ms: 5 candidates, 108956 repo-hours, 1114 releases; waiting 485 ms; commit 2121 ms)
2026-11-07T23:18:34Z [load_day 2023-07-25] 2023-07-25 hour 13: 196818 events in 4 files, snapshot 4599023012135462478 (task 20784 ms: download 11064 ms overlapping gunzip 1243 ms, parse 5582 ms, sort 164 ms, write 12277 ms, index 700 ms: 6 candidates, 100317 repo-hours, 992 releases; waiting 476 ms; commit 2443 ms)
2026-11-07T23:18:46Z [load_day 2023-07-25] 2023-07-25 hour 14: 194060 events in 4 files, snapshot 1198681537862038928 (task 19937 ms: download 12298 ms overlapping gunzip 1037 ms, parse 4584 ms, sort 117 ms, write 12809 ms, index 573 ms: 5 candidates, 88425 repo-hours, 1081 releases; waiting 540 ms; commit 2174 ms)
2026-11-07T23:18:51Z [load_day 2023-07-25] 2023-07-25 hour 15: 170848 events in 4 files, snapshot 7649058415671661709 (task 16056 ms: download 9485 ms overlapping gunzip 932 ms, parse 4240 ms, sort 100 ms, write 9506 ms, index 538 ms: 10 candidates, 81844 repo-hours, 1076 releases; waiting 457 ms; commit 2030 ms)
2026-11-07T23:19:05Z [load_day 2023-07-25] 2023-07-25 hour 16: 172522 events in 4 files, snapshot 1724694361370114260 (task 16704 ms: download 8832 ms overlapping gunzip 989 ms, parse 4339 ms, sort 113 ms, write 9817 ms, index 616 ms: 5 candidates, 78424 repo-hours, 867 releases; waiting 518 ms; commit 2985 ms)
2026-11-07T23:19:10Z [load_day 2023-07-25] 2023-07-25 hour 17: 182391 events in 4 files, snapshot 3206352154826424044 (task 17755 ms: download 9829 ms overlapping gunzip 1097 ms, parse 4834 ms, sort 109 ms, write 10236 ms, index 695 ms: 12 candidates, 78263 repo-hours, 998 releases; waiting 509 ms; commit 2359 ms)
2026-11-07T23:19:24Z [load_day 2023-07-25] 2023-07-25 hour 18: 187028 events in 4 files, snapshot 3669693217174623463 (task 18035 ms: download 9380 ms overlapping gunzip 1053 ms, parse 4733 ms, sort 122 ms, write 11052 ms, index 575 ms: 7 candidates, 82427 repo-hours, 1082 releases; waiting 184 ms; commit 2272 ms)
2026-11-07T23:19:29Z [load_day 2023-07-25] 2023-07-25 hour 19: 171940 events in 4 files, snapshot 1687362100531246512 (task 16765 ms: download 10268 ms overlapping gunzip 1075 ms, parse 5098 ms, sort 110 ms, write 9418 ms, index 547 ms: 9 candidates, 72512 repo-hours, 970 releases; waiting 223 ms; commit 2906 ms)
2026-11-07T23:19:45Z [load_day 2023-07-25] 2023-07-25 hour 20: 176529 events in 4 files, snapshot 6954797568486573889 (task 19345 ms: download 11494 ms overlapping gunzip 1198 ms, parse 5426 ms, sort 105 ms, write 11252 ms, index 541 ms: 8 candidates, 75417 repo-hours, 963 releases; waiting 517 ms; commit 2517 ms)
2026-11-07T23:19:48Z [load_day 2023-07-25] 2023-07-25 hour 21: 164952 events in 4 files, snapshot 588991905923103796 (task 18658 ms: download 11172 ms overlapping gunzip 1114 ms, parse 4806 ms, sort 139 ms, write 10994 ms, index 642 ms: 10 candidates, 67724 repo-hours, 1034 releases; waiting 482 ms; commit 2613 ms)
2026-11-07T23:19:59Z [load_day 2023-07-25] 2023-07-25 hour 22: 143792 events in 3 files, snapshot 4366687290213019754 (task 13943 ms: download 6445 ms overlapping gunzip 860 ms, parse 3875 ms, sort 90 ms, write 7749 ms, index 508 ms: 2 candidates, 56856 repo-hours, 946 releases; waiting 535 ms; commit 2309 ms)
2026-11-07T23:20:04Z [load_day 2023-07-25] 2023-07-25 hour 23: 136501 events in 3 files, snapshot 8554918661086681598 (task 13608 ms: download 5938 ms overlapping gunzip 818 ms, parse 3701 ms, sort 100 ms, write 7366 ms, index 409 ms: 4 candidates, 55712 repo-hours, 668 releases; waiting 511 ms; commit 3111 ms)
2026-11-07T23:20:11Z [load_day 2023-07-25] 2023-07-25: repo_hour merged from 24 files to 1 (1822220 rows, 7617 ms)
2026-11-07T23:20:14Z [load_day 2023-07-25] 2023-07-25: index committed in 10741 ms (24 + 1 + 24 files)
2026-11-07T23:20:14Z [load_day 2023-07-25] 2023-07-25: 4050746 events in 24 hours
2026-11-07T23:20:14Z [load_day 2023-07-25] attempt 1 succeeded