orcaLog in

Runs · run 1393

load_day 2023-08-15, attempt 1 succeeded

Host
3c2b29713ce8:228071
Started
2026-11-07T23:54:38Z
Ended
2026-11-07T23:58:21Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1393/load_day/2023-08-15/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T23:54:38Z [load_day 2023-08-15] attempt 1 started
2026-11-07T23:54:40Z [load_day 2023-08-15] 2023-08-15: 2 hours in flight, about 1200 MB
2026-11-07T23:54:59Z [load_day 2023-08-15] 2023-08-15 hour 0: 164736 events in 4 files, snapshot 3658986480943621387 (task 15193 ms: download 6951 ms overlapping gunzip 985 ms, parse 4870 ms, sort 126 ms, write 7769 ms, index 637 ms: 8 candidates, 87258 repo-hours, 880 releases; waiting 516 ms; commit 2043 ms)
2026-11-07T23:55:04Z [load_day 2023-08-15] 2023-08-15 hour 1: 156863 events in 4 files, snapshot 5685419017749301133 (task 14410 ms: download 5558 ms overlapping gunzip 859 ms, parse 3808 ms, sort 134 ms, write 8352 ms, index 585 ms: 3 candidates, 86975 repo-hours, 685 releases; waiting 349 ms; commit 5145 ms)
2026-11-07T23:55:13Z [load_day 2023-08-15] 2023-08-15 hour 2: 135647 events in 3 files, snapshot 2167719436066796375 (task 12852 ms: download 5897 ms overlapping gunzip 719 ms, parse 3121 ms, sort 92 ms, write 7645 ms, index 407 ms: 4 candidates, 59927 repo-hours, 716 releases; waiting 522 ms; commit 2520 ms)
2026-11-07T23:55:16Z [load_day 2023-08-15] 2023-08-15 hour 3: 131512 events in 3 files, snapshot 558294839171254056 (task 13437 ms: download 5756 ms overlapping gunzip 837 ms, parse 3607 ms, sort 108 ms, write 7411 ms, index 676 ms: 1 candidates, 56861 repo-hours, 849 releases; waiting 494 ms; commit 2697 ms)
2026-11-07T23:55:26Z [load_day 2023-08-15] 2023-08-15 hour 4: 125272 events in 3 files, snapshot 3044129986272011075 (task 12112 ms: download 4616 ms overlapping gunzip 740 ms, parse 3073 ms, sort 96 ms, write 5925 ms, index 1477 ms: 5 candidates, 52846 repo-hours, 704 releases; waiting 465 ms; commit 2822 ms)
2026-11-07T23:55:33Z [load_day 2023-08-15] 2023-08-15 hour 5: 131279 events in 3 files, snapshot 463810267115981487 (task 14187 ms: download 4916 ms overlapping gunzip 655 ms, parse 2726 ms, sort 85 ms, write 9515 ms, index 389 ms: 4 candidates, 57255 repo-hours, 826 releases; waiting 515 ms; commit 3764 ms)
2026-11-07T23:55:42Z [load_day 2023-08-15] 2023-08-15 hour 6: 158153 events in 4 files, snapshot 1677175698011212367 (task 14914 ms: download 5323 ms overlapping gunzip 896 ms, parse 3901 ms, sort 122 ms, write 8512 ms, index 621 ms: 4 candidates, 71201 repo-hours, 1119 releases; waiting 522 ms; commit 2048 ms)
2026-11-07T23:55:49Z [load_day 2023-08-15] 2023-08-15 hour 7: 165140 events in 4 files, snapshot 1492785261809835040 (task 16334 ms: download 7067 ms overlapping gunzip 1009 ms, parse 4361 ms, sort 172 ms, write 9524 ms, index 499 ms: 1 candidates, 72144 repo-hours, 928 releases; waiting 487 ms; commit 2364 ms)
2026-11-07T23:56:00Z [load_day 2023-08-15] 2023-08-15 hour 8: 174260 events in 4 files, snapshot 2898075222364972879 (task 16526 ms: download 10243 ms overlapping gunzip 902 ms, parse 3894 ms, sort 108 ms, write 10199 ms, index 576 ms: 2 candidates, 75088 repo-hours, 1049 releases; waiting 530 ms; commit 3012 ms)
2026-11-07T23:56:06Z [load_day 2023-08-15] 2023-08-15 hour 9: 178453 events in 4 files, snapshot 2269274397454595389 (task 15298 ms: download 8557 ms overlapping gunzip 906 ms, parse 3936 ms, sort 114 ms, write 9001 ms, index 573 ms: 2 candidates, 77856 repo-hours, 1142 releases; waiting 497 ms; commit 2303 ms)
2026-11-07T23:56:14Z [load_day 2023-08-15] 2023-08-15 hour 10: 171139 events in 4 files, snapshot 7055809308690811122 (task 13278 ms: download 7442 ms overlapping gunzip 823 ms, parse 3505 ms, sort 113 ms, write 8065 ms, index 554 ms: 6 candidates, 74337 repo-hours, 984 releases; waiting 21 ms; commit 2463 ms)
2026-11-07T23:56:23Z [load_day 2023-08-15] 2023-08-15 hour 11: 168837 events in 4 files, snapshot 9057110044776265089 (task 15736 ms: download 7331 ms overlapping gunzip 1020 ms, parse 4204 ms, sort 146 ms, write 9255 ms, index 602 ms: 6 candidates, 70196 repo-hours, 1044 releases; waiting 16 ms; commit 2411 ms)
2026-11-07T23:56:35Z [load_day 2023-08-15] 2023-08-15 hour 12: 227279 events in 5 files, snapshot 8134679083166137073 (task 19721 ms: download 10284 ms overlapping gunzip 1120 ms, parse 5366 ms, sort 183 ms, write 11779 ms, index 1052 ms: 6 candidates, 103515 repo-hours, 1088 releases; waiting 17 ms; commit 3004 ms)
2026-11-07T23:56:42Z [load_day 2023-08-15] 2023-08-15 hour 13: 194805 events in 4 files, snapshot 8279705693211078545 (task 18749 ms: download 9395 ms overlapping gunzip 1110 ms, parse 4902 ms, sort 143 ms, write 11310 ms, index 1025 ms: 9 candidates, 97149 repo-hours, 1058 releases; waiting 13 ms; commit 2552 ms)
2026-11-07T23:56:56Z [load_day 2023-08-15] 2023-08-15 hour 14: 190285 events in 4 files, snapshot 7324036525895084609 (task 20099 ms: download 10062 ms overlapping gunzip 1330 ms, parse 5640 ms, sort 170 ms, write 12083 ms, index 657 ms: 11 candidates, 88474 repo-hours, 1044 releases; waiting 20 ms; commit 2587 ms)
2026-11-07T23:57:02Z [load_day 2023-08-15] 2023-08-15 hour 15: 174953 events in 4 files, snapshot 8843045034742777376 (task 18416 ms: download 10842 ms overlapping gunzip 1064 ms, parse 4625 ms, sort 205 ms, write 11633 ms, index 685 ms: 8 candidates, 80447 repo-hours, 1026 releases; waiting 18 ms; commit 2663 ms)
2026-11-07T23:57:15Z [load_day 2023-08-15] 2023-08-15 hour 16: 170037 events in 4 files, snapshot 4262544940913848786 (task 18595 ms: download 11039 ms overlapping gunzip 1092 ms, parse 5109 ms, sort 241 ms, write 10893 ms, index 584 ms: 3 candidates, 80636 repo-hours, 1045 releases; waiting 299 ms; commit 2578 ms)
2026-11-07T23:57:21Z [load_day 2023-08-15] 2023-08-15 hour 17: 169009 events in 4 files, snapshot 5515806425909738550 (task 17380 ms: download 10164 ms overlapping gunzip 1133 ms, parse 4824 ms, sort 119 ms, write 10497 ms, index 554 ms: 18 candidates, 75476 repo-hours, 938 releases; waiting 26 ms; commit 3073 ms)
2026-11-07T23:57:34Z [load_day 2023-08-15] 2023-08-15 hour 18: 170779 events in 4 files, snapshot 1052473134388924527 (task 18140 ms: download 10298 ms overlapping gunzip 1123 ms, parse 5132 ms, sort 180 ms, write 10700 ms, index 778 ms: 8 candidates, 76448 repo-hours, 903 releases; waiting 23 ms; commit 2531 ms)
2026-11-07T23:57:37Z [load_day 2023-08-15] 2023-08-15 hour 19: 160621 events in 4 files, snapshot 347668414565429252 (task 16700 ms: download 6340 ms overlapping gunzip 1049 ms, parse 4502 ms, sort 160 ms, write 10070 ms, index 684 ms: 4 candidates, 68117 repo-hours, 926 releases; waiting 24 ms; commit 2321 ms)
2026-11-07T23:57:53Z [load_day 2023-08-15] 2023-08-15 hour 20: 166201 events in 4 files, snapshot 4349607151428493548 (task 18178 ms: download 10825 ms overlapping gunzip 1044 ms, parse 4328 ms, sort 209 ms, write 11730 ms, index 632 ms: 1 candidates, 73519 repo-hours, 1030 releases; waiting 15 ms; commit 2544 ms)
2026-11-07T23:57:55Z [load_day 2023-08-15] 2023-08-15 hour 21: 157530 events in 4 files, snapshot 8575463974060922214 (task 16560 ms: download 10147 ms overlapping gunzip 1096 ms, parse 4502 ms, sort 112 ms, write 10011 ms, index 618 ms: 2 candidates, 62748 repo-hours, 949 releases; waiting 21 ms; commit 2321 ms)
2026-11-07T23:58:09Z [load_day 2023-08-15] 2023-08-15 hour 22: 145211 events in 3 files, snapshot 5112665707666061218 (task 15312 ms: download 6472 ms overlapping gunzip 965 ms, parse 3840 ms, sort 104 ms, write 9641 ms, index 535 ms: 7 candidates, 57608 repo-hours, 726 releases; waiting 27 ms; commit 2165 ms)
2026-11-07T23:58:11Z [load_day 2023-08-15] 2023-08-15 hour 23: 135291 events in 3 files, snapshot 7516240806480881771 (task 13094 ms: download 5337 ms overlapping gunzip 886 ms, parse 3743 ms, sort 112 ms, write 7706 ms, index 451 ms: 2 candidates, 55134 repo-hours, 724 releases; waiting 19 ms; commit 2252 ms)
2026-11-07T23:58:19Z [load_day 2023-08-15] 2023-08-15: repo_hour merged from 24 files to 1 (1761215 rows, 7701 ms)
2026-11-07T23:58:21Z [load_day 2023-08-15] 2023-08-15: index committed in 9823 ms (24 + 1 + 24 files)
2026-11-07T23:58:21Z [load_day 2023-08-15] 2023-08-15: 3923292 events in 24 hours
2026-11-07T23:58:21Z [load_day 2023-08-15] attempt 1 succeeded