orcaLog in

Runs · run 1441

load_day 2023-08-29, attempt 1 succeeded

Host
3c2b29713ce8:273853
Started
2026-11-08T00:19:31Z
Ended
2026-11-08T00:23:30Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1441/load_day/2023-08-29/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T00:19:31Z [load_day 2023-08-29] attempt 1 started
2026-11-08T00:19:33Z [load_day 2023-08-29] 2023-08-29: 2 hours in flight, about 1200 MB
2026-11-08T00:19:53Z [load_day 2023-08-29] 2023-08-29 hour 0: 174353 events in 4 files, snapshot 2068295777062698004 (task 16065 ms: download 7302 ms overlapping gunzip 1076 ms, parse 4979 ms, sort 112 ms, write 8523 ms, index 590 ms: 11 candidates, 92709 repo-hours, 996 releases; waiting 484 ms; commit 2932 ms)
2026-11-08T00:19:56Z [load_day 2023-08-29] 2023-08-29 hour 1: 138226 events in 3 files, snapshot 3917087265003529502 (task 13199 ms: download 5278 ms overlapping gunzip 772 ms, parse 3520 ms, sort 162 ms, write 7331 ms, index 631 ms: 6 candidates, 81099 repo-hours, 748 releases; waiting 508 ms; commit 2547 ms)
2026-11-08T00:20:07Z [load_day 2023-08-29] 2023-08-29 hour 2: 131161 events in 3 files, snapshot 4969306410633675206 (task 12694 ms: download 5194 ms overlapping gunzip 685 ms, parse 2893 ms, sort 80 ms, write 7995 ms, index 428 ms: 6 candidates, 62276 repo-hours, 606 releases; waiting 363 ms; commit 2708 ms)
2026-11-08T00:20:11Z [load_day 2023-08-29] 2023-08-29 hour 3: 135930 events in 3 files, snapshot 8411998805170570322 (task 12770 ms: download 5343 ms overlapping gunzip 658 ms, parse 2848 ms, sort 89 ms, write 7750 ms, index 626 ms: 4 candidates, 58808 repo-hours, 869 releases; waiting 504 ms; commit 3733 ms)
2026-11-08T00:20:21Z [load_day 2023-08-29] 2023-08-29 hour 4: 129134 events in 3 files, snapshot 2659015270619542879 (task 12889 ms: download 5437 ms overlapping gunzip 753 ms, parse 3259 ms, sort 125 ms, write 7632 ms, index 358 ms: 2 candidates, 55224 repo-hours, 676 releases; waiting 470 ms; commit 2907 ms)
2026-11-08T00:20:26Z [load_day 2023-08-29] 2023-08-29 hour 5: 144683 events in 3 files, snapshot 4065819830333334510 (task 14480 ms: download 6092 ms overlapping gunzip 818 ms, parse 3354 ms, sort 107 ms, write 8825 ms, index 626 ms: 2 candidates, 61926 repo-hours, 734 releases; waiting 477 ms; commit 2667 ms)
2026-11-08T00:20:39Z [load_day 2023-08-29] 2023-08-29 hour 6: 166281 events in 4 files, snapshot 8876449786767315836 (task 16668 ms: download 6766 ms overlapping gunzip 1141 ms, parse 5140 ms, sort 110 ms, write 8869 ms, index 570 ms: 6 candidates, 77485 repo-hours, 917 releases; waiting 505 ms; commit 3450 ms)
2026-11-08T00:20:44Z [load_day 2023-08-29] 2023-08-29 hour 7: 171554 events in 4 files, snapshot 6348289409984820819 (task 18035 ms: download 10081 ms overlapping gunzip 1123 ms, parse 4858 ms, sort 119 ms, write 10593 ms, index 749 ms: 8 candidates, 76505 repo-hours, 971 releases; waiting 330 ms; commit 2096 ms)
2026-11-08T00:21:00Z [load_day 2023-08-29] 2023-08-29 hour 8: 185990 events in 4 files, snapshot 8897744571765141910 (task 19874 ms: download 11099 ms overlapping gunzip 1033 ms, parse 4283 ms, sort 143 ms, write 12892 ms, index 625 ms: 6 candidates, 83120 repo-hours, 1246 releases; waiting 538 ms; commit 2464 ms)
2026-11-08T00:21:06Z [load_day 2023-08-29] 2023-08-29 hour 9: 179540 events in 4 files, snapshot 8776163698705479261 (task 20126 ms: download 11719 ms overlapping gunzip 1139 ms, parse 5278 ms, sort 148 ms, write 12042 ms, index 723 ms: 2 candidates, 82364 repo-hours, 1180 releases; waiting 514 ms; commit 2483 ms)
2026-11-08T00:21:16Z [load_day 2023-08-29] 2023-08-29 hour 10: 171841 events in 4 files, snapshot 4091736337407294055 (task 16009 ms: download 9856 ms overlapping gunzip 939 ms, parse 4192 ms, sort 153 ms, write 9517 ms, index 564 ms: 1 candidates, 77909 repo-hours, 1025 releases; waiting 359 ms; commit 2112 ms)
2026-11-08T00:21:22Z [load_day 2023-08-29] 2023-08-29 hour 11: 182109 events in 4 files, snapshot 2155477556306529906 (task 15513 ms: download 8886 ms overlapping gunzip 939 ms, parse 4181 ms, sort 118 ms, write 8865 ms, index 536 ms: 6 candidates, 80450 repo-hours, 1032 releases; waiting 618 ms; commit 2388 ms)
2026-11-08T00:21:36Z [load_day 2023-08-29] 2023-08-29 hour 12: 210933 events in 5 files, snapshot 841855375292144446 (task 18310 ms: download 8149 ms overlapping gunzip 963 ms, parse 4437 ms, sort 124 ms, write 11303 ms, index 717 ms: 2 candidates, 105566 repo-hours, 1141 releases; waiting 512 ms; commit 2585 ms)
2026-11-08T00:21:47Z [load_day 2023-08-29] 2023-08-29 hour 13: 208694 events in 5 files, snapshot 968593044044337046 (task 21848 ms: download 15080 ms overlapping gunzip 1445 ms, parse 6290 ms, sort 139 ms, write 12578 ms, index 856 ms: 6 candidates, 104850 repo-hours, 1288 releases; waiting 295 ms; commit 4731 ms)
2026-11-08T00:21:59Z [load_day 2023-08-29] 2023-08-29 hour 14: 202199 events in 5 files, snapshot 8717657350830220619 (task 22489 ms: download 12106 ms overlapping gunzip 1415 ms, parse 5946 ms, sort 148 ms, write 13456 ms, index 724 ms: 4 candidates, 94283 repo-hours, 1149 releases; waiting 525 ms; commit 2166 ms)
2026-11-08T00:22:08Z [load_day 2023-08-29] 2023-08-29 hour 15: 176572 events in 4 files, snapshot 5850541055867907731 (task 20999 ms: download 12101 ms overlapping gunzip 1246 ms, parse 5501 ms, sort 160 ms, write 12401 ms, index 694 ms: 6 candidates, 85037 repo-hours, 1103 releases; waiting 677 ms; commit 2589 ms)
2026-11-08T00:22:22Z [load_day 2023-08-29] 2023-08-29 hour 16: 174636 events in 4 files, snapshot 2724330302162179026 (task 20287 ms: download 11540 ms overlapping gunzip 1181 ms, parse 5016 ms, sort 163 ms, write 12461 ms, index 655 ms: 5 candidates, 81001 repo-hours, 1007 releases; waiting 516 ms; commit 2777 ms)
2026-11-08T00:22:28Z [load_day 2023-08-29] 2023-08-29 hour 17: 178174 events in 4 files, snapshot 1946182647266536839 (task 19444 ms: download 11385 ms overlapping gunzip 1233 ms, parse 5555 ms, sort 138 ms, write 11149 ms, index 536 ms: 8 candidates, 79091 repo-hours, 959 releases; waiting 548 ms; commit 3048 ms)
2026-11-08T00:22:41Z [load_day 2023-08-29] 2023-08-29 hour 18: 183274 events in 4 files, snapshot 1158781403846000694 (task 17892 ms: download 9723 ms overlapping gunzip 935 ms, parse 4160 ms, sort 142 ms, write 11255 ms, index 900 ms: 6 candidates, 84443 repo-hours, 998 releases; waiting 214 ms; commit 2621 ms)
2026-11-08T00:22:47Z [load_day 2023-08-29] 2023-08-29 hour 19: 171653 events in 4 files, snapshot 8741325327174968955 (task 17844 ms: download 10255 ms overlapping gunzip 1021 ms, parse 4527 ms, sort 153 ms, write 10800 ms, index 550 ms: 9 candidates, 73368 repo-hours, 918 releases; waiting 490 ms; commit 2701 ms)
2026-11-08T00:23:00Z [load_day 2023-08-29] 2023-08-29 hour 20: 164232 events in 4 files, snapshot 5150314348985170986 (task 17110 ms: download 10094 ms overlapping gunzip 865 ms, parse 3692 ms, sort 100 ms, write 10972 ms, index 663 ms: 6 candidates, 71084 repo-hours, 994 releases; waiting 495 ms; commit 4018 ms)
2026-11-08T00:23:10Z [load_day 2023-08-29] 2023-08-29 hour 21: 158966 events in 4 files, snapshot 735091905210699621 (task 16604 ms: download 6524 ms overlapping gunzip 891 ms, parse 4050 ms, sort 107 ms, write 10211 ms, index 548 ms: 6 candidates, 65480 repo-hours, 947 releases; waiting 505 ms; commit 8721 ms)
2026-11-08T00:23:16Z [load_day 2023-08-29] 2023-08-29 hour 22: 147454 events in 3 files, snapshot 729203093047136526 (task 15739 ms: download 5757 ms overlapping gunzip 917 ms, parse 3982 ms, sort 147 ms, write 9325 ms, index 639 ms: 4 candidates, 59864 repo-hours, 857 releases; waiting 507 ms; commit 2539 ms)
2026-11-08T00:23:20Z [load_day 2023-08-29] 2023-08-29 hour 23: 138862 events in 3 files, snapshot 4994510181490237961 (task 14211 ms: download 6559 ms overlapping gunzip 889 ms, parse 3922 ms, sort 106 ms, write 8125 ms, index 428 ms: 3 candidates, 56992 repo-hours, 697 releases; waiting 479 ms; commit 2505 ms)
2026-11-08T00:23:28Z [load_day 2023-08-29] 2023-08-29: repo_hour merged from 24 files to 1 (1850934 rows, 8388 ms)
2026-11-08T00:23:30Z [load_day 2023-08-29] 2023-08-29: index committed in 10534 ms (24 + 1 + 24 files)
2026-11-08T00:23:30Z [load_day 2023-08-29] 2023-08-29: 4026451 events in 24 hours
2026-11-08T00:23:30Z [load_day 2023-08-29] attempt 1 succeeded