orcaLog in

Runs · run 1741

load_day 2023-11-15, attempt 1 succeeded

Host
3c2b29713ce8:558493
Started
2026-11-08T02:49:49Z
Ended
2026-11-08T02:54:16Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1741/load_day/2023-11-15/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T02:49:49Z [load_day 2023-11-15] attempt 1 started
2026-11-08T02:49:51Z [load_day 2023-11-15] 2023-11-15: 2 hours in flight, about 1200 MB
2026-11-08T02:50:15Z [load_day 2023-11-15] 2023-11-15 hour 0: 184359 events in 4 files, snapshot 2735994408771534165 (task 17513 ms: download 9964 ms overlapping gunzip 1088 ms, parse 5057 ms, sort 144 ms, write 10197 ms, index 805 ms: 9 candidates, 94781 repo-hours, 1043 releases; waiting 20 ms; commit 5178 ms)
2026-11-08T02:50:18Z [load_day 2023-11-15] 2023-11-15 hour 1: 183759 events in 4 files, snapshot 8566747134759387046 (task 17139 ms: download 9489 ms overlapping gunzip 1006 ms, parse 4502 ms, sort 156 ms, write 10346 ms, index 908 ms: 6 candidates, 98428 repo-hours, 868 releases; waiting 17 ms; commit 2819 ms)
2026-11-08T02:50:30Z [load_day 2023-11-15] 2023-11-15 hour 2: 154399 events in 4 files, snapshot 178680705447319250 (task 14645 ms: download 5878 ms overlapping gunzip 911 ms, parse 4222 ms, sort 160 ms, write 8633 ms, index 473 ms: 9 candidates, 66236 repo-hours, 880 releases; waiting 37 ms; commit 3794 ms)
2026-11-08T02:50:34Z [load_day 2023-11-15] 2023-11-15 hour 3: 150935 events in 4 files, snapshot 7006571966340618572 (task 14194 ms: download 5644 ms overlapping gunzip 857 ms, parse 3882 ms, sort 118 ms, write 8589 ms, index 518 ms: 6 candidates, 64410 repo-hours, 829 releases; waiting 21 ms; commit 2876 ms)
2026-11-08T02:50:44Z [load_day 2023-11-15] 2023-11-15 hour 4: 143340 events in 3 files, snapshot 4703061484462783039 (task 14308 ms: download 5671 ms overlapping gunzip 1048 ms, parse 4473 ms, sort 101 ms, write 7997 ms, index 464 ms: 8 candidates, 59190 repo-hours, 693 releases; waiting 21 ms; commit 2486 ms)
2026-11-08T02:50:53Z [load_day 2023-11-15] 2023-11-15 hour 5: 151097 events in 4 files, snapshot 3079739160653994086 (task 15719 ms: download 6900 ms overlapping gunzip 973 ms, parse 4335 ms, sort 134 ms, write 8996 ms, index 541 ms: 7 candidates, 62329 repo-hours, 701 releases; waiting 474 ms; commit 5091 ms)
2026-11-08T02:51:03Z [load_day 2023-11-15] 2023-11-15 hour 6: 170331 events in 4 files, snapshot 1652248544563968348 (task 17178 ms: download 10067 ms overlapping gunzip 930 ms, parse 4191 ms, sort 182 ms, write 10404 ms, index 546 ms: 3 candidates, 75312 repo-hours, 833 releases; waiting 545 ms; commit 3255 ms)
2026-11-08T02:51:10Z [load_day 2023-11-15] 2023-11-15 hour 7: 178779 events in 4 files, snapshot 7753089524630500620 (task 18264 ms: download 10648 ms overlapping gunzip 1143 ms, parse 5147 ms, sort 205 ms, write 11002 ms, index 538 ms: 12 candidates, 75880 repo-hours, 1014 releases; waiting 25 ms; commit 2835 ms)
2026-11-08T02:51:21Z [load_day 2023-11-15] 2023-11-15 hour 8: 190875 events in 4 files, snapshot 3099812392699426736 (task 17577 ms: download 10452 ms overlapping gunzip 1164 ms, parse 5065 ms, sort 119 ms, write 10420 ms, index 589 ms: 10 candidates, 84225 repo-hours, 1067 releases; waiting 18 ms; commit 2358 ms)
2026-11-08T02:51:28Z [load_day 2023-11-15] 2023-11-15 hour 9: 199175 events in 4 files, snapshot 995857134844707192 (task 17051 ms: download 9275 ms overlapping gunzip 1134 ms, parse 4875 ms, sort 138 ms, write 10030 ms, index 614 ms: 4 candidates, 86050 repo-hours, 1334 releases; waiting 24 ms; commit 2251 ms)
2026-11-08T02:51:41Z [load_day 2023-11-15] 2023-11-15 hour 10: 197507 events in 4 files, snapshot 3683729995886386819 (task 18166 ms: download 8680 ms overlapping gunzip 1001 ms, parse 4429 ms, sort 185 ms, write 11626 ms, index 706 ms: 8 candidates, 86363 repo-hours, 1132 releases; waiting 17 ms; commit 2927 ms)
2026-11-08T02:51:48Z [load_day 2023-11-15] 2023-11-15 hour 11: 188102 events in 4 files, snapshot 2374356664890605046 (task 18494 ms: download 9756 ms overlapping gunzip 1197 ms, parse 5430 ms, sort 115 ms, write 10781 ms, index 770 ms: 2 candidates, 79753 repo-hours, 1011 releases; waiting 16 ms; commit 2679 ms)
2026-11-08T02:52:03Z [load_day 2023-11-15] 2023-11-15 hour 12: 234908 events in 5 files, snapshot 4784121376271189421 (task 20417 ms: download 12235 ms overlapping gunzip 1167 ms, parse 5519 ms, sort 193 ms, write 12588 ms, index 733 ms: 7 candidates, 110963 repo-hours, 1129 releases; waiting 17 ms; commit 3121 ms)
2026-11-08T02:52:13Z [load_day 2023-11-15] 2023-11-15 hour 13: 223117 events in 5 files, snapshot 1654283280280446098 (task 22379 ms: download 14036 ms overlapping gunzip 1124 ms, parse 5274 ms, sort 207 ms, write 14472 ms, index 1046 ms: 4 candidates, 109474 repo-hours, 1126 releases; waiting 27 ms; commit 4825 ms)
2026-11-08T02:52:29Z [load_day 2023-11-15] 2023-11-15 hour 14: 219869 events in 5 files, snapshot 2999128354168237906 (task 25341 ms: download 16621 ms overlapping gunzip 1558 ms, parse 6944 ms, sort 235 ms, write 15704 ms, index 680 ms: 6 candidates, 97364 repo-hours, 1236 releases; waiting 20 ms; commit 3335 ms)
2026-11-08T02:52:40Z [load_day 2023-11-15] 2023-11-15 hour 15: 224665 events in 5 files, snapshot 2417194441969488428 (task 24789 ms: download 16537 ms overlapping gunzip 1253 ms, parse 5626 ms, sort 179 ms, write 16750 ms, index 749 ms: 7 candidates, 99147 repo-hours, 1523 releases; waiting 30 ms; commit 4837 ms)
2026-11-08T02:52:54Z [load_day 2023-11-15] 2023-11-15 hour 16: 215913 events in 5 files, snapshot 3219203799032894952 (task 23557 ms: download 15642 ms overlapping gunzip 1621 ms, parse 7079 ms, sort 143 ms, write 13727 ms, index 765 ms: 10 candidates, 92979 repo-hours, 1487 releases; waiting 22 ms; commit 3019 ms)
2026-11-08T02:53:02Z [load_day 2023-11-15] 2023-11-15 hour 17: 207882 events in 5 files, snapshot 7584077885531782263 (task 22630 ms: download 12078 ms overlapping gunzip 1433 ms, parse 6504 ms, sort 150 ms, write 13447 ms, index 875 ms: 15 candidates, 86217 repo-hours, 1296 releases; waiting 29 ms; commit 2793 ms)
2026-11-08T02:53:17Z [load_day 2023-11-15] 2023-11-15 hour 18: 204778 events in 5 files, snapshot 527126161158342283 (task 21915 ms: download 11837 ms overlapping gunzip 1227 ms, parse 5521 ms, sort 189 ms, write 14149 ms, index 601 ms: 10 candidates, 90125 repo-hours, 1180 releases; waiting 33 ms; commit 2967 ms)
2026-11-08T02:53:25Z [load_day 2023-11-15] 2023-11-15 hour 19: 194234 events in 4 files, snapshot 7771504128034360383 (task 19681 ms: download 11407 ms overlapping gunzip 1350 ms, parse 5899 ms, sort 135 ms, write 11512 ms, index 565 ms: 7 candidates, 78953 repo-hours, 1286 releases; waiting 18 ms; commit 4746 ms)
2026-11-08T02:53:37Z [load_day 2023-11-15] 2023-11-15 hour 20: 188385 events in 4 files, snapshot 3304231690370866713 (task 19539 ms: download 10918 ms overlapping gunzip 1121 ms, parse 5001 ms, sort 144 ms, write 12401 ms, index 644 ms: 12 candidates, 76705 repo-hours, 1101 releases; waiting 23 ms; commit 2861 ms)
2026-11-08T02:53:54Z [load_day 2023-11-15] 2023-11-15 hour 21: 181872 events in 4 files, snapshot 8000950270585813954 (task 19081 ms: download 11143 ms overlapping gunzip 1412 ms, parse 5937 ms, sort 134 ms, write 10826 ms, index 536 ms: 6 candidates, 72577 repo-hours, 1166 releases; waiting 18 ms; commit 14052 ms)
2026-11-08T02:53:57Z [load_day 2023-11-15] 2023-11-15 hour 22: 169446 events in 4 files, snapshot 1263587688574482608 (task 17526 ms: download 10027 ms overlapping gunzip 1001 ms, parse 4326 ms, sort 107 ms, write 11135 ms, index 738 ms: 6 candidates, 66774 repo-hours, 1062 releases; waiting 19 ms; commit 2476 ms)
2026-11-08T02:54:05Z [load_day 2023-11-15] 2023-11-15 hour 23: 153035 events in 4 files, snapshot 5668684686519469201 (task 14677 ms: download 6867 ms overlapping gunzip 1016 ms, parse 4483 ms, sort 99 ms, write 8387 ms, index 478 ms: 6 candidates, 61098 repo-hours, 975 releases; waiting 21 ms; commit 2169 ms)
2026-11-08T02:54:14Z [load_day 2023-11-15] 2023-11-15: repo_hour merged from 24 files to 1 (1975333 rows, 8819 ms)
2026-11-08T02:54:16Z [load_day 2023-11-15] 2023-11-15: index committed in 10562 ms (24 + 1 + 24 files)
2026-11-08T02:54:16Z [load_day 2023-11-15] 2023-11-15: 4510762 events in 24 hours
2026-11-08T02:54:16Z [load_day 2023-11-15] attempt 1 succeeded