orcaLog in

Runs · run 554

load_day 2026-05-17, attempt 1 succeeded

Host
4e84322b8c45:123041
Started
2026-11-07T06:25:36Z
Ended
2026-11-07T06:26:59Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/554/load_day/2026-05-17/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:25:36Z [load_day 2026-05-17] attempt 1 started
2026-11-07T06:25:46Z [load_day 2026-05-17] 2026-05-17 hour 0: 141825 events in 3 files, snapshot 7957308229789042931 (task 6523 ms: download 2153 ms overlapping gunzip 400 ms, parse 1317 ms, sort 244 ms, write 3024 ms, index 397 ms: 7 candidates, 60642 repo-hours, 930 releases; waiting 807 ms; commit 1135 ms)
2026-11-07T06:25:47Z [load_day 2026-05-17] 2026-05-17 hour 1: 146987 events in 3 files, snapshot 6570156450105618937 (task 6375 ms: download 2421 ms overlapping gunzip 366 ms, parse 1236 ms, sort 141 ms, write 3061 ms, index 457 ms: 10 candidates, 69910 repo-hours, 843 releases; waiting 781 ms; commit 1321 ms)
2026-11-07T06:25:52Z [load_day 2026-05-17] 2026-05-17 hour 2: 149312 events in 3 files, snapshot 445174339398915773 (task 5358 ms: download 1585 ms overlapping gunzip 318 ms, parse 1057 ms, sort 179 ms, write 2487 ms, index 489 ms: 4 candidates, 78791 repo-hours, 596 releases; waiting 539 ms; commit 1268 ms)
2026-11-07T06:25:53Z [load_day 2026-05-17] 2026-05-17 hour 3: 148806 events in 3 files, snapshot 4372598308689946918 (task 5355 ms: download 1833 ms overlapping gunzip 318 ms, parse 1076 ms, sort 141 ms, write 2534 ms, index 472 ms: 7 candidates, 74131 repo-hours, 640 releases; waiting 539 ms; commit 1140 ms)
2026-11-07T06:25:58Z [load_day 2026-05-17] 2026-05-17 hour 4: 148545 events in 3 files, snapshot 7626801330667195314 (task 5393 ms: download 2059 ms overlapping gunzip 337 ms, parse 1091 ms, sort 116 ms, write 2553 ms, index 451 ms: 10 candidates, 70810 repo-hours, 796 releases; waiting 534 ms; commit 1314 ms)
2026-11-07T06:25:59Z [load_day 2026-05-17] 2026-05-17 hour 5: 148068 events in 3 files, snapshot 9083671019963159086 (task 5656 ms: download 1853 ms overlapping gunzip 372 ms, parse 1186 ms, sort 161 ms, write 2639 ms, index 438 ms: 5 candidates, 67116 repo-hours, 751 releases; waiting 548 ms; commit 1083 ms)
2026-11-07T06:26:05Z [load_day 2026-05-17] 2026-05-17 hour 6: 151720 events in 4 files, snapshot 9116803318737189709 (task 5698 ms: download 1715 ms overlapping gunzip 346 ms, parse 1133 ms, sort 124 ms, write 2782 ms, index 459 ms: 3 candidates, 69426 repo-hours, 818 releases; waiting 521 ms; commit 1036 ms)
2026-11-07T06:26:06Z [load_day 2026-05-17] 2026-05-17 hour 7: 155273 events in 4 files, snapshot 1949987901073422096 (task 5230 ms: download 1781 ms overlapping gunzip 305 ms, parse 1000 ms, sort 123 ms, write 2514 ms, index 470 ms: 5 candidates, 72520 repo-hours, 499 releases; waiting 538 ms; commit 1196 ms)
2026-11-07T06:26:10Z [load_day 2026-05-17] 2026-05-17 hour 8: 155890 events in 4 files, snapshot 3026128355429047675 (task 4925 ms: download 1907 ms overlapping gunzip 303 ms, parse 1035 ms, sort 135 ms, write 1843 ms, index 521 ms: 8 candidates, 76658 repo-hours, 314 releases; waiting 787 ms; commit 1034 ms)
2026-11-07T06:26:11Z [load_day 2026-05-17] 2026-05-17 hour 9: 155444 events in 4 files, snapshot 8794807519166708007 (task 4652 ms: download 1649 ms overlapping gunzip 271 ms, parse 906 ms, sort 108 ms, write 1976 ms, index 531 ms: 3 candidates, 76464 repo-hours, 322 releases; waiting 548 ms; commit 1061 ms)
2026-11-07T06:26:16Z [load_day 2026-05-17] 2026-05-17 hour 10: 154481 events in 4 files, snapshot 1699899316209759245 (task 5141 ms: download 1454 ms overlapping gunzip 309 ms, parse 1065 ms, sort 137 ms, write 2394 ms, index 485 ms: 13 candidates, 73649 repo-hours, 509 releases; waiting 532 ms; commit 1106 ms)
2026-11-07T06:26:17Z [load_day 2026-05-17] 2026-05-17 hour 11: 158561 events in 4 files, snapshot 2696567864765095950 (task 4396 ms: download 1550 ms overlapping gunzip 241 ms, parse 854 ms, sort 113 ms, write 1837 ms, index 531 ms: 15 candidates, 73281 repo-hours, 191 releases; waiting 533 ms; commit 1164 ms)
2026-11-07T06:26:21Z [load_day 2026-05-17] 2026-05-17 hour 12: 159610 events in 4 files, snapshot 6183937622088801436 (task 4202 ms: download 1479 ms overlapping gunzip 231 ms, parse 821 ms, sort 105 ms, write 1623 ms, index 540 ms: 8 candidates, 82249 repo-hours, 136 releases; waiting 529 ms; commit 1185 ms)
2026-11-07T06:26:22Z [load_day 2026-05-17] 2026-05-17 hour 13: 159961 events in 4 files, snapshot 2536864916018781932 (task 4139 ms: download 1482 ms overlapping gunzip 203 ms, parse 761 ms, sort 100 ms, write 1648 ms, index 575 ms: 11 candidates, 90762 repo-hours, 85 releases; waiting 526 ms; commit 972 ms)
2026-11-07T06:26:26Z [load_day 2026-05-17] 2026-05-17 hour 14: 165599 events in 4 files, snapshot 7624301593156358916 (task 4282 ms: download 1492 ms overlapping gunzip 227 ms, parse 833 ms, sort 111 ms, write 1647 ms, index 611 ms: 6 candidates, 85600 repo-hours, 126 releases; waiting 523 ms; commit 1094 ms)
2026-11-07T06:26:27Z [load_day 2026-05-17] 2026-05-17 hour 15: 161174 events in 4 files, snapshot 4083589231073655549 (task 4300 ms: download 1569 ms overlapping gunzip 223 ms, parse 795 ms, sort 101 ms, write 1683 ms, index 571 ms: 9 candidates, 83627 repo-hours, 126 releases; waiting 551 ms; commit 1178 ms)
2026-11-07T06:26:32Z [load_day 2026-05-17] 2026-05-17 hour 16: 163017 events in 4 files, snapshot 8105742769149313844 (task 4163 ms: download 1468 ms overlapping gunzip 231 ms, parse 842 ms, sort 107 ms, write 1629 ms, index 576 ms: 9 candidates, 85961 repo-hours, 110 releases; waiting 524 ms; commit 2943 ms)
2026-11-07T06:26:33Z [load_day 2026-05-17] 2026-05-17 hour 17: 163903 events in 4 files, snapshot 3480295109831858486 (task 4320 ms: download 1774 ms overlapping gunzip 232 ms, parse 829 ms, sort 101 ms, write 1728 ms, index 573 ms: 9 candidates, 84853 repo-hours, 140 releases; waiting 533 ms; commit 1163 ms)
2026-11-07T06:26:35Z [load_day 2026-05-17] 2026-05-17 hour 18: 159159 events in 4 files, snapshot 2920193599795642105 (task 4216 ms: download 1560 ms overlapping gunzip 242 ms, parse 831 ms, sort 105 ms, write 1633 ms, index 539 ms: 14 candidates, 80705 repo-hours, 209 releases; waiting 541 ms; commit 1021 ms)
2026-11-07T06:26:39Z [load_day 2026-05-17] 2026-05-17 hour 19: 159826 events in 4 files, snapshot 1029646608256791258 (task 4740 ms: download 1331 ms overlapping gunzip 261 ms, parse 915 ms, sort 119 ms, write 2149 ms, index 526 ms: 12 candidates, 82544 repo-hours, 271 releases; waiting 543 ms; commit 1089 ms)
2026-11-07T06:26:41Z [load_day 2026-05-17] 2026-05-17 hour 20: 154336 events in 4 files, snapshot 738581206752939070 (task 4547 ms: download 1434 ms overlapping gunzip 258 ms, parse 873 ms, sort 117 ms, write 1946 ms, index 542 ms: 6 candidates, 76161 repo-hours, 269 releases; waiting 535 ms; commit 1190 ms)
2026-11-07T06:26:44Z [load_day 2026-05-17] 2026-05-17 hour 21: 148249 events in 3 files, snapshot 8019031194121361193 (task 5147 ms: download 1964 ms overlapping gunzip 352 ms, parse 1119 ms, sort 148 ms, write 2180 ms, index 517 ms: 7 candidates, 69170 repo-hours, 549 releases; waiting 532 ms; commit 1066 ms)
2026-11-07T06:26:46Z [load_day 2026-05-17] 2026-05-17 hour 22: 148122 events in 3 files, snapshot 2744783825793328391 (task 4981 ms: download 1874 ms overlapping gunzip 364 ms, parse 1183 ms, sort 124 ms, write 2117 ms, index 442 ms: 8 candidates, 69920 repo-hours, 685 releases; waiting 526 ms; commit 1001 ms)
2026-11-07T06:26:50Z [load_day 2026-05-17] 2026-05-17 hour 23: 144649 events in 3 files, snapshot 5679975646009172967 (task 4964 ms: download 1562 ms overlapping gunzip 342 ms, parse 1142 ms, sort 128 ms, write 2164 ms, index 434 ms: 8 candidates, 67039 repo-hours, 810 releases; waiting 546 ms; commit 1039 ms)
2026-11-07T06:26:57Z [load_day 2026-05-17] 2026-05-17: repo_hour merged from 24 files to 1 (1821989 rows, 7258 ms)
2026-11-07T06:26:59Z [load_day 2026-05-17] 2026-05-17: index committed in 9121 ms (24 + 1 + 24 files)
2026-11-07T06:26:59Z [load_day 2026-05-17] 2026-05-17: 3702517 events in 24 hours
2026-11-07T06:26:59Z [load_day 2026-05-17] attempt 1 succeeded