orcaLog in

Runs · run 651

load_day 2026-04-15, attempt 1 succeeded

Host
4e84322b8c45:159176
Started
2026-11-07T12:52:19Z
Ended
2026-11-07T12:53:48Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/651/load_day/2026-04-15/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T12:52:19Z [load_day 2026-04-15] attempt 1 started
2026-11-07T12:52:28Z [load_day 2026-04-15] 2026-04-15 hour 0: 147702 events in 3 files, snapshot 4657141332784983824 (task 5969 ms: download 2124 ms overlapping gunzip 376 ms, parse 1318 ms, sort 183 ms, write 2754 ms, index 487 ms: 7 candidates, 71733 repo-hours, 868 releases; waiting 517 ms; commit 1295 ms)
2026-11-07T12:52:30Z [load_day 2026-04-15] 2026-04-15 hour 1: 155729 events in 4 files, snapshot 8182887850046564917 (task 5795 ms: download 1917 ms overlapping gunzip 316 ms, parse 1128 ms, sort 166 ms, write 2727 ms, index 588 ms: 5 candidates, 87799 repo-hours, 589 releases; waiting 512 ms; commit 1294 ms)
2026-11-07T12:52:35Z [load_day 2026-04-15] 2026-04-15 hour 2: 151829 events in 4 files, snapshot 8656308382547863980 (task 5870 ms: download 2575 ms overlapping gunzip 337 ms, parse 1134 ms, sort 214 ms, write 2582 ms, index 599 ms: 9 candidates, 86160 repo-hours, 563 releases; waiting 677 ms; commit 1144 ms)
2026-11-07T12:52:36Z [load_day 2026-04-15] 2026-04-15 hour 3: 153784 events in 4 files, snapshot 6432590321167877882 (task 5786 ms: download 1715 ms overlapping gunzip 359 ms, parse 1311 ms, sort 174 ms, write 2708 ms, index 650 ms: 12 candidates, 78296 repo-hours, 631 releases; waiting 261 ms; commit 1150 ms)
2026-11-07T12:52:42Z [load_day 2026-04-15] 2026-04-15 hour 4: 155800 events in 4 files, snapshot 5733135318441785264 (task 6562 ms: download 2424 ms overlapping gunzip 406 ms, parse 1342 ms, sort 239 ms, write 3016 ms, index 576 ms: 5 candidates, 75581 repo-hours, 702 releases; waiting 651 ms; commit 1211 ms)
2026-11-07T12:52:43Z [load_day 2026-04-15] 2026-04-15 hour 5: 154396 events in 4 files, snapshot 595305060113355453 (task 6300 ms: download 2360 ms overlapping gunzip 386 ms, parse 1270 ms, sort 170 ms, write 3010 ms, index 546 ms: 8 candidates, 79033 repo-hours, 706 releases; waiting 600 ms; commit 1228 ms)
2026-11-07T12:52:49Z [load_day 2026-04-15] 2026-04-15 hour 6: 155958 events in 4 files, snapshot 551867580559112230 (task 5716 ms: download 1940 ms overlapping gunzip 349 ms, parse 1200 ms, sort 164 ms, write 2628 ms, index 560 ms: 13 candidates, 82795 repo-hours, 485 releases; waiting 550 ms; commit 1292 ms)
2026-11-07T12:52:50Z [load_day 2026-04-15] 2026-04-15 hour 7: 155560 events in 4 files, snapshot 1235965445222662347 (task 5349 ms: download 1622 ms overlapping gunzip 314 ms, parse 1067 ms, sort 152 ms, write 2515 ms, index 546 ms: 7 candidates, 86272 repo-hours, 287 releases; waiting 413 ms; commit 1154 ms)
2026-11-07T12:52:54Z [load_day 2026-04-15] 2026-04-15 hour 8: 157341 events in 4 files, snapshot 418488902246103754 (task 5207 ms: download 1524 ms overlapping gunzip 378 ms, parse 1177 ms, sort 154 ms, write 2253 ms, index 578 ms: 7 candidates, 83221 repo-hours, 357 releases; waiting 368 ms; commit 1214 ms)
2026-11-07T12:52:55Z [load_day 2026-04-15] 2026-04-15 hour 9: 158834 events in 4 files, snapshot 4816510564206082866 (task 4749 ms: download 1746 ms overlapping gunzip 326 ms, parse 1004 ms, sort 155 ms, write 1827 ms, index 557 ms: 8 candidates, 84485 repo-hours, 196 releases; waiting 522 ms; commit 986 ms)
2026-11-07T12:53:00Z [load_day 2026-04-15] 2026-04-15 hour 10: 158603 events in 4 files, snapshot 6919677542889367876 (task 5584 ms: download 1949 ms overlapping gunzip 310 ms, parse 1029 ms, sort 190 ms, write 2298 ms, index 635 ms: 8 candidates, 88059 repo-hours, 273 releases; waiting 769 ms; commit 1234 ms)
2026-11-07T12:53:02Z [load_day 2026-04-15] 2026-04-15 hour 11: 158513 events in 4 files, snapshot 8050230472640334785 (task 5131 ms: download 1491 ms overlapping gunzip 288 ms, parse 977 ms, sort 143 ms, write 2231 ms, index 648 ms: 12 candidates, 87188 repo-hours, 226 releases; waiting 524 ms; commit 1293 ms)
2026-11-07T12:53:05Z [load_day 2026-04-15] 2026-04-15 hour 12: 156006 events in 4 files, snapshot 1156085573078756563 (task 4304 ms: download 1101 ms overlapping gunzip 243 ms, parse 842 ms, sort 136 ms, write 1954 ms, index 620 ms: 11 candidates, 88895 repo-hours, 163 releases; waiting 198 ms; commit 1205 ms)
2026-11-07T12:53:07Z [load_day 2026-04-15] 2026-04-15 hour 13: 162709 events in 4 files, snapshot 7067917077997160566 (task 4760 ms: download 1525 ms overlapping gunzip 227 ms, parse 818 ms, sort 125 ms, write 1962 ms, index 680 ms: 3 candidates, 102003 repo-hours, 58 releases; waiting 600 ms; commit 1269 ms)
2026-11-07T12:53:11Z [load_day 2026-04-15] 2026-04-15 hour 14: 156440 events in 4 files, snapshot 1147012378451596470 (task 4838 ms: download 1833 ms overlapping gunzip 243 ms, parse 866 ms, sort 120 ms, write 1869 ms, index 618 ms: 11 candidates, 89660 repo-hours, 138 releases; waiting 826 ms; commit 1181 ms)
2026-11-07T12:53:13Z [load_day 2026-04-15] 2026-04-15 hour 15: 158392 events in 4 files, snapshot 7210758127225517241 (task 4832 ms: download 1562 ms overlapping gunzip 253 ms, parse 889 ms, sort 130 ms, write 2093 ms, index 619 ms: 10 candidates, 87114 repo-hours, 183 releases; waiting 545 ms; commit 1379 ms)
2026-11-07T12:53:17Z [load_day 2026-04-15] 2026-04-15 hour 16: 158755 events in 4 files, snapshot 3947639000688144183 (task 5032 ms: download 1875 ms overlapping gunzip 278 ms, parse 933 ms, sort 136 ms, write 2175 ms, index 662 ms: 13 candidates, 86343 repo-hours, 246 releases; waiting 531 ms; commit 1401 ms)
2026-11-07T12:53:18Z [load_day 2026-04-15] 2026-04-15 hour 17: 160562 events in 4 files, snapshot 4711668102794679749 (task 4894 ms: download 1535 ms overlapping gunzip 251 ms, parse 876 ms, sort 139 ms, write 2104 ms, index 633 ms: 9 candidates, 86692 repo-hours, 189 releases; waiting 537 ms; commit 1221 ms)
2026-11-07T12:53:22Z [load_day 2026-04-15] 2026-04-15 hour 18: 158391 events in 4 files, snapshot 4553175237350096110 (task 4919 ms: download 1695 ms overlapping gunzip 273 ms, parse 948 ms, sort 123 ms, write 2041 ms, index 637 ms: 11 candidates, 85249 repo-hours, 221 releases; waiting 588 ms; commit 1208 ms)
2026-11-07T12:53:24Z [load_day 2026-04-15] 2026-04-15 hour 19: 156236 events in 4 files, snapshot 1746825319401664100 (task 4964 ms: download 1630 ms overlapping gunzip 263 ms, parse 916 ms, sort 155 ms, write 2141 ms, index 624 ms: 9 candidates, 86510 repo-hours, 174 releases; waiting 548 ms; commit 1313 ms)
2026-11-07T12:53:28Z [load_day 2026-04-15] 2026-04-15 hour 20: 155418 events in 4 files, snapshot 4079030179998169969 (task 5323 ms: download 2070 ms overlapping gunzip 297 ms, parse 1039 ms, sort 138 ms, write 2353 ms, index 616 ms: 13 candidates, 83344 repo-hours, 385 releases; waiting 541 ms; commit 1397 ms)
2026-11-07T12:53:31Z [load_day 2026-04-15] 2026-04-15 hour 21: 153016 events in 4 files, snapshot 173286380492152186 (task 5942 ms: download 2119 ms overlapping gunzip 342 ms, parse 1142 ms, sort 137 ms, write 2652 ms, index 822 ms: 7 candidates, 77095 repo-hours, 552 releases; waiting 553 ms; commit 1178 ms)
2026-11-07T12:53:35Z [load_day 2026-04-15] 2026-04-15 hour 22: 149337 events in 3 files, snapshot 6213047626375642497 (task 5427 ms: download 1507 ms overlapping gunzip 343 ms, parse 1174 ms, sort 148 ms, write 2525 ms, index 638 ms: 9 candidates, 76374 repo-hours, 636 releases; waiting 285 ms; commit 1329 ms)
2026-11-07T12:53:38Z [load_day 2026-04-15] 2026-04-15 hour 23: 149833 events in 3 files, snapshot 6168771706873678273 (task 6107 ms: download 2023 ms overlapping gunzip 418 ms, parse 1436 ms, sort 133 ms, write 2609 ms, index 517 ms: 6 candidates, 73768 repo-hours, 866 releases; waiting 600 ms; commit 1099 ms)
2026-11-07T12:53:46Z [load_day 2026-04-15] 2026-04-15: repo_hour merged from 24 files to 1 (2013669 rows, 8381 ms)
2026-11-07T12:53:48Z [load_day 2026-04-15] 2026-04-15: index committed in 10068 ms (24 + 1 + 24 files)
2026-11-07T12:53:48Z [load_day 2026-04-15] 2026-04-15: 3739144 events in 24 hours
2026-11-07T12:53:48Z [load_day 2026-04-15] attempt 1 succeeded