recurrent : rework graph inputs + add TODOs#2

gabe-l-hart merged 1 commit intogabe-l-hart:HybridRecurrentCachegabe-l-hart/llama.cpp:HybridRecurrentCachefrom

ggml-org:gabe-l-hart/HybridRecurrentCacheggml-org/llama.cpp:gabe-l-hart/HybridRecurrentCacheCopy head branch name to clipboard