[Core] Restructure core loop for async input preparation #23391

WoosukKwon wants to merge 5 commits intomainvllm-project/vllm:mainfrom

woosuk/async-input-prepvllm-project/vllm:woosuk/async-input-prepCopy head branch name to clipboard