[Misc] Update config loading for Qwen2-VL and remove Granite#8837

simon-mo merged 5 commits intomainvllm-project/vllm:mainfrom

qwenv2-configvllm-project/vllm:qwenv2-configCopy head branch name to clipboard