[VLM] Fix paligemma, fuyu and persimmon with transformers 4.45 : use config.text_config.vocab_size#8707

DarkLight1337 merged 1 commit intovllm-project:mainvllm-project/vllm:mainfrom

janimo:paligemma-fixjanimo/vllm:paligemma-fixCopy head branch name to clipboard