Skip to content

Run vLLM inference using torchtitan model definition (single GPU)#2119

Open
wwwjn wants to merge 16 commits intopytorch:mainfrom
wwwjn:vllm-infer
Open

Run vLLM inference using torchtitan model definition (single GPU)#2119
wwwjn wants to merge 16 commits intopytorch:mainfrom
wwwjn:vllm-infer

Commits

Commits on Dec 10, 2025