[Doc]: Qwen3 omni running on Ascend

[yyong-brs]

📚 The doc issue

Does the current version of vllm-omni support running on vllm-ascend:0.12.0rc1? After checking the vllm-ascend project, I see that this version supports qwen3 omni.

Suggest a potential alternative/fix

No response

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[hsliuustc0106]

check this PR #266

[gcanlin]

vllm(vllm-ascend) and vllm-omni are different. The former only supports the omni-thinker, while the latter supports not only omni-thinker but also talker and code2wav to generate the audio. So even if running with vllm-ascend v0.11.0rc2, Qwen3-Omni also can be supported. #266 has implemented a draft version based on vllm-ascend v0.11.0rc2. Please feel free to try it and we thank for any feedback. BTW, we're upgrading vllm and vllm-ascend version to v0.12.0 in #335.

[yyong-brs]

vllm(vllm-ascend) and vllm-omni are different. The former only supports the omni-thinker, while the latter supports not only omni-thinker but also talker and code2wav to generate the audio. So even if running with vllm-ascend v0.11.0rc2, Qwen3-Omni also can be supported. #266 has implemented a draft version based on vllm-ascend v0.11.0rc2. Please feel free to try it and we thank for any feedback. BTW, we're upgrading vllm and vllm-ascend version to v0.12.0 in #335.

Please help me verify if the following Dockerfile is usable:

FROM quay.io/ascend/vllm-ascend:v0.11.0rc2

# download from https://github.com/gcanlin/vllm-omni.git  -b qwen3-omni-npu
ADD vllm-omni.tar /vllm-workspace

RUN cd /vllm/workspace/vllm-omni && python3 -m pip install -v -e .

[gcanlin]

You could refer to the Dockerfile.ci.npu, which has been verified in CI. But if you want to experience qwen3-omni, you could add the below command:

git fetch origin pull/266/head:pr-266
git checkout pr-266

[david6666666]

• [NPU][Model] Support Qwen3-Omni on NPU #484