Skip to content

Comments

[Doc] update offline inference doc and offline_inference examples#274

Merged
hsliuustc0106 merged 6 commits intovllm-project:mainfrom
david6666666:update_doc_20251211
Dec 11, 2025
Merged

[Doc] update offline inference doc and offline_inference examples#274
hsliuustc0106 merged 6 commits intovllm-project:mainfrom
david6666666:update_doc_20251211

Conversation

@david6666666
Copy link
Collaborator

@david6666666 david6666666 commented Dec 11, 2025

PLEASE FILL IN THE PR DESCRIPTION HERE ENSURING ALL CHECKLIST ITEMS (AT THE BOTTOM) HAVE BEEN CONSIDERED.

Purpose

add offline inference doc

  • Image-To-Image Qwen-Image-Edit
  • Text-To-Video Wan2.2-T2V
  • Text-To-Image Z-Image

Test Plan

Test Result


Essential Elements of an Effective PR Description Checklist
  • The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
  • The test plan, such as providing test command.
  • The test results, such as pasting the results comparison before and after, or e2e results
  • (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.
  • (Optional) Release notes update. If your change is user facing, please update the release notes draft.

BEFORE SUBMITTING, PLEASE READ https://github.com/vllm-project/vllm-omni/blob/main/CONTRIBUTING.md (anything written below this line will be removed by GitHub Actions)

Signed-off-by: David Chen <[email protected]>
docs/.nav.yml Outdated
- Online serving Example of vLLM-Omni for Qwen2.5-Omni: user_guide/examples/online_serving/qwen2_5_omni.md
- Online serving Example of vLLM-Omni for Qwen3-omni: user_guide/examples/online_serving/qwen3_omni.md
- Qwen2.5-Omni: user_guide/examples/online_serving/qwen2_5_omni.md
- Qwen3-omni: user_guide/examples/online_serving/qwen3_omni.md
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- Qwen3-omni: user_guide/examples/online_serving/qwen3_omni.md
- Qwen3-Omni: user_guide/examples/online_serving/qwen3_omni.md

@@ -0,0 +1,30 @@
# Z-Image Offline Inference
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why these files are different?
we should follow the same style

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated

Signed-off-by: David Chen <[email protected]>
Signed-off-by: David Chen <[email protected]>
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

add a readme under i2i/t2v
maybe use the same markdown under user_guide?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

updated

Signed-off-by: David Chen <[email protected]>
Signed-off-by: David Chen <[email protected]>
@david6666666 david6666666 changed the title [Doc][WIP] add offline inference doc [Doc] add offline inference doc Dec 11, 2025
Signed-off-by: David Chen <[email protected]>
@david6666666 david6666666 changed the title [Doc] add offline inference doc [Doc] update offline inference doc and offline_inference examples Dec 11, 2025
Copy link
Collaborator

@hsliuustc0106 hsliuustc0106 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm. thx for your contribution

@hsliuustc0106 hsliuustc0106 enabled auto-merge (squash) December 11, 2025 11:54
@hsliuustc0106 hsliuustc0106 merged commit 7aaec2d into vllm-project:main Dec 11, 2025
4 checks passed
congw729 pushed a commit to congw729/vllm-omni that referenced this pull request Dec 12, 2025
LawJarp-A pushed a commit to LawJarp-A/vllm-omni that referenced this pull request Dec 12, 2025
LawJarp-A pushed a commit to LawJarp-A/vllm-omni that referenced this pull request Dec 12, 2025
e1ijah1 pushed a commit to e1ijah1/vllm-omni that referenced this pull request Dec 14, 2025
@david6666666 david6666666 deleted the update_doc_20251211 branch December 18, 2025 08:32
faaany pushed a commit to faaany/vllm-omni that referenced this pull request Dec 19, 2025
yenuo26 pushed a commit to yenuo26/vllm-omni that referenced this pull request Dec 29, 2025
princepride pushed a commit to princepride/vllm-omni that referenced this pull request Jan 10, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants