Skip to content

Comments

[CI] Change Qwen3 Omni stage placement strategy #1072

Merged
hsliuustc0106 merged 3 commits intovllm-project:mainfrom
ZeldaHuang:change_qwen3_omni_yaml
Jan 29, 2026
Merged

[CI] Change Qwen3 Omni stage placement strategy #1072
hsliuustc0106 merged 3 commits intovllm-project:mainfrom
ZeldaHuang:change_qwen3_omni_yaml

Conversation

@ZeldaHuang
Copy link
Contributor

@ZeldaHuang ZeldaHuang commented Jan 29, 2026

PLEASE FILL IN THE PR DESCRIPTION HERE ENSURING ALL CHECKLIST ITEMS (AT THE BOTTOM) HAVE BEEN CONSIDERED.

Purpose

Place thinker to device 0 , talker and code2wav to device 1

Test Plan

Test Result

Essential Elements of an Effective PR Description Checklist
  • The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
  • The test plan, such as providing test command.
  • The test results, such as pasting the results comparison before and after, or e2e results
  • (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.
  • (Optional) Release notes update. If your change is user facing, please update the release notes draft.

BEFORE SUBMITTING, PLEASE READ https://github.com/vllm-project/vllm-omni/blob/main/CONTRIBUTING.md (anything written below this line will be removed by GitHub Actions)

@hsliuustc0106 hsliuustc0106 added the ready label to trigger buildkite CI label Jan 29, 2026
@ZeldaHuang
update
515dfdd 
Signed-off-by: ZeldaHuang <[email protected]>
@ZeldaHuang
update
01f5e08 
Signed-off-by: ZeldaHuang <[email protected]>
@hsliuustc0106 hsliuustc0106 mentioned this pull request Jan 29, 2026
Closed
1 task
@david6666666 david6666666 linked an issue Jan 29, 2026 that may be closed by this pull request
[Bug]: Qwen3-Omni OOM occur by chance in CI #1084
Closed
1 task
@amy-why-3459
Copy link
Contributor

amy-why-3459 commented Jan 29, 2026 

	   tp=1	            tp=2
E2E	14798.60544	   17095.36076
E2E	15040.10153	   17175.17591
E2E	15180.53484	   17267.72022
E2E	15395.60413	   18366.13464
E2E	15514.0276	   18470.24417
E2E	15610.63743	   18709.90562
E2E	16903.44715	   18768.37778
E2E	17255.94592	   18828.37749
E2E	17316.66327	   19335.66022
E2E	18116.38713	   21175.01354
AVG	16113.19544	  18519.19703

hsliuustc0106
hsliuustc0106 approved these changes Jan 29, 2026
View reviewed changes
Copy link
Collaborator

@hsliuustc0106 hsliuustc0106 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@hsliuustc0106 hsliuustc0106 merged commit c48a9f3 into vllm-project:main Jan 29, 2026
7 checks passed
@yenuo26 yenuo26 mentioned this pull request Jan 30, 2026
Closed
1 task
dongbo910220 pushed a commit to dongbo910220/vllm-omni that referenced this pull request Feb 1, 2026
@ZeldaHuang @dongbo910220
[CI] Change Qwen3 Omni stage placement strategy (vllm-project#1072)
52bc961 
Signed-off-by: ZeldaHuang <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@hsliuustc0106 hsliuustc0106 hsliuustc0106 approved these changes

Assignees

No one assigned

Labels

ready label to trigger buildkite CI

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

[Bug]: Qwen3-Omni OOM occur by chance in CI

3 participants

@ZeldaHuang @amy-why-3459 @hsliuustc0106