[Model] Add Qwen-Image-Edit

[SamitHuang]

PLEASE FILL IN THE PR DESCRIPTION HERE ENSURING ALL CHECKLIST ITEMS (AT THE BOTTOM) HAVE BEEN CONSIDERED.

Purpose

Add Qwen-Image-Edit, as described #187

Test Plan

python image_edit.py \
    --image qwen_bear.png \
    --prompt "Let this mascot dance under the moon, surrounded by floating stars and poetic bubbles such as 'Be Kind'" \
    --output output_image_edit.png \
    --num_inference_steps 50 \
    --cfg_scale 4.0

Test Result

Input image:

Edited image:

prompt: "Let this mascot dance under the moon, surrounded by floating stars and poetic bubbles such as 'Be Kind'"

prompt: "Add a white art board written with colorful text 'vLLM-Omni' on grassland. Add a paintbrush in the bear's hands. position the bear standing in front of the art board as if painting"

---

Essential Elements of an Effective PR Description Checklist

• The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
• The test plan, such as providing test command.
• The test results, such as pasting the results comparison before and after, or e2e results
• (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.
• (Optional) Release notes update. If your change is user facing, please update the release notes draft.

BEFORE SUBMITTING, PLEASE READ https://github.com/vllm-project/vllm-omni/blob/main/CONTRIBUTING.md (anything written below this line will be removed by GitHub Actions)

[chatgpt-codex-connector]

The account who enabled Codex for this repo no longer has access to Codex. Please contact the admins of this repo to enable Codex again.

[hsliuustc0106]

PLEASE FILL IN THE PR DESCRIPTION HERE ENSURING ALL CHECKLIST ITEMS (AT THE BOTTOM) HAVE BEEN CONSIDERED.

Purpose

Add Qwen-Image-Edit, as described #187

TODOs:

• align output with diffusers
• run pre-processing in DiffusionEngine (or API Server after online serving supported)

Test Plan

python image_edit.py \
    --image qwen_bear.png \
    --prompt "Let this mascot dance under the moon, surrounded by floating stars and poetic bubbles such as 'Be Kind'" \
    --output output_image_edit.png \
    --num_inference_steps 50 \
    --cfg_scale 4.0

Test Result

Input image:

Edited image:

Essential Elements of an Effective PR Description Checklist

• The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
• The test plan, such as providing test command.
• The test results, such as pasting the results comparison before and after, or e2e results
• (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.
• (Optional) Release notes update. If your change is user facing, please update the release notes draft.

BEFORE SUBMITTING, PLEASE READ https://github.com/vllm-project/vllm-omni/blob/main/CONTRIBUTING.md (anything written below this line will be removed by GitHub Actions)

could you modify the png for qwen x vllm-omni

[SamitHuang]

@hsliuustc0106 added

[chatgpt-codex-connector]

The account who enabled Codex for this repo no longer has access to Codex. Please contact the admins of this repo to enable Codex again.

[ZJY0516]

Can we unify get_diffusion_pre_process_func and get_diffusion_post_process_func? They have some common code

[SamitHuang]

good suggestion, common code is extracted into a function

[ZJY0516]

Do we really need this log?

[SamitHuang]

it's used for performance profiling. just two lines of info log. i think it doesn't matter

[ZJY0516]

use weight loader introduced in #157

[Gaohan123]

LGTM, thanks!