[Bug] [ROCm]: ModuleNotFoundError: No module named 'vllm.vllm_flash_attn.layers'

[tjtanaa]

Your current environment

The output of python collect_env.py

Your output of `python collect_env.py` here

🐛 Describe the bug

https://buildkite.com/vllm/vllm-omni-amd-ci/builds/42/steps/canvas?sid=019b3713-5b6e-4b67-9c59-9c2d1ea10dc8

ERROR 12-19 15:12:02 [gpu_worker.py:209] File "/app/vllm-omni/vllm_omni/diffusion/layers/custom_op.py", line 27, in forward -- ERROR 12-19 15:12:02 [gpu_worker.py:209] return self._forward_method(*args, **kwargs) ERROR 12-19 15:12:02 [gpu_worker.py:209] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ERROR 12-19 15:12:02 [gpu_worker.py:209] File "/app/vllm-omni/vllm_omni/diffusion/layers/rope.py", line 55, in forward_cuda ERROR 12-19 15:12:02 [gpu_worker.py:209] from vllm.vllm_flash_attn.layers.rotary import apply_rotary_emb ERROR 12-19 15:12:02 [gpu_worker.py:209] ModuleNotFoundError: No module named 'vllm.vllm_flash_attn.layers' ERROR 12-19 15:12:02 [diffusion_engine.py:57] Generation failed: No module named 'vllm.vllm_flash_attn.layers'

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[tjtanaa]

https://buildkite.com/vllm/vllm-omni-amd-ci/builds/43/steps/canvas The test is passing now.

[david6666666]

Has this issue been resolved? If so, we can close it.

[tjtanaa]

Resolved by the PR.