[Usage]: Vllm inference slower for LoRA models

[akrish2011]

Your current environment

The output of `python collect_env.py`

How would you like to use vllm

when running LoRA trained models using Vllm see lower inference speed when compared to Non-LoRA trained models. Is there anything causing this ?

[jeejeelee]

please refer to: #2829 and #1804

[mgoin]

This should be lessened by about 2x with the new landed Triton kernels #5036