[Bugfix] fixing sonnet benchmark bug in benchmark_serving.py#8616

Merged

ywang96 merged 1 commit intovllm-project:mainfrom

KuntaiDu:kuntai-sonnet-fix

Sep 19, 2024

Commits on Sep 19, 2024

fixing sonnet benchmark bug: after adding multi-modal content, there is a new attribute called mm_content which is not added as None in sonnet, triggering bugs
KuntaiDu
committed