Skip to content

Commit a4f2d9e

Browse files
Potabkrichardsliu
authored andcommitted
[BugFix]Fix performance serving benchmark when enable profiling (vllm-project#14737)
Signed-off-by: wangli <[email protected]> Signed-off-by: Richard Liu <[email protected]>
1 parent 6e270d2 commit a4f2d9e

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

benchmarks/backend_request_func.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -333,7 +333,7 @@ async def async_request_openai_chat_completions(
333333
) -> RequestFuncOutput:
334334
api_url = request_func_input.api_url
335335
assert api_url.endswith(
336-
"chat/completions"
336+
("chat/completions", "profile")
337337
), "OpenAI Chat Completions API URL must end with 'chat/completions'."
338338

339339
async with aiohttp.ClientSession(trust_env=True,

0 commit comments

Comments
 (0)