Adds support for OpenAI chat completions API in bench_serving#7036

mickqian merged 13 commits intosgl-project:mainsgl-project/sglang:mainfrom

JustinTong0323:bench_serving_openai_chatJustinTong0323/sglang:bench_serving_openai_chatCopy head branch name to clipboard