optimize serving_score loops.#24000

zhanluxianshen wants to merge 1 commit intovllm-project:mainvllm-project/vllm:mainfrom

zhanluxianshen:optimize-serving_score-loopszhanluxianshen/ai-vllm:optimize-serving_score-loopsCopy head branch name to clipboard