support dp > 1 while integrated with vllm#18

peaceforeverCN merged 1 commit intotaco-project:devtaco-project/FlexKV:devfrom

linhu-nv:dp-supportlinhu-nv/FlexKV:dp-supportCopy head branch name to clipboard