Add utility functions to enable pass-kv prefill and allgather decode.#26059

Open

qiruiyangmeta wants to merge 10 commits intovllm-project:mainfrom

qiruiyangmeta:add_cp_for_xformers

Commits on Oct 3, 2025

Add context parallelism configurations and parallel group
Qirui Yang
committed
Lint
Qirui Yang
committed
Fix EP group ranks
Qirui Yang
committed
Add token sharding functions and tests for context parallelism
Qirui Yang
committed
lint
Qirui Yang
committed
lint
Qirui Yang
committed
Add token sharding functions and tests for context parallelism
Qirui Yang
committed
Add context parallel support for xformers attention backend
Qirui Yang
committed
lint
Qirui Yang
committed
lint
Qirui Yang
committed