Commit be0e12d

authored and

Pradyun Ramadorai

committed

[V1][P/D]Enhance Performance and code readability for P2pNcclConnector (vllm-project#20906)

Signed-off-by: Abatom <[email protected]>

1 parent 9f86558 commit be0e12dCopy full SHA for be0e12d

4 files changed

+266

-256

lines changed

docs/design/v1
- p2p_nccl_connector.md
examples/online_serving/disaggregated_serving_p2p_nccl_xpyd
- disagg_proxy_p2p_nccl_xpyd.py
vllm/distributed/kv_transfer/kv_connector/v1/p2p
- p2p_nccl_connector.py
- p2p_nccl_engine.py

+266

-256

lines changed

Comments

(0)