FEAT: Xavier: Share KV cache between VLLM replicas#2732
Merged
ChengjieLi28 merged 18 commits intoxorbitsai:mainfrom Jan 10, 2025
Merged
FEAT: Xavier: Share KV cache between VLLM replicas#2732ChengjieLi28 merged 18 commits intoxorbitsai:mainfrom
ChengjieLi28 merged 18 commits intoxorbitsai:mainfrom
Commits
Commits on Jan 3, 2025
- committed
- committed
Commits on Jan 6, 2025
Commits on Jan 7, 2025
- committed
- committed
- committed
- committed
Commits on Jan 8, 2025
Commits on Jan 9, 2025
- committed
- committed
- committed
- committed
Commits on Jan 10, 2025
- committed
- committed
- committed
- committed