Skip to content

[ROCm] [V1] [SpecDec] Enable Speculative Decoding on ROCm V1 Engine#21496

Merged
vllm-bot merged 9 commits into
vllm-project:mainfrom
EmbeddedLLM:fix-specdec-rocm
Aug 8, 2025
Merged

[ROCm] [V1] [SpecDec] Enable Speculative Decoding on ROCm V1 Engine#21496
vllm-bot merged 9 commits into
vllm-project:mainfrom
EmbeddedLLM:fix-specdec-rocm

disable tree attention from rocm

42b14ab
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Aug 7, 2025 in 0s

DCO

All commits are signed off!