Skip to content

[Doc] add online speculative decoding example#7243

Merged
youkaichao merged 2 commits intovllm-project:mainfrom
stas00:spec-dec-online
Aug 7, 2024
Merged

[Doc] add online speculative decoding example#7243
youkaichao merged 2 commits intovllm-project:mainfrom
stas00:spec-dec-online

Commits

Commits on Aug 7, 2024