[Speculative decoding] Add ngram prompt lookup decoding#4237
Merged
cadedaniel merged 2 commits intovllm-project:mainfrom May 1, 2024
Merged
[Speculative decoding] Add ngram prompt lookup decoding#4237cadedaniel merged 2 commits intovllm-project:mainfrom
cadedaniel merged 2 commits intovllm-project:mainfrom
Commits
Commits on May 1, 2024
- authored andcommitted
- committed
