Commit 27cee1f
[Speculative Decoding 1/2 ] Add typical acceptance sampling as one of the sampling techniques in the verifier (vllm-project#5131)
1 parent 371ed93 commit 27cee1f
File tree
4 files changed
+866
-164
lines changed- tests/samplers
- vllm/model_executor/layers
4 files changed
+866
-164
lines changed
0 commit comments