This repository was archived by the owner on Oct 11, 2024. It is now read-only.
Commit dbf0e91
[Speculative Decoding 1/2 ] Add typical acceptance sampling as one of the sampling techniques in the verifier (vllm-project#5131)
1 parent 7a58e54 commit dbf0e91
File tree
4 files changed
+866
-164
lines changed- tests/samplers
- vllm/model_executor/layers
4 files changed
+866
-164
lines changed
0 commit comments