Skip to content

[Speculative decoding 6/9] Integrate speculative decoding with LLMEngine #3894

Merged
cadedaniel merged 120 commits intovllm-project:mainfrom
cadedaniel:llm-engine-spec
Apr 16, 2024
Merged

[Speculative decoding 6/9] Integrate speculative decoding with LLMEngine #3894
cadedaniel merged 120 commits intovllm-project:mainfrom
cadedaniel:llm-engine-spec

Commits

Commits on Apr 3, 2024

Commits on Apr 4, 2024

Commits on Apr 5, 2024

Commits on Apr 7, 2024

Commits on Apr 8, 2024

Commits on Apr 9, 2024

Commits on Apr 10, 2024

Commits on Apr 11, 2024

Commits on Apr 16, 2024