Skip to content

[Bugfix] Better error message for MLPSpeculator when num_speculative_tokens is set too high#5894

Merged
njhill merged 2 commits intovllm-project:mainfrom
tdoublep:mlp-error-msg
Jun 28, 2024
Merged

[Bugfix] Better error message for MLPSpeculator when `num_speculative_tokens` is set too high#5894
njhill merged 2 commits intovllm-project:mainfrom
tdoublep:mlp-error-msg

Commits

Commits on Jun 27, 2024

Commits on Jun 28, 2024