[Bugfix] Better error message for MLPSpeculator when num_speculative_tokens is set too high#5894
Merged
njhill merged 2 commits intovllm-project:mainfrom Jun 28, 2024
Merged
num_speculative_tokens is set too high#5894