Skip to content

[Core][Bugfix] Support prompt_logprobs returned with speculative decoding#8047

Merged
njhill merged 9 commits intovllm-project:mainfrom
tjohnson31415:fix-speculator-prompt-logprobs
Sep 25, 2024
Merged

[Core][Bugfix] Support prompt_logprobs returned with speculative decoding#8047
njhill merged 9 commits intovllm-project:mainfrom
tjohnson31415:fix-speculator-prompt-logprobs

Commits

Commits on Sep 18, 2024

Commits on Sep 23, 2024