Skip to content

[Bugfix] Address #8009 and add model test for flashinfer fp8 kv cache.#8013

Merged
youkaichao merged 4 commits intovllm-project:mainfrom
pavanimajety:dispatch-uint8-flashinfer-bug
Aug 31, 2024
Merged

[Bugfix] Address #8009 and add model test for flashinfer fp8 kv cache.#8013
youkaichao merged 4 commits intovllm-project:mainfrom
pavanimajety:dispatch-uint8-flashinfer-bug

Commits

Commits on Aug 29, 2024