[Core/Bugfix] Add query dtype as per FlashInfer API requirements.#8173
Merged
comaniac merged 1 commit intovllm-project:mainfrom Sep 5, 2024
Merged
[Core/Bugfix] Add query dtype as per FlashInfer API requirements.#8173comaniac merged 1 commit intovllm-project:mainfrom
comaniac merged 1 commit intovllm-project:mainfrom
