Skip to content

[Kernel][Amd] Add fp8 kv cache support for rocm custom paged attention#8577

Merged
mgoin merged 6 commits intovllm-project:mainfrom
ROCm:fp8_kv_cache_for_rocm_paged_attention
Sep 19, 2024
Merged

[Kernel][Amd] Add fp8 kv cache support for rocm custom paged attention#8577
mgoin merged 6 commits intovllm-project:mainfrom
ROCm:fp8_kv_cache_for_rocm_paged_attention

Commits

Commits on Sep 17, 2024