Skip to content

Use FlashAttention for multi_query_kv_attention#4

Merged
WoosukKwon merged 8 commits intomainfrom
flash-attn
Mar 2, 2023
Merged

Use FlashAttention for `multi_query_kv_attention`#4
WoosukKwon merged 8 commits intomainfrom
flash-attn

Commits

Commits on Mar 2, 2023