Use FlashAttention for multi_query_kv_attention#4
Merged
WoosukKwon merged 8 commits intomainfrom Mar 2, 2023
Merged
Commits
Commits on Mar 2, 2023
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed