Better support for FlashAttention: real batching + sliding window + softcap#707

EricLBuehler merged 7 commits intomasterEricLBuehler/mistral.rs:masterfrom

flash_attn_softcapEricLBuehler/mistral.rs:flash_attn_softcapCopy head branch name to clipboard