[Refactor][MLA]: Independently passing q_nope & q_rope

[vnadathur]

This is outdated, I messed up src control. Here is the updated pr: #28368

I track in this issue: #26567

open up the opportunity for MLA to its own custom op instead of unified_attention allowing for to potentially explore passing q_nope and q_rope independently instead of concatenated

Reference: #24620 and #25103

The buildthedocs fails because of the changes in flashmla_sparse.py. This will prob need to be overwritten.

cc @ProExpertProg @MatthewBonanni @LucasWilkinson

[chatgpt-codex-connector]

💡 Codex Review

Here are some automated review suggestions for this pull request.

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

• Open a pull request for review
• Mark a draft as ready
• Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

[mergify]

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @vnadathur.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

[ProExpertProg]

Let's split the tuple and update flashmla_sparse to the new interface as well! Also cc @MatthewBonanni and @LucasWilkinson - do we expect a win here somewhere because q no longer needs to be concatenated?

[mergify]

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @vnadathur.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork