Skip to content

Use std::optional for mask_arr arg#2763

Merged
zcbenz merged 1 commit intoml-explore:mainfrom
zcbenz:sdpa-arrs
Nov 17, 2025
Merged

Use std::optional for mask_arr arg#2763
zcbenz merged 1 commit intoml-explore:mainfrom
zcbenz:sdpa-arrs

Conversation

@zcbenz
Copy link
Copy Markdown
Collaborator

@zcbenz zcbenz commented Nov 14, 2025

Both the API and kernel only support one mask so there is no need to store masks in a std::vector.

@awni
Copy link
Copy Markdown
Member

awni commented Nov 14, 2025

My understanding is this was an intentional design choice to enable masks which require more than one array in the future.

CC @jagrit06 or @angeloskath might have an example of that?

If not then yea we should simplify it.

@angeloskath
Copy link
Copy Markdown
Member

Yeah I think Jagrit had a specific thing in mind but I am pro simplifying now and breaking the API later.

Copy link
Copy Markdown
Member

@awni awni left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, we can change it back in the future if needed.

@zcbenz zcbenz merged commit 32b18d8 into ml-explore:main Nov 17, 2025
9 checks passed
@zcbenz zcbenz deleted the sdpa-arrs branch November 17, 2025 01:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants