Skip to content

switch roberta from sdpa to eager attn #1361

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Sep 26, 2024
Merged

switch roberta from sdpa to eager attn #1361

merged 1 commit into from
Sep 26, 2024

Conversation

@skaulintel
Copy link
Contributor

@skaulintel skaulintel commented Sep 25, 2024

What does this PR do?

Fixes # (issue)

Before submitting

  • This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
  • Did you make sure to update the documentation with your changes?
  • Did you write any new necessary tests?

@skaulintel skaulintel requested a review from regisss as a code owner September 25, 2024 22:05
@regisss regisss merged commit 679365a into transformers_future Sep 26, 2024
1 check passed
@regisss regisss deleted the skaulintel/roberta_eager_attn branch September 26, 2024 07:54
alekseyfa pushed a commit to alekseyfa/optimum-habana that referenced this pull request Jun 25, 2025
@skaulintel @alekseyfa
Switch roberta from sdpa to eager attn (huggingface#1361)
861750b
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@regisss regisss regisss approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@skaulintel @regisss