Commit ef54499
[SW-209062] Disable default sdpa in Albert (#22)
Transformers v4.45 introduced sdpa as the default implementation
in Albet. This caused performance drop.
Adding Albert to the list of models which don't yet have sdpa
implementation in Gaudi and use thus eager attention.1 parent 9a49200 commit ef54499
1 file changed
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
115 | 115 | | |
116 | 116 | | |
117 | 117 | | |
118 | | - | |
| 118 | + | |
119 | 119 | | |
120 | 120 | | |
121 | 121 | | |
| |||
0 commit comments