Prebuilt wheels for PyTorch 2.9

[lgeiger]

Would be great to also have prebuilt wheels for PyTorch 2.9 on the 2.8.3 release

[sattwik-sahu]

I am using torch==2.9.0 with CUDA 13.0, and it does not seem to work for me as well

[montvid]

Source build with cuda 13 and torch 2.9 or 2.10 does no work for me too. 64 gb ram 32 cpu.

[xiansk]

Blackwell 支持良好：

https://zhuanlan.zhihu.com/p/1966238887119655602

[0xrushi]

I have them built here https://github.com/0xrushi/flash-attention/releases/tag/v2.8.4
tested on torch 2.10 linux

It would only work on rtx blackwell gpus

[montvid]

https://github.com/mjun0812/flash-attention-prebuild-wheels work fine too.

[ydshieh]

In https://github.com/huggingface/transformers, our CI docker image build is failing when we switch to use torch 2.9+cu126 during the installation of flash-attn (build forever).

Would be nice if we could have prebuilt wheels 🙏

[ydshieh]

Hi @tridao Is there any plan to have a wheel for torch 2.9 soon ?

That would be very beneficial to all of us 🙏