[Feature]: Releasing Prebuilt Wheels

[tjtanaa]

Suggestion Description

Like nixl (https://github.com/vllm-project/vllm/blob/b569620f720d0c07bcb90bcc29dacaf0ce318d85/docker/Dockerfile#L801), could we have prebuilt wheel releases for better user experience and avoid building from source on inference framework like vLLM (vllm-project/vllm#38371)

This is ideal for reusing Mori across multiple repos as well.

Operating System

No response

GPU

No response

ROCm Component

No response

[jhchouuu]

Thanks for your suggestion, We are currently promoting the implementation of CI and wheels release.

[functionstackx]

thanks @jhchouuu

in terms of the clusters i have, i have mi355 pollara cluster and thor-2 mi325 clusters so it is great for MoRI wheels to support both of these

[jhchouuu]

Thanks @tjtanaa @functionstackx
We now have nightly pre-built wheels for MoRI, automatically built and tested every day.
Install the latest nightly:
pip install --no-index --force-reinstall --find-links https://rocm.github.io/mori/nightly/latest/ amd_mori
Browse all nightly builds: https://rocm.github.io/mori/nightly/

Nightly wheels are built for Python 3.10 and 3.12, tested on MI355X (AINIC) and MI300X (BNXT) platforms with both intranode and internode python tests. Only wheels that pass the full test suite are published to latest/.

For stable releases, amd_mori is available on PyPI: pip install amd_mori

The installation method has been updated in the README.md file.

[tjtanaa]

Thanks @tjtanaa @functionstackx
We now have nightly pre-built wheels for MoRI, automatically built and tested every day.
Install the latest nightly:
pip install --no-index --force-reinstall --find-links https://rocm.github.io/mori/nightly/latest/ amd_mori
Browse all nightly builds: https://rocm.github.io/mori/nightly/

Nightly wheels are built for Python 3.10 and 3.12, tested on MI355X (AINIC) and MI300X (BNXT) platforms with both intranode and internode python tests. Only wheels that pass the full test suite are published to latest/.

For stable releases, amd_mori is available on PyPI: pip install amd_mori

The installation method has been updated in the README.md file.

@jhchouuu is there any ROCm version dependencies? What is the ROCm version used? We are currently at ROCm 7.2.2

[jhchouuu]

Hi @tjtanaa It has not any dependencies with the rocm version. Version 7.2.2 is supported. But we have only tested it on Ubuntu 22.04/24.04 docker env. We plan to test more os later. You can give it a try first. If you encounter any problems, please contact us.

[jhchouuu]

and now we have nightly wheel released on pypi too https://pypi.org/project/amd-mori-nightly/
use pip install amd-mori-nightly can get the latest nightly pre-build mori wheel

cc @functionstackx @tjtanaa

[functionstackx]

thanks @jhchouuu can u update the README about it