File tree Expand file tree Collapse file tree 1 file changed +7
-2
lines changed Expand file tree Collapse file tree 1 file changed +7
-2
lines changed Original file line number Diff line number Diff line change @@ -12,14 +12,18 @@ The pre-built image includes:
1212
1313- ROCm™ 6.3.1
1414- vLLM 0.6.6
15- - PyTorch 2.6dev (nightly)
15+ - PyTorch 2.7dev (nightly)
1616
1717## Pull latest Docker Image
1818
1919Pull the most recent validated docker image with ` docker pull rocm/vllm-dev:main `
2020
2121## What is New
2222
23+ 20250205_aiter:
24+ - [ AITER] ( https://github.com/ROCm/aiter ) support
25+ - Performance improvement for custom paged attention
26+ - Reduced memory overhead bug fix
232720250124:
2428- Fix accuracy issue with 405B FP8 Triton FA
2529- Fixed accuracy issue with TP8
@@ -475,8 +479,9 @@ To reproduce the release docker:
475479``` bash
476480 git clone https://github.com/ROCm/vllm.git
477481 cd vllm
478- git checkout 8e87b08c2a284c1a20eb3d8e0fbdc84918bf27dc
482+ git checkout 9dc3394c9ee4da250be28d7bd08babf098d51081
479483 docker build -f Dockerfile.rocm -t < your_tag> --build-arg BUILD_HIPBLASLT=1 --build-arg USE_CYTHON=1 .
484+ export VLLM_USE_AITER=0
480485```
481486
482487### AITER
You can’t perform that action at this time.
0 commit comments