Update to Unified ROCm 6.2 base image (#155)

* optimizations for process output step

* Llama3.1 (#129)

* Add support for a rope extension method (vllm-project#6553)

* [BugFix] Fix RoPE error in Llama 3.1 (vllm-project#6693)

---------

Co-authored-by: Simon Mo <[email protected]>
Co-authored-by: Woosuk Kwon <[email protected]>

* Update hipblaslt and FA revs to match what was used for MLPerf

* Switch to "unified docker" with a ROCm 6.2 base image

This base image includes current libraries, so there is no need for
us to rebuild hipblaslt, RCCL, and Flash Attention.

---------

Co-authored-by: Shomy <[email protected]>
Co-authored-by: Gregory Shtrasberg <[email protected]>
Co-authored-by: Simon Mo <[email protected]>
Co-authored-by: Woosuk Kwon <[email protected]>

Author: 5 people

Dockerfile.rocm

@@ -1,12 +1,12 @@
 # default base image
-ARG BASE_IMAGE="rocm/pytorch:rocm6.1.2_ubuntu20.04_py3.9_pytorch_staging"
+ARG BASE_IMAGE="rocm/pytorch-private:20240819_exec_dashboard_unified_rc3_added_triton_fa_vllm"
 
 ARG COMMON_WORKDIR=/app
 
 # The following ARGs should be "0" or "1". If "1", the respective component will be built and installed on top of the base image
-ARG BUILD_HIPBLASLT="1"
-ARG BUILD_RCCL="1"
-ARG BUILD_FA="1"
+ARG BUILD_HIPBLASLT="0"
+ARG BUILD_RCCL="0"
+ARG BUILD_FA="0"
 ARG BUILD_CUPY="0"
 ARG BUILD_TRITON="1"
 # This ARG should also be "0" or "1". If "1", the vLLM development directory is obtained via git clone.
@@ -26,7 +26,7 @@ ARG PYTORCH_ROCM_ARCH="gfx90a;gfx942"
 ENV PYTORCH_ROCM_ARCH=${PYTORCH_ROCM_ARCH}
 
 # Install some basic utilities
-RUN apt-get update && apt-get install python3 python3-pip -
+RUN apt-get update && apt-get install -y python3 python3-pip -
 RUN apt-get update && apt-get install -y \
     sqlite3 libsqlite3-dev libfmt-dev libmsgpack-dev libsuitesparse-dev