Adding files to deploy DocSum application on ROCm vLLM#1572
Adding files to deploy DocSum application on ROCm vLLM#1572chensuyue merged 149 commits intoopea-project:mainfrom
Conversation
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Dependency Review✅ No vulnerabilities or license issues found.Scanned Files |
for more information, see https://pre-commit.ci
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
…into feature/Docsum_vLLM # Conflicts: # .github/workflows/_example-workflow.yml # AgentQnA/README.md # AgentQnA/docker_compose/intel/cpu/xeon/README.md # AgentQnA/docker_compose/intel/cpu/xeon/compose_openai.yaml # AgentQnA/docker_compose/intel/cpu/xeon/launch_agent_service_openai.sh # AgentQnA/docker_compose/intel/hpu/gaudi/README.md # AgentQnA/docker_compose/intel/hpu/gaudi/launch_agent_service_gaudi.sh # AgentQnA/tests/step4_launch_and_validate_agent_gaudi.sh # AgentQnA/tests/test_compose_on_gaudi.sh # AudioQnA/docker_image_build/build.yaml # ChatQnA/docker_compose/intel/hpu/gaudi/compose.telemetry.yaml # ChatQnA/docker_compose/intel/hpu/gaudi/compose_tgi.telemetry.yaml # ChatQnA/docker_compose/intel/hpu/gaudi/set_env.sh
for more information, see https://pre-commit.ci
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
I fixed errors related to missing variables and encountered an error again. - failed to solve: opea/comps-base:ci: failed to resolve source metadata for docker.io/opea/comps-base:ci: docker.io/opea/comps-base:ci: not found |
Please see my comments inline. |
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
…tamonsters/OPEA-GenAIExamples into feature/Docsum_vLLM # Conflicts: # DocSum/docker_compose/amd/gpu/rocm/README.md # DocSum/docker_compose/amd/gpu/rocm/compose.yaml # DocSum/docker_compose/amd/gpu/rocm/compose_vllm.yaml # DocSum/tests/test_compose_on_rocm.sh # DocSum/tests/test_compose_vllm_on_rocm.sh
…into feature/Docsum_vLLM # Conflicts: # DocSum/docker_compose/amd/gpu/rocm/README.md # DocSum/docker_compose/amd/gpu/rocm/set_env.sh # DocSum/docker_image_build/build.yaml # DocSum/tests/test_compose_on_rocm.sh
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
…into feature/Docsum_vLLM
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
…into feature/Docsum_vLLM
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
for more information, see https://pre-commit.ci
…1572) Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com> Signed-off-by: Chingis Yundunov <c.yundunov@datamonsters.com>
…1572) Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com> Signed-off-by: cogniware-devops <ambarish.desai@cogniware.ai>
Description
Adding files to deploy DocSum application on ROCm vLLM.
Issues
It is required to provide the ability to deploy the DocSum application on ROCm vLLM
Type of change
Dependencies
Tests
Testing was performed manually and by running a script DocSum/tests/test_compose_vllm_on_rocm.sh This script is similar to the script that runs DocSum testing on an Intel CPU.