Skip to content

Adding files to deploy DocSum application on ROCm vLLM#1572

Merged
chensuyue merged 149 commits intoopea-project:mainfrom
chyundunovDatamonsters:feature/DocSum_vLLM
Apr 3, 2025
Merged

Adding files to deploy DocSum application on ROCm vLLM#1572
chensuyue merged 149 commits intoopea-project:mainfrom
chyundunovDatamonsters:feature/DocSum_vLLM

Conversation

@chyundunovDatamonsters
Copy link
Copy Markdown
Contributor

Description

Adding files to deploy DocSum application on ROCm vLLM.

Issues

It is required to provide the ability to deploy the DocSum application on ROCm vLLM

Type of change

  • [*] New feature (non-breaking change which adds new functionality)

Dependencies

Tests

Testing was performed manually and by running a script DocSum/tests/test_compose_vllm_on_rocm.sh This script is similar to the script that runs DocSum testing on an Intel CPU.

Chingis Yundunov added 13 commits February 13, 2025 10:02
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
@github-actions
Copy link
Copy Markdown

github-actions bot commented Feb 19, 2025

Dependency Review

✅ No vulnerabilities or license issues found.

Scanned Files

Chingis Yundunov added 11 commits February 19, 2025 20:03
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Chingis Yundunov and others added 6 commits March 24, 2025 13:17
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
…into feature/Docsum_vLLM

# Conflicts:
#	.github/workflows/_example-workflow.yml
#	AgentQnA/README.md
#	AgentQnA/docker_compose/intel/cpu/xeon/README.md
#	AgentQnA/docker_compose/intel/cpu/xeon/compose_openai.yaml
#	AgentQnA/docker_compose/intel/cpu/xeon/launch_agent_service_openai.sh
#	AgentQnA/docker_compose/intel/hpu/gaudi/README.md
#	AgentQnA/docker_compose/intel/hpu/gaudi/launch_agent_service_gaudi.sh
#	AgentQnA/tests/step4_launch_and_validate_agent_gaudi.sh
#	AgentQnA/tests/test_compose_on_gaudi.sh
#	AudioQnA/docker_image_build/build.yaml
#	ChatQnA/docker_compose/intel/hpu/gaudi/compose.telemetry.yaml
#	ChatQnA/docker_compose/intel/hpu/gaudi/compose_tgi.telemetry.yaml
#	ChatQnA/docker_compose/intel/hpu/gaudi/set_env.sh
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
@chyundunovDatamonsters
Copy link
Copy Markdown
Contributor Author

@joshuayao @chensuyue @ please tell me why the error occurs:

  • docker build --no-cache -t /comps-base: --build-arg https_proxy= --build-arg http_proxy= -f Dockerfile .
    ERROR: invalid tag "/comps-base:": invalid reference format

Please see my comments in line, that's because you deleted some ENVs in the test.

I fixed errors related to missing variables and encountered an error again. - failed to solve: opea/comps-base:ci: failed to resolve source metadata for docker.io/opea/comps-base:ci: docker.io/opea/comps-base:ci: not found

@chensuyue
Copy link
Copy Markdown
Collaborator

@joshuayao @chensuyue @ please tell me why the error occurs:

  • docker build --no-cache -t /comps-base: --build-arg https_proxy= --build-arg http_proxy= -f Dockerfile .
    ERROR: invalid tag "/comps-base:": invalid reference format

Please see my comments in line, that's because you deleted some ENVs in the test.

I fixed errors related to missing variables and encountered an error again. - failed to solve: opea/comps-base:ci: failed to resolve source metadata for docker.io/opea/comps-base:ci: docker.io/opea/comps-base:ci: not found

Please see my comments inline.

Chingis Yundunov and others added 5 commits March 24, 2025 22:03
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
…tamonsters/OPEA-GenAIExamples into feature/Docsum_vLLM

# Conflicts:
#	DocSum/docker_compose/amd/gpu/rocm/README.md
#	DocSum/docker_compose/amd/gpu/rocm/compose.yaml
#	DocSum/docker_compose/amd/gpu/rocm/compose_vllm.yaml
#	DocSum/tests/test_compose_on_rocm.sh
#	DocSum/tests/test_compose_vllm_on_rocm.sh
…into feature/Docsum_vLLM

# Conflicts:
#	DocSum/docker_compose/amd/gpu/rocm/README.md
#	DocSum/docker_compose/amd/gpu/rocm/set_env.sh
#	DocSum/docker_image_build/build.yaml
#	DocSum/tests/test_compose_on_rocm.sh
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Chingis Yundunov and others added 3 commits April 2, 2025 12:45
@joshuayao joshuayao added the v1.3 label Apr 3, 2025
Chingis Yundunov and others added 6 commits April 3, 2025 10:35
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
@chensuyue chensuyue merged commit 319dbda into opea-project:main Apr 3, 2025
20 checks passed
chyundunovDatamonsters added a commit to chyundunovDatamonsters/OPEA-GenAIExamples that referenced this pull request May 16, 2025
…1572)

Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <c.yundunov@datamonsters.com>
cogniware-devops pushed a commit to Cogniware-Inc/GenAIExamples that referenced this pull request Dec 19, 2025
…1572)

Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: cogniware-devops <ambarish.desai@cogniware.ai>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.