Skip to content

Use model cache for dataprep docker compose test. #1450

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
ZePan110 merged 4 commits into from
Mar 27, 2025
Merged

Use model cache for dataprep docker compose test. #1450

Show file tree
Hide file tree
Changes from 2 commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
b017bac
Use model cache for dataprepl docker compose test.
ZePan110 Mar 25, 2025
9e7b13a
Fix comments
ZePan110 Mar 25, 2025
2d78a18
Fix typo
ZePan110 Mar 27, 2025
e1fb095
Merge branch 'main' into cache_dataprep
ZePan110 Mar 27, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .github/workflows/manual-comps-test.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -69,4 +69,5 @@ jobs:
mode: ${{ inputs.mode }}
test_compose: ${{ inputs.test_compose }}
test_helmchart: ${{ inputs.test_helmchart }}
use_model_cache: ${{ inputs.use_model_cache }}
secrets: inherit
6 changes: 3 additions & 3 deletions comps/third_parties/tei/deployment/docker_compose/compose.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ services:
ports:
- "${TEI_EMBEDDER_PORT:-12000}:80"
volumes:
- "./data:/data"
- "${DATA_PATH-./data}:/data"
shm_size: 1g
environment:
no_proxy: ${no_proxy}
Expand All @@ -30,7 +30,7 @@ services:
ports:
- "${TEI_RERANKING_PORT:-12003}:80"
volumes:
- "./data:/data"
- "${DATA_PATH-./data}:/data"
shm_size: 1g
environment:
no_proxy: ${no_proxy}
Expand All @@ -51,7 +51,7 @@ services:
ports:
- ${TEI_RERANKING_PORT:-12004}:80
volumes:
- "./data:/data"
- "${DATA_PATH-./data}:/data"
shm_size: 1g
environment:
no_proxy: ${no_proxy}
Expand Down
2 changes: 1 addition & 1 deletion tests/dataprep/test_dataprep_milvus.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ ip_address=$(hostname -I | awk '{print $1}')
DATAPREP_PORT=11101
service_name="dataprep-milvus tei-embedding-serving etcd minio standalone"
export TAG="comps"

export DATA_PATH=${model_cache}
SCRIPT_DIR="$( cd "$( dirname "${BASH_SOURCE[0]}" )" &> /dev/null && pwd )"
source ${SCRIPT_DIR}/dataprep_utils.sh

Expand Down
1 change: 1 addition & 0 deletions tests/dataprep/test_dataprep_neo4j_on_intel_hpu.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,7 @@ ip_address=$(hostname -I | awk '{print $1}')
DATAPREP_PORT=11103
LLM_ENDPOINT_PORT=10510
export TAG="comps"
export DATA_PATH=${model_cache}

function build_docker_images() {
cd $WORKPATH
Expand Down
1 change: 1 addition & 0 deletions tests/dataprep/test_dataprep_qdrant.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,7 @@ ip_address=$(hostname -I | awk '{print $1}')
DATAPREP_PORT="11107"
TEI_EMBEDDER_PORT="10220"
export TAG="comps"
export DATA_PATH=${model_cache}

SCRIPT_DIR="$( cd "$( dirname "${BASH_SOURCE[0]}" )" &> /dev/null && pwd )"
source ${SCRIPT_DIR}/dataprep_utils.sh
Expand Down
1 change: 1 addition & 0 deletions tests/dataprep/test_dataprep_redis.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,7 @@ ip_address=$(hostname -I | awk '{print $1}')
DATAPREP_PORT="11108"
TEI_EMBEDDER_PORT="10221"
export TAG="comps"
export DATA_PATH=${model_cache}

SCRIPT_DIR="$( cd "$( dirname "${BASH_SOURCE[0]}" )" &> /dev/null && pwd )"
source ${SCRIPT_DIR}/dataprep_utils.sh
Expand Down
2 changes: 1 addition & 1 deletion tests/dataprep/test_dataprep_redis_finance_on_intel_hpu.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -53,7 +53,7 @@ function start_vllm_service_70B() {
echo "token is ${HF_TOKEN}"
model="meta-llama/Llama-3.3-70B-Instruct"
vllm_port=8086
export HF_CACHE_DIR=/data2/hf_model
export HF_CACHE_DIR=${model_cache:-./data}
vllm_volume=$HF_CACHE_DIR

echo "start vllm gaudi service"
Expand Down
1 change: 1 addition & 0 deletions tests/dataprep/test_dataprep_redis_multimodal.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -23,6 +23,7 @@ caption_fn="${tmp_dir}/${image_name}.txt"
pdf_name="nke-10k-2023"
pdf_fn="${tmp_dir}/${pdf_name}.pdf"
DATAPREP_PORT="11109"
export DATA_PATH=${model_cache}

function build_docker_images() {
cd $WORKPATH
Expand Down
Loading