ChatQnA Docker compose file for Milvus as vdb by ezelanza · Pull Request #1548 · opea-project/GenAIExamples

ezelanza · 2025-02-13T16:58:52Z

Description

Docker_compose file for Milvus usage as Vector Database on GenAIExamples/ChatQnA

Issues

Retriever PR

Type of change

List the type of change like below. Please delete options that are not relevant.

Bug fix (non-breaking change which fixes an issue)
[ X] New feature (non-breaking change which adds new functionality)
Breaking change (fix or feature that would break existing design and interface)
Others (enhancement, documentation, validation, etc.)

Dependencies

n/a

Tests

Locally tested

github-actions · 2025-02-13T16:59:11Z

Dependency Review

✅ No vulnerabilities or license issues found.

Scanned Files

ezelanza · 2025-02-13T17:12:59Z

The PR replaces the actual retriever error on Milvus comps. Once the new image is created, the functionality will work.

ChatQnA/docker_compose/intel/cpu/xeon/compose_milvus.yaml

letonghan · 2025-02-14T01:54:10Z

Hi @ezelanza ! Please also provide a test script in GenAIExamples/ChatQnA/tests named as test_compose_milvus_on_xeon.sh. You can follow the design of this file, Thanks!

xiguiw · 2025-02-25T06:49:15Z

@ezelanza
Please check the CI failed.

Signed-off-by: Ezequiel Lanza <[email protected]>

Signed-off-by: Kendall González León <[email protected]> Signed-off-by: Ezequiel Lanza <[email protected]>

Expand CI test scope, trigger all hw test when the common test scripts changed. Signed-off-by: chensuyue <[email protected]> Signed-off-by: Ezequiel Lanza <[email protected]>

Signed-off-by: Spycsh <[email protected]> Signed-off-by: Ezequiel Lanza <[email protected]>

Signed-off-by: Wang, Xigui <[email protected]> Co-authored-by: chen, suyue <[email protected]> Signed-off-by: Ezequiel Lanza <[email protected]>

Change Docker Compost<br/>Deployment on ROCm to Docker Compose<br/>Deployment on ROCm Signed-off-by: Ezequiel Lanza <[email protected]>

Signed-off-by: ZePan110 <[email protected]> Signed-off-by: Ezequiel Lanza <[email protected]>

…oject#1391) Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: chen, suyue <[email protected]> Signed-off-by: Ezequiel Lanza <[email protected]>

Signed-off-by: Wang, Xigui <[email protected]> Signed-off-by: Ezequiel Lanza <[email protected]>

for more information, see https://pre-commit.ci Signed-off-by: Ezequiel Lanza <[email protected]>

- Align benchmark default config: 1. Update default helm charts version. 2. Add `# mandatory` comment. 3. Update default model ID for LLM. - Fix deploy issue: 1. Support different `replicaCount` for w/ w/o rerank test. 2. Add `max_num_seqs` for vllm. 3. Add resource setting for tune mode. - Fix Benchmark issue: 1. Update `user_queries` and `concurrency` setting. 2. Remove invalid parameters. 3. Fix `dataset` and `prompt` setting. And dataset ingest into db. 5. Fix the benchmark hang issue with large user queries. Update `"processes": 16` will fix this issue. 6. Update the eval_path setting logical. - Optimize benchmark readme. - Optimize the log path to make the logs more readable. Signed-off-by: chensuyue <[email protected]> Signed-off-by: Cathy Zhang <[email protected]> Signed-off-by: letonghan <[email protected]> Signed-off-by: Ezequiel Lanza <[email protected]>

) Signed-off-by: alexsin368 <[email protected]> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Signed-off-by: Ezequiel Lanza <[email protected]>

Signed-off-by: Ezequiel Lanza <[email protected]>

Signed-off-by: WenjiaoYue <[email protected]> Signed-off-by: Ezequiel Lanza <[email protected]>

Signed-off-by: Ezequiel Lanza <[email protected]>

for more information, see https://pre-commit.ci Signed-off-by: Ezequiel Lanza <[email protected]>

Signed-off-by: Ezequiel Lanza <[email protected]> Signed-off-by: Kendall González León <[email protected]> Signed-off-by: chensuyue <[email protected]> Signed-off-by: Spycsh <[email protected]> Signed-off-by: Wang, Xigui <[email protected]> Signed-off-by: ZePan110 <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: minmin-intel <[email protected]> Signed-off-by: Artem Astafev <[email protected]> Signed-off-by: Xinyao Wang <[email protected]> Signed-off-by: Cathy Zhang <[email protected]> Signed-off-by: letonghan <[email protected]> Signed-off-by: alexsin368 <[email protected]> Signed-off-by: WenjiaoYue <[email protected]> Co-authored-by: Ezequiel Lanza <[email protected]> Co-authored-by: Kendall González León <[email protected]> Co-authored-by: chen, suyue <[email protected]> Co-authored-by: Spycsh <[email protected]> Co-authored-by: xiguiw <[email protected]> Co-authored-by: jotpalch <[email protected]> Co-authored-by: ZePan110 <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: minmin-intel <[email protected]> Co-authored-by: Ying Hu <[email protected]> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Eero Tamminen <[email protected]> Co-authored-by: Liang Lv <[email protected]> Co-authored-by: Artem Astafev <[email protected]> Co-authored-by: XinyaoWa <[email protected]> Co-authored-by: alexsin368 <[email protected]> Co-authored-by: WenjiaoYue <[email protected]> Signed-off-by: Chingis Yundunov <[email protected]>

Signed-off-by: Ezequiel Lanza <[email protected]> Signed-off-by: Kendall González León <[email protected]> Signed-off-by: chensuyue <[email protected]> Signed-off-by: Spycsh <[email protected]> Signed-off-by: Wang, Xigui <[email protected]> Signed-off-by: ZePan110 <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: minmin-intel <[email protected]> Signed-off-by: Artem Astafev <[email protected]> Signed-off-by: Xinyao Wang <[email protected]> Signed-off-by: Cathy Zhang <[email protected]> Signed-off-by: letonghan <[email protected]> Signed-off-by: alexsin368 <[email protected]> Signed-off-by: WenjiaoYue <[email protected]> Co-authored-by: Ezequiel Lanza <[email protected]> Co-authored-by: Kendall González León <[email protected]> Co-authored-by: chen, suyue <[email protected]> Co-authored-by: Spycsh <[email protected]> Co-authored-by: xiguiw <[email protected]> Co-authored-by: jotpalch <[email protected]> Co-authored-by: ZePan110 <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: minmin-intel <[email protected]> Co-authored-by: Ying Hu <[email protected]> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Eero Tamminen <[email protected]> Co-authored-by: Liang Lv <[email protected]> Co-authored-by: Artem Astafev <[email protected]> Co-authored-by: XinyaoWa <[email protected]> Co-authored-by: alexsin368 <[email protected]> Co-authored-by: WenjiaoYue <[email protected]> Signed-off-by: Edwards, James A <[email protected]>

Signed-off-by: Ezequiel Lanza <[email protected]> Signed-off-by: Kendall González León <[email protected]> Signed-off-by: chensuyue <[email protected]> Signed-off-by: Spycsh <[email protected]> Signed-off-by: Wang, Xigui <[email protected]> Signed-off-by: ZePan110 <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: minmin-intel <[email protected]> Signed-off-by: Artem Astafev <[email protected]> Signed-off-by: Xinyao Wang <[email protected]> Signed-off-by: Cathy Zhang <[email protected]> Signed-off-by: letonghan <[email protected]> Signed-off-by: alexsin368 <[email protected]> Signed-off-by: WenjiaoYue <[email protected]> Co-authored-by: Ezequiel Lanza <[email protected]> Co-authored-by: Kendall González León <[email protected]> Co-authored-by: chen, suyue <[email protected]> Co-authored-by: Spycsh <[email protected]> Co-authored-by: xiguiw <[email protected]> Co-authored-by: jotpalch <[email protected]> Co-authored-by: ZePan110 <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: minmin-intel <[email protected]> Co-authored-by: Ying Hu <[email protected]> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Eero Tamminen <[email protected]> Co-authored-by: Liang Lv <[email protected]> Co-authored-by: Artem Astafev <[email protected]> Co-authored-by: XinyaoWa <[email protected]> Co-authored-by: alexsin368 <[email protected]> Co-authored-by: WenjiaoYue <[email protected]> Signed-off-by: Chingis Yundunov <[email protected]>

Signed-off-by: Ezequiel Lanza <[email protected]> Signed-off-by: Kendall González León <[email protected]> Signed-off-by: chensuyue <[email protected]> Signed-off-by: Spycsh <[email protected]> Signed-off-by: Wang, Xigui <[email protected]> Signed-off-by: ZePan110 <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: minmin-intel <[email protected]> Signed-off-by: Artem Astafev <[email protected]> Signed-off-by: Xinyao Wang <[email protected]> Signed-off-by: Cathy Zhang <[email protected]> Signed-off-by: letonghan <[email protected]> Signed-off-by: alexsin368 <[email protected]> Signed-off-by: WenjiaoYue <[email protected]> Co-authored-by: Ezequiel Lanza <[email protected]> Co-authored-by: Kendall González León <[email protected]> Co-authored-by: chen, suyue <[email protected]> Co-authored-by: Spycsh <[email protected]> Co-authored-by: xiguiw <[email protected]> Co-authored-by: jotpalch <[email protected]> Co-authored-by: ZePan110 <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: minmin-intel <[email protected]> Co-authored-by: Ying Hu <[email protected]> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Eero Tamminen <[email protected]> Co-authored-by: Liang Lv <[email protected]> Co-authored-by: Artem Astafev <[email protected]> Co-authored-by: XinyaoWa <[email protected]> Co-authored-by: alexsin368 <[email protected]> Co-authored-by: WenjiaoYue <[email protected]> Signed-off-by: cogniware-devops <[email protected]>

ezelanza requested review from letonghan and lvliang-intel as code owners February 13, 2025 16:58

ezelanza force-pushed the milvus_compose branch from 1499449 to 8911eb7 Compare February 13, 2025 16:59

letonghan reviewed Feb 14, 2025

View reviewed changes

ChatQnA/docker_compose/intel/cpu/xeon/compose_milvus.yaml Outdated Show resolved Hide resolved

ChatQnA/docker_compose/intel/cpu/xeon/compose_milvus.yaml Outdated Show resolved Hide resolved

yinghu5 requested review from chensuyue and ftian1 February 25, 2025 06:39

ezelanza force-pushed the milvus_compose branch 9 times, most recently from 1c69e98 to 28382b1 Compare February 28, 2025 05:34

Spycsh approved these changes Feb 28, 2025

View reviewed changes

Ezequiel Lanza and others added 10 commits February 28, 2025 22:12

Compose file to use Milvus as vdb

0c2cb4c

Signed-off-by: Ezequiel Lanza <[email protected]>

Make a fix in the main README.md of the ChatQnA. (opea-project#1551)

1f0a26e

Signed-off-by: Kendall González León <[email protected]> Signed-off-by: Ezequiel Lanza <[email protected]>

Expand CI test scope for common test scripts (opea-project#1554)

d3db280

Expand CI test scope, trigger all hw test when the common test scripts changed. Signed-off-by: chensuyue <[email protected]> Signed-off-by: Ezequiel Lanza <[email protected]>

Refactor AudioQnA README (opea-project#1508)

1c6e267

Signed-off-by: Spycsh <[email protected]> Signed-off-by: Ezequiel Lanza <[email protected]>

update vLLM CPU to the latest stable version (opea-project#1546)

43b0ad1

Signed-off-by: Wang, Xigui <[email protected]> Co-authored-by: chen, suyue <[email protected]> Signed-off-by: Ezequiel Lanza <[email protected]>

Fix minor typo in README (opea-project#1559)

fa9f5d9

Change Docker Compost<br/>Deployment on ROCm to Docker Compose<br/>Deployment on ROCm Signed-off-by: Ezequiel Lanza <[email protected]>

Remove perf test code from test scripts. (opea-project#1510)

79ef340

Signed-off-by: ZePan110 <[email protected]> Signed-off-by: Ezequiel Lanza <[email protected]>

Simplify ChatQnA AIPC user setting (opea-project#1573)

18f6342

Signed-off-by: Wang, Xigui <[email protected]> Signed-off-by: Ezequiel Lanza <[email protected]>

Fix mismatched environment variable (opea-project#1575)

f10e493

Signed-off-by: Wang, Xigui <[email protected]> Signed-off-by: Ezequiel Lanza <[email protected]>

pre-commit-ci bot and others added 10 commits February 28, 2025 22:12

[pre-commit.ci] auto fixes from pre-commit.com hooks

b7663cd

for more information, see https://pre-commit.ci Signed-off-by: Ezequiel Lanza <[email protected]>

Top level README: add link to github.io documentation (opea-project#1584

ea0cfcd

) Signed-off-by: alexsin368 <[email protected]> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Signed-off-by: Ezequiel Lanza <[email protected]>

Update test_compose_milvus_on_xeon.sh

ec679a9

Signed-off-by: Ezequiel Lanza <[email protected]>

fix click example button issue (opea-project#1586)

5755e0c

Signed-off-by: WenjiaoYue <[email protected]> Signed-off-by: Ezequiel Lanza <[email protected]>

Milvus compose

3d09215

Signed-off-by: Ezequiel Lanza <[email protected]>

Docker compose updated

80d9b32

Signed-off-by: Ezequiel Lanza <[email protected]>

Docker compose updated

6ebe408

Signed-off-by: Ezequiel Lanza <[email protected]>

Docker compose updated

5db12a5

Signed-off-by: Ezequiel Lanza <[email protected]>

[pre-commit.ci] auto fixes from pre-commit.com hooks

ceaa7bc

for more information, see https://pre-commit.ci Signed-off-by: Ezequiel Lanza <[email protected]>

ezelanza force-pushed the milvus_compose branch from 714373b to ceaa7bc Compare February 28, 2025 13:13

ezelanza requested review from WenjiaoYue, XinyaoWa, ZePan110, ashahba, hteeyeoh, jaswanth8888, lkk12014402, minmin-intel, myqi, rbrugaro and xuechendi as code owners February 28, 2025 13:13

Merge branch 'main' into milvus_compose

cf1c114

lvliang-intel approved these changes Feb 28, 2025

View reviewed changes

lvliang-intel merged commit fba0de4 into opea-project:main Feb 28, 2025
14 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

ChatQnA Docker compose file for Milvus as vdb#1548

ChatQnA Docker compose file for Milvus as vdb#1548
lvliang-intel merged 44 commits intoopea-project:mainfrom
ezelanza:milvus_compose

ezelanza commented Feb 13, 2025

Uh oh!

github-actions bot commented Feb 13, 2025 •

edited

Loading

Uh oh!

ezelanza commented Feb 13, 2025 •

edited

Loading

Uh oh!

Uh oh!

Uh oh!

letonghan commented Feb 14, 2025

Uh oh!

xiguiw commented Feb 25, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

16 participants

Conversation

ezelanza commented Feb 13, 2025

Description

Issues

Type of change

Dependencies

Tests

Uh oh!

github-actions bot commented Feb 13, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Dependency Review

Scanned Files

Uh oh!

ezelanza commented Feb 13, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

letonghan commented Feb 14, 2025

Uh oh!

xiguiw commented Feb 25, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

16 participants

github-actions bot commented Feb 13, 2025 •

edited

Loading

ezelanza commented Feb 13, 2025 •

edited

Loading