Skip to content

Fix Dockerfile error and add CI test for IPEX#1585

Merged
chensuyue merged 4 commits intoopea-project:mainfrom
lvliang-intel:add_test_for_ipex
Apr 17, 2025
Merged

Fix Dockerfile error and add CI test for IPEX#1585
chensuyue merged 4 commits intoopea-project:mainfrom
lvliang-intel:add_test_for_ipex

Conversation

@lvliang-intel
Copy link
Copy Markdown
Collaborator

Description

Fix Dockerfile error and add CI test for IPEX

Issues

n/a

Type of change

List the type of change like below. Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds new functionality)
  • Breaking change (fix or feature that would break existing design and interface)
  • Others (enhancement, documentation, validation, etc.)

Dependencies

None.

Tests

Local test and CI test.

++ dirname /home/lvl/GenAIComps/tests

  • WORKPATH=/home/lvl/GenAIComps
    ++ hostname -I
    ++ awk '{print $1}'
  • ip_address=10.7.4.57
  • export DATA_PATH=
  • DATA_PATH=
  • main
  • validate_microservice
  • echo 'Validate microservice started'
    Validate microservice started
    ++ http_proxy=
    ++ curl http://localhost:8688/v1/chat/completions -X POST -H 'Content-Type: application/json' -d '{
    "model": "microsoft/Phi-4-mini-instruct",
    "messages": [
    {"role": "user", "content": "What is Deep Learning?"}
    ],
    "max_tokens": 128
    }'
    % Total % Received % Xferd Average Speed Time Time Time Current
    Dload Upload Total Spent Left Speed
    100 879 100 721 100 158 17 3 0:00:52 0:00:40 0:00:12 158
  • result='["What is Deep Learning?** \n\nDeep learning is a subset of machine learning in artificial intelligence that has networks capable of learning unsupervised from data that is unstructured or unlabeled. Deep learning is also known as deep neural learning or deep neural network.\n\nTo put it simply, it is a neural network with three or more layers. These neural networks attempt to simulate the behavior of the human brain—albeit far from matching its ability—in order to "learn" from large amounts of data. While a neural network with a single layer can still make approximate predictions, additional hidden layers can help optimize the accuracy.\n\nWhy is Deep Learning Important?\n\nDeep learning frameworks"]'
  • [[ ["What is Deep Learning?** \n\nDeep learning is a subset of machine learning in artificial intelligence that has networks capable of learning unsupervised from data that is unstructured or unlabeled. Deep learning is also known as deep neural learning or deep neural network.\n\nTo put it simply, it is a neural network with three or more layers. These neural networks attempt to simulate the behavior of the human brain—albeit far from matching its ability—in order to "learn" from large amounts of data. While a neural network with a single layer can still make approximate predictions, additional hidden layers can help optimize the accuracy.\n\nWhy is Deep Learning Important?\n\nDeep learning frameworks"] == \D\e\e\p ]]
  • echo 'Result correct.'
    Result correct.
  • stop_docker
    ++ docker ps -aq --filter name=ipex-llm-server
  • cid=ac50824e2d82
  • echo 'Shutdown legacy containers ac50824e2d82'
    Shutdown legacy containers ac50824e2d82
  • [[ ! -z ac50824e2d82 ]]
  • docker stop ac50824e2d82
    ac50824e2d82
  • docker rm ac50824e2d82
    ac50824e2d82
  • sleep 1s
  • echo 'cleanup container images and volumes'
    cleanup container images and volumes
  • echo y
  • docker system prune

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
pre-commit-ci bot and others added 3 commits April 17, 2025 03:18
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
…GenAIComps into add_test_for_ipex

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
@lvliang-intel lvliang-intel requested a review from ZePan110 as a code owner April 17, 2025 03:36
@chensuyue chensuyue merged commit f19609b into opea-project:main Apr 17, 2025
12 checks passed
aMahanna pushed a commit to arangoml/GenAIComps1.3 that referenced this pull request Apr 18, 2025
* Fix Dockerfile error and add CI teat

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>
rbrugaro added a commit that referenced this pull request Apr 18, 2025
* Fix image build issue (#1553)

Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Unified default port number for the same service in text2graph and text2sql (#1554)

Signed-off-by: Yao, Qing <qing.yao@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* new: `OpeaArangoDataprep` (#2)

* new: `third_parties/arangodb`

* new: `OpeaArangoDataprep`

* cleanup

* fix: `vllm` instead of `tgi`

* fix: dataprep compsoe

* cleanup

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* new: `OpeaArangoRetriever` (#3)

* new: `OpeaArangoRetriever`

* cleanup

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* new: deps

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix typo: `test_retrievers_arango.sh`

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* updated retriever-arango compose file

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* correction

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* add json-repair to dataprep-arango requirements

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Fix network error, change WORKPATH

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* extra time for health check retriever

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* extended retriever healthcheck 90secs

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* correction

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Update arangodb.py

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Removing hugging face token requirement from test file

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Update test_dataprep_arango with network tests and additional logs

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Running CI after docker rate limit

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Base case remove HF_token, no additional tests

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Adding VLLM check and logs, currently VLLM not working in CI/CD

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* cleanup: compose.yaml

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* update: arangodb healthcheck

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* cleanup

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* cleanup: retriever test

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: typo

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* rem: unused vars

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: indent

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* temp: swap vllm healthcheck with sleep

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: typo

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: component name typo

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: support `EmbedDoc` for retriever

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: `getattr`

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: CURL command

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* revert 6061484

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Update xtune file and change DDP paramter (#1552)

Signed-off-by: jilongwa <jilong.wang@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* add N/A option (#1561)

Signed-off-by: ZhangJianyu <zhang.jianyu@outlook.com>
Co-authored-by: ZhangJianyu <zhang.jianyu@outlook.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Test latest gaudi docker container (#1477)

Update base gaudi container into the latest version, docker pull vault.habana.ai/gaudi-docker/1.20.1/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest, https://docs.habana.ai/en/latest/Installation_Guide/Additional_Installation/Docker_Installation.html#use-intel-gaudi-containers

Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix audioqna male voice setting (#1559)

Co-authored-by: Letong Han <106566639+letonghan@users.noreply.github.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* added error handling for lvm (#1556)

Signed-off-by: okhleif-IL <omar.khleif@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* enable mysql db for sql agent (#1431)

Signed-off-by: cheehook <chee.hoo.kok@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Enlarge DocSum prompt buffer (#1567)

* Enlarge DocSum prompt buffer
Follow PR #1471

Signed-off-by: XinyaoWa <xinyao.wang@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Update vLLM parameter max-seq-len-to-capture (#1565)

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: lint

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: missing import

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* new: healtcheck for dataprep-arangodb

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* update: arangodb readmes

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* cleanup: test_dataprep_arango.sh

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* cleanup: test_dataprep_arango.sh (PT2)

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* cleanup: test_dataprep_arango.sh (PT3)

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* update: test_dataprep_arango.sh

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: whitespace

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Remove Transformers versions from requirements.txt file (#1547)

* Remove Transformers versions from requirements.txt file

Signed-off-by: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Remove index_names from files for dataprep-get request  (#1569)

* remove index_names from files fot get request

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* update the tests

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* update the tests

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* update the tests

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add validation check for 'all' as an index_name

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* fix for readme file

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Mustafa <mustafa.cetin@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Upgrade Optimum Habana version to fix security check issue (#1571)

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Make llamaguard compatible with both TGI and vLLM (#1581)

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Fix Dockerfile error and add CI test for IPEX (#1585)

* Fix Dockerfile error and add CI teat

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Reduce multilang tts docker image size (#1587)

* fix audioqna male voice setting

* reduce multilang tts docker image size

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* unset OPENAI_KEY in CI test (#1586)

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Add AWS Credentials for CD test (#1588)

* Fix CD test issue

Signed-off-by: ZePan110 <ze.pan@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* update: shorten ingest_dataprep.txt

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* revert: a4d943e

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* new: `DataprepRequest` model (#1525)

* new: `DataprepRequest`

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix: docstrings

* rem: `ingest_from_graphDB`

* new: dep injection

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix: verbose `input` processing

* attempt: replace `kwargs` with params

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* rem: `db_type`

ref: #1525 (comment)

* attempt: require `base`

* Revert "attempt: require `base`"

This reverts commit 620ca6b.

* new: `DataprepRequest`

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix: docstrings

* rem: `ingest_from_graphDB`

* new: dep injection

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix: verbose `input` processing

* attempt: replace `kwargs` with params

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* rem: `db_type`

ref: #1525 (comment)

* attempt: require `base`

* Revert "attempt: require `base`"

This reverts commit 620ca6b.

* Fix dataprep request class issue of Redis (#1)

* new: `DataprepRequest`

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix: docstrings

* rem: `ingest_from_graphDB`

* new: dep injection

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix: verbose `input` processing

* attempt: replace `kwargs` with params

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* rem: `db_type`

ref: #1525 (comment)

* attempt: require `base`

* Revert "attempt: require `base`"

This reverts commit 620ca6b.

* fix dataprep request class of redis

Signed-off-by: letonghan <letong.han@intel.com>

* revert change in redis.py

Signed-off-by: letonghan <letong.han@intel.com>

---------

Signed-off-by: letonghan <letong.han@intel.com>
Co-authored-by: Anthony Mahanna <anthony.mahanna@arangodb.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Anthony Mahanna <43019056+aMahanna@users.noreply.github.com>
Co-authored-by: Liang Lv <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* revert: `DataprepRequest` for multimodal

* revert: `DataprepRequest` for multimodal (PT2)

* fix: conditionally fetch unique `DataprepRequest` attributes

* fix bugs in dataprep util script

Signed-off-by: letonghan <letong.han@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* revert change of pgvector

Signed-off-by: letonghan <letong.han@intel.com>

* fix indices bug for redis

Signed-off-by: letonghan <letong.han@intel.com>

* minor fix for redis

Signed-off-by: letonghan <letong.han@intel.com>

* ingest file into rag_redis_test

Signed-off-by: letonghan <letong.han@intel.com>

* update indice name

Signed-off-by: letonghan <letong.han@intel.com>

---------

Signed-off-by: letonghan <letong.han@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Liang Lv <liang1.lv@intel.com>
Co-authored-by: Letong Han <106566639+letonghan@users.noreply.github.com>
Co-authored-by: letonghan <letong.han@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* revert: bc4445c

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* revert: d17f6aa

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Revert "new: `DataprepRequest` model (#1525)" (#1592)

This reverts commit 88947ab.

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* add hyperlinks

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* revert: 4eb9ec4f

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* new: ArangoDBDataprepRequest

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: lint

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* cleanup: delete_files

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* remove: env mutation

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: move openai key env var to top of file

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

---------

Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>
Signed-off-by: Yao, Qing <qing.yao@intel.com>
Signed-off-by: jilongwa <jilong.wang@intel.com>
Signed-off-by: ZhangJianyu <zhang.jianyu@outlook.com>
Signed-off-by: okhleif-IL <omar.khleif@intel.com>
Signed-off-by: cheehook <chee.hoo.kok@intel.com>
Signed-off-by: XinyaoWa <xinyao.wang@intel.com>
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com>
Signed-off-by: Mustafa <mustafa.cetin@intel.com>
Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>
Signed-off-by: ZePan110 <ze.pan@intel.com>
Signed-off-by: letonghan <letong.han@intel.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
Co-authored-by: Yao Qing <Qing.Yao@intel.com>
Co-authored-by: lasyasn <lasyan640@gmail.com>
Co-authored-by: Ajay Kallepalli <ajay.r.kallepalli@gmail.com>
Co-authored-by: jilongW <109333127+jilongW@users.noreply.github.com>
Co-authored-by: Neo Zhang Jianyu <jianyu.zhang@intel.com>
Co-authored-by: ZhangJianyu <zhang.jianyu@outlook.com>
Co-authored-by: Spycsh <39623753+Spycsh@users.noreply.github.com>
Co-authored-by: Letong Han <106566639+letonghan@users.noreply.github.com>
Co-authored-by: Omar Khleif <omar.khleif@intel.com>
Co-authored-by: cheehook <chee.hoo.kok@intel.com>
Co-authored-by: XinyaoWa <xinyao.wang@intel.com>
Co-authored-by: Liang Lv <liang1.lv@intel.com>
Co-authored-by: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com>
Co-authored-by: Mustafa <109312699+MSCetin37@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: rbrugaro <rita.brugarolas.brufau@intel.com>
Co-authored-by: ZePan110 <ze.pan@intel.com>
Co-authored-by: letonghan <letong.han@intel.com>
chyundunovDatamonsters pushed a commit to chyundunovDatamonsters/GenAIComps that referenced this pull request Apr 29, 2025
* Fix Dockerfile error and add CI teat

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: Chingis Yundunov <c.yundunov@datamonsters.com>
chyundunovDatamonsters pushed a commit to chyundunovDatamonsters/GenAIComps that referenced this pull request Apr 29, 2025
)

* Fix image build issue (opea-project#1553)

Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Unified default port number for the same service in text2graph and text2sql (opea-project#1554)

Signed-off-by: Yao, Qing <qing.yao@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* new: `OpeaArangoDataprep` (opea-project#2)

* new: `third_parties/arangodb`

* new: `OpeaArangoDataprep`

* cleanup

* fix: `vllm` instead of `tgi`

* fix: dataprep compsoe

* cleanup

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* new: `OpeaArangoRetriever` (opea-project#3)

* new: `OpeaArangoRetriever`

* cleanup

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* new: deps

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix typo: `test_retrievers_arango.sh`

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* updated retriever-arango compose file

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* correction

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* add json-repair to dataprep-arango requirements

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Fix network error, change WORKPATH

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* extra time for health check retriever

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* extended retriever healthcheck 90secs

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* correction

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Update arangodb.py

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Removing hugging face token requirement from test file

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Update test_dataprep_arango with network tests and additional logs

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Running CI after docker rate limit

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Base case remove HF_token, no additional tests

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Adding VLLM check and logs, currently VLLM not working in CI/CD

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* cleanup: compose.yaml

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* update: arangodb healthcheck

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* cleanup

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* cleanup: retriever test

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: typo

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* rem: unused vars

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: indent

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* temp: swap vllm healthcheck with sleep

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: typo

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: component name typo

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: support `EmbedDoc` for retriever

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: `getattr`

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: CURL command

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* revert 6061484

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Update xtune file and change DDP paramter (opea-project#1552)

Signed-off-by: jilongwa <jilong.wang@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* add N/A option (opea-project#1561)

Signed-off-by: ZhangJianyu <zhang.jianyu@outlook.com>
Co-authored-by: ZhangJianyu <zhang.jianyu@outlook.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Test latest gaudi docker container (opea-project#1477)

Update base gaudi container into the latest version, docker pull vault.habana.ai/gaudi-docker/1.20.1/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest, https://docs.habana.ai/en/latest/Installation_Guide/Additional_Installation/Docker_Installation.html#use-intel-gaudi-containers

Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix audioqna male voice setting (opea-project#1559)

Co-authored-by: Letong Han <106566639+letonghan@users.noreply.github.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* added error handling for lvm (opea-project#1556)

Signed-off-by: okhleif-IL <omar.khleif@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* enable mysql db for sql agent (opea-project#1431)

Signed-off-by: cheehook <chee.hoo.kok@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Enlarge DocSum prompt buffer (opea-project#1567)

* Enlarge DocSum prompt buffer
Follow PR opea-project#1471

Signed-off-by: XinyaoWa <xinyao.wang@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Update vLLM parameter max-seq-len-to-capture (opea-project#1565)

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: lint

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: missing import

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* new: healtcheck for dataprep-arangodb

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* update: arangodb readmes

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* cleanup: test_dataprep_arango.sh

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* cleanup: test_dataprep_arango.sh (PT2)

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* cleanup: test_dataprep_arango.sh (PT3)

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* update: test_dataprep_arango.sh

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: whitespace

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Remove Transformers versions from requirements.txt file (opea-project#1547)

* Remove Transformers versions from requirements.txt file

Signed-off-by: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Remove index_names from files for dataprep-get request  (opea-project#1569)

* remove index_names from files fot get request

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* update the tests

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* update the tests

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* update the tests

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add validation check for 'all' as an index_name

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* fix for readme file

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Mustafa <mustafa.cetin@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Upgrade Optimum Habana version to fix security check issue (opea-project#1571)

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Make llamaguard compatible with both TGI and vLLM (opea-project#1581)

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Fix Dockerfile error and add CI test for IPEX (opea-project#1585)

* Fix Dockerfile error and add CI teat

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Reduce multilang tts docker image size (opea-project#1587)

* fix audioqna male voice setting

* reduce multilang tts docker image size

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* unset OPENAI_KEY in CI test (opea-project#1586)

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Add AWS Credentials for CD test (opea-project#1588)

* Fix CD test issue

Signed-off-by: ZePan110 <ze.pan@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* update: shorten ingest_dataprep.txt

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* revert: a4d943e

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* new: `DataprepRequest` model (opea-project#1525)

* new: `DataprepRequest`

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix: docstrings

* rem: `ingest_from_graphDB`

* new: dep injection

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix: verbose `input` processing

* attempt: replace `kwargs` with params

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* rem: `db_type`

ref: opea-project#1525 (comment)

* attempt: require `base`

* Revert "attempt: require `base`"

This reverts commit 620ca6b.

* new: `DataprepRequest`

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix: docstrings

* rem: `ingest_from_graphDB`

* new: dep injection

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix: verbose `input` processing

* attempt: replace `kwargs` with params

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* rem: `db_type`

ref: opea-project#1525 (comment)

* attempt: require `base`

* Revert "attempt: require `base`"

This reverts commit 620ca6b.

* Fix dataprep request class issue of Redis (opea-project#1)

* new: `DataprepRequest`

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix: docstrings

* rem: `ingest_from_graphDB`

* new: dep injection

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix: verbose `input` processing

* attempt: replace `kwargs` with params

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* rem: `db_type`

ref: opea-project#1525 (comment)

* attempt: require `base`

* Revert "attempt: require `base`"

This reverts commit 620ca6b.

* fix dataprep request class of redis

Signed-off-by: letonghan <letong.han@intel.com>

* revert change in redis.py

Signed-off-by: letonghan <letong.han@intel.com>

---------

Signed-off-by: letonghan <letong.han@intel.com>
Co-authored-by: Anthony Mahanna <anthony.mahanna@arangodb.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Anthony Mahanna <43019056+aMahanna@users.noreply.github.com>
Co-authored-by: Liang Lv <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* revert: `DataprepRequest` for multimodal

* revert: `DataprepRequest` for multimodal (PT2)

* fix: conditionally fetch unique `DataprepRequest` attributes

* fix bugs in dataprep util script

Signed-off-by: letonghan <letong.han@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* revert change of pgvector

Signed-off-by: letonghan <letong.han@intel.com>

* fix indices bug for redis

Signed-off-by: letonghan <letong.han@intel.com>

* minor fix for redis

Signed-off-by: letonghan <letong.han@intel.com>

* ingest file into rag_redis_test

Signed-off-by: letonghan <letong.han@intel.com>

* update indice name

Signed-off-by: letonghan <letong.han@intel.com>

---------

Signed-off-by: letonghan <letong.han@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Liang Lv <liang1.lv@intel.com>
Co-authored-by: Letong Han <106566639+letonghan@users.noreply.github.com>
Co-authored-by: letonghan <letong.han@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* revert: bc4445c

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* revert: d17f6aa

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Revert "new: `DataprepRequest` model (opea-project#1525)" (opea-project#1592)

This reverts commit 88947ab.

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* add hyperlinks

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* revert: 4eb9ec4f

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* new: ArangoDBDataprepRequest

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: lint

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* cleanup: delete_files

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* remove: env mutation

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: move openai key env var to top of file

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

---------

Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>
Signed-off-by: Yao, Qing <qing.yao@intel.com>
Signed-off-by: jilongwa <jilong.wang@intel.com>
Signed-off-by: ZhangJianyu <zhang.jianyu@outlook.com>
Signed-off-by: okhleif-IL <omar.khleif@intel.com>
Signed-off-by: cheehook <chee.hoo.kok@intel.com>
Signed-off-by: XinyaoWa <xinyao.wang@intel.com>
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com>
Signed-off-by: Mustafa <mustafa.cetin@intel.com>
Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>
Signed-off-by: ZePan110 <ze.pan@intel.com>
Signed-off-by: letonghan <letong.han@intel.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
Co-authored-by: Yao Qing <Qing.Yao@intel.com>
Co-authored-by: lasyasn <lasyan640@gmail.com>
Co-authored-by: Ajay Kallepalli <ajay.r.kallepalli@gmail.com>
Co-authored-by: jilongW <109333127+jilongW@users.noreply.github.com>
Co-authored-by: Neo Zhang Jianyu <jianyu.zhang@intel.com>
Co-authored-by: ZhangJianyu <zhang.jianyu@outlook.com>
Co-authored-by: Spycsh <39623753+Spycsh@users.noreply.github.com>
Co-authored-by: Letong Han <106566639+letonghan@users.noreply.github.com>
Co-authored-by: Omar Khleif <omar.khleif@intel.com>
Co-authored-by: cheehook <chee.hoo.kok@intel.com>
Co-authored-by: XinyaoWa <xinyao.wang@intel.com>
Co-authored-by: Liang Lv <liang1.lv@intel.com>
Co-authored-by: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com>
Co-authored-by: Mustafa <109312699+MSCetin37@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: rbrugaro <rita.brugarolas.brufau@intel.com>
Co-authored-by: ZePan110 <ze.pan@intel.com>
Co-authored-by: letonghan <letong.han@intel.com>
Signed-off-by: Chingis Yundunov <c.yundunov@datamonsters.com>
madison-evans pushed a commit to SAPD-Intel/GenAIComps that referenced this pull request May 12, 2025
* Fix Dockerfile error and add CI teat

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
madison-evans pushed a commit to SAPD-Intel/GenAIComps that referenced this pull request May 12, 2025
)

* Fix image build issue (opea-project#1553)

Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Unified default port number for the same service in text2graph and text2sql (opea-project#1554)

Signed-off-by: Yao, Qing <qing.yao@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* new: `OpeaArangoDataprep` (opea-project#2)

* new: `third_parties/arangodb`

* new: `OpeaArangoDataprep`

* cleanup

* fix: `vllm` instead of `tgi`

* fix: dataprep compsoe

* cleanup

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* new: `OpeaArangoRetriever` (opea-project#3)

* new: `OpeaArangoRetriever`

* cleanup

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* new: deps

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix typo: `test_retrievers_arango.sh`

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* updated retriever-arango compose file

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* correction

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* add json-repair to dataprep-arango requirements

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Fix network error, change WORKPATH

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* extra time for health check retriever

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* extended retriever healthcheck 90secs

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* correction

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Update arangodb.py

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Removing hugging face token requirement from test file

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Update test_dataprep_arango with network tests and additional logs

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Running CI after docker rate limit

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Base case remove HF_token, no additional tests

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Adding VLLM check and logs, currently VLLM not working in CI/CD

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* cleanup: compose.yaml

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* update: arangodb healthcheck

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* cleanup

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* cleanup: retriever test

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: typo

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* rem: unused vars

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: indent

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* temp: swap vllm healthcheck with sleep

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: typo

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: component name typo

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: support `EmbedDoc` for retriever

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: `getattr`

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: CURL command

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* revert 6061484

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Update xtune file and change DDP paramter (opea-project#1552)

Signed-off-by: jilongwa <jilong.wang@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* add N/A option (opea-project#1561)

Signed-off-by: ZhangJianyu <zhang.jianyu@outlook.com>
Co-authored-by: ZhangJianyu <zhang.jianyu@outlook.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Test latest gaudi docker container (opea-project#1477)

Update base gaudi container into the latest version, docker pull vault.habana.ai/gaudi-docker/1.20.1/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest, https://docs.habana.ai/en/latest/Installation_Guide/Additional_Installation/Docker_Installation.html#use-intel-gaudi-containers

Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix audioqna male voice setting (opea-project#1559)

Co-authored-by: Letong Han <106566639+letonghan@users.noreply.github.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* added error handling for lvm (opea-project#1556)

Signed-off-by: okhleif-IL <omar.khleif@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* enable mysql db for sql agent (opea-project#1431)

Signed-off-by: cheehook <chee.hoo.kok@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Enlarge DocSum prompt buffer (opea-project#1567)

* Enlarge DocSum prompt buffer
Follow PR opea-project#1471

Signed-off-by: XinyaoWa <xinyao.wang@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Update vLLM parameter max-seq-len-to-capture (opea-project#1565)

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: lint

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: missing import

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* new: healtcheck for dataprep-arangodb

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* update: arangodb readmes

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* cleanup: test_dataprep_arango.sh

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* cleanup: test_dataprep_arango.sh (PT2)

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* cleanup: test_dataprep_arango.sh (PT3)

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* update: test_dataprep_arango.sh

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: whitespace

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Remove Transformers versions from requirements.txt file (opea-project#1547)

* Remove Transformers versions from requirements.txt file

Signed-off-by: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Remove index_names from files for dataprep-get request  (opea-project#1569)

* remove index_names from files fot get request

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* update the tests

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* update the tests

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* update the tests

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add validation check for 'all' as an index_name

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* fix for readme file

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Mustafa <mustafa.cetin@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Upgrade Optimum Habana version to fix security check issue (opea-project#1571)

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Make llamaguard compatible with both TGI and vLLM (opea-project#1581)

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Fix Dockerfile error and add CI test for IPEX (opea-project#1585)

* Fix Dockerfile error and add CI teat

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Reduce multilang tts docker image size (opea-project#1587)

* fix audioqna male voice setting

* reduce multilang tts docker image size

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* unset OPENAI_KEY in CI test (opea-project#1586)

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Add AWS Credentials for CD test (opea-project#1588)

* Fix CD test issue

Signed-off-by: ZePan110 <ze.pan@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* update: shorten ingest_dataprep.txt

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* revert: a4d943e

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* new: `DataprepRequest` model (opea-project#1525)

* new: `DataprepRequest`

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix: docstrings

* rem: `ingest_from_graphDB`

* new: dep injection

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix: verbose `input` processing

* attempt: replace `kwargs` with params

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* rem: `db_type`

ref: opea-project#1525 (comment)

* attempt: require `base`

* Revert "attempt: require `base`"

This reverts commit 620ca6b.

* new: `DataprepRequest`

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix: docstrings

* rem: `ingest_from_graphDB`

* new: dep injection

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix: verbose `input` processing

* attempt: replace `kwargs` with params

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* rem: `db_type`

ref: opea-project#1525 (comment)

* attempt: require `base`

* Revert "attempt: require `base`"

This reverts commit 620ca6b.

* Fix dataprep request class issue of Redis (opea-project#1)

* new: `DataprepRequest`

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix: docstrings

* rem: `ingest_from_graphDB`

* new: dep injection

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix: verbose `input` processing

* attempt: replace `kwargs` with params

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* rem: `db_type`

ref: opea-project#1525 (comment)

* attempt: require `base`

* Revert "attempt: require `base`"

This reverts commit 620ca6b.

* fix dataprep request class of redis

Signed-off-by: letonghan <letong.han@intel.com>

* revert change in redis.py

Signed-off-by: letonghan <letong.han@intel.com>

---------

Signed-off-by: letonghan <letong.han@intel.com>
Co-authored-by: Anthony Mahanna <anthony.mahanna@arangodb.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Anthony Mahanna <43019056+aMahanna@users.noreply.github.com>
Co-authored-by: Liang Lv <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* revert: `DataprepRequest` for multimodal

* revert: `DataprepRequest` for multimodal (PT2)

* fix: conditionally fetch unique `DataprepRequest` attributes

* fix bugs in dataprep util script

Signed-off-by: letonghan <letong.han@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* revert change of pgvector

Signed-off-by: letonghan <letong.han@intel.com>

* fix indices bug for redis

Signed-off-by: letonghan <letong.han@intel.com>

* minor fix for redis

Signed-off-by: letonghan <letong.han@intel.com>

* ingest file into rag_redis_test

Signed-off-by: letonghan <letong.han@intel.com>

* update indice name

Signed-off-by: letonghan <letong.han@intel.com>

---------

Signed-off-by: letonghan <letong.han@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Liang Lv <liang1.lv@intel.com>
Co-authored-by: Letong Han <106566639+letonghan@users.noreply.github.com>
Co-authored-by: letonghan <letong.han@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* revert: bc4445c

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* revert: d17f6aa

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* Revert "new: `DataprepRequest` model (opea-project#1525)" (opea-project#1592)

This reverts commit 2cc9559.

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* add hyperlinks

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* revert: 4eb9ec4f

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* new: ArangoDBDataprepRequest

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: lint

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* cleanup: delete_files

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* remove: env mutation

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

* fix: move openai key env var to top of file

Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>

---------

Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>
Signed-off-by: Yao, Qing <qing.yao@intel.com>
Signed-off-by: jilongwa <jilong.wang@intel.com>
Signed-off-by: ZhangJianyu <zhang.jianyu@outlook.com>
Signed-off-by: okhleif-IL <omar.khleif@intel.com>
Signed-off-by: cheehook <chee.hoo.kok@intel.com>
Signed-off-by: XinyaoWa <xinyao.wang@intel.com>
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com>
Signed-off-by: Mustafa <mustafa.cetin@intel.com>
Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>
Signed-off-by: ZePan110 <ze.pan@intel.com>
Signed-off-by: letonghan <letong.han@intel.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
Co-authored-by: Yao Qing <Qing.Yao@intel.com>
Co-authored-by: lasyasn <lasyan640@gmail.com>
Co-authored-by: Ajay Kallepalli <ajay.r.kallepalli@gmail.com>
Co-authored-by: jilongW <109333127+jilongW@users.noreply.github.com>
Co-authored-by: Neo Zhang Jianyu <jianyu.zhang@intel.com>
Co-authored-by: ZhangJianyu <zhang.jianyu@outlook.com>
Co-authored-by: Spycsh <39623753+Spycsh@users.noreply.github.com>
Co-authored-by: Letong Han <106566639+letonghan@users.noreply.github.com>
Co-authored-by: Omar Khleif <omar.khleif@intel.com>
Co-authored-by: cheehook <chee.hoo.kok@intel.com>
Co-authored-by: XinyaoWa <xinyao.wang@intel.com>
Co-authored-by: Liang Lv <liang1.lv@intel.com>
Co-authored-by: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com>
Co-authored-by: Mustafa <109312699+MSCetin37@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: rbrugaro <rita.brugarolas.brufau@intel.com>
Co-authored-by: ZePan110 <ze.pan@intel.com>
Co-authored-by: letonghan <letong.han@intel.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants