Fix huggingface_hub API upgrade issue by lvliang-intel · Pull Request #1691 · opea-project/GenAIComps

lvliang-intel · 2025-05-13T01:53:59Z

Description

Fix huggingface_hub API upgrade issue.

InferenceClient.post is deprecated and not supported in the latest version. InferenceClient provides a new embedding interface 'feature_extraction', but Sentence Ranking tasks are not implemented. So we replaced the new embedding interface 'feature_extraction' and downgrade huggingface_hub version in reranking microservice.

huggingface/huggingface_hub#3055

Issues

1933

File "/home/comps/cores/telemetry/opea_telemetry.py", line 61, in wrapper
res = await func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/comps/embeddings/src/opea_embedding_microservice.py", line 53, in embedding
embedding_response = await loader.invoke(input)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/comps/cores/common/component.py", line 163, in invoke
return await self.component.invoke(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/comps/embeddings/src/integrations/tei.py", line 71, in invoke
response = await self.client.post(
^^^^^^^^^^^^^^^^
AttributeError: 'AsyncInferenceClient' object has no attribute 'post'

Type of change

List the type of change like below. Please delete options that are not relevant.

Bug fix (non-breaking change which fixes an issue)
New feature (non-breaking change which adds new functionality)
Breaking change (fix or feature that would break existing design and interface)
Others (enhancement, documentation, validation, etc.)

Dependencies

huggingface_hub

Tests

Local test and CI test.

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

for more information, see https://pre-commit.ci

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

…com/lvliang-intel/GenAIComps into fix_hugingfacehub_api_upgrade_issue Signed-off-by: lvliang-intel <liang1.lv@intel.com>

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

comps/embeddings/src/integrations/tei.py

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

codecov · 2025-05-13T03:35:31Z

Codecov Report

All modified and coverable lines are covered by tests ✅

Files with missing lines	Coverage Δ
comps/cores/mega/orchestrator.py	`90.43% <ø> (ø)`

... and 2 files with indirect coverage changes

🚀 New features to boost your workflow:

❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

for more information, see https://pre-commit.ci

* Fix huggingfacehub API upgrade issue Signed-off-by: lvliang-intel <liang1.lv@intel.com> Signed-off-by: alexsin368 <alex.sin@intel.com>

* add support for remote server Signed-off-by: alexsin368 <alex.sin@intel.com> * add steps to enable remote server Signed-off-by: alexsin368 <alex.sin@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * remove use_remote_service Signed-off-by: alexsin368 <alex.sin@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * add OpenAI models instructions, fix format of commands Signed-off-by: alexsin368 <alex.sin@intel.com> * simplify ChatOpenAI instantiation Signed-off-by: alexsin368 <alex.sin@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Revert "simplify ChatOpenAI instantiation" This reverts commit b7c4acf. * add back check and logic for llm_engine, set openai_key argument Signed-off-by: alexsin368 <alex.sin@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Provide ARCH option for lvm-video-llama image build (#1630) Signed-off-by: ZePan110 <ze.pan@intel.com> Signed-off-by: alexsin368 <alex.sin@intel.com> * Add sglang microservice for supporting llama4 model (#1640) Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com> Co-authored-by: Lv,Liang1 <liang1.lv@intel.com> Signed-off-by: alexsin368 <alex.sin@intel.com> * Remove invalid codeowner. (#1642) Signed-off-by: ZePan110 <ze.pan@intel.com> Signed-off-by: alexsin368 <alex.sin@intel.com> * add support for remote server Signed-off-by: alexsin368 <alex.sin@intel.com> * add steps to enable remote server Signed-off-by: alexsin368 <alex.sin@intel.com> * remove use_remote_service Signed-off-by: alexsin368 <alex.sin@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci Signed-off-by: alexsin368 <alex.sin@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci Signed-off-by: alexsin368 <alex.sin@intel.com> * bug fix for chunk_size and overlap cause error in dataprep ingestion (#1643) * bug fix for dataingest url Signed-off-by: Mustafa <mustafa.cetin@intel.com> * add validation function Signed-off-by: Mustafa <mustafa.cetin@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * validation update Signed-off-by: Mustafa <mustafa.cetin@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * update validation function Signed-off-by: Mustafa <mustafa.cetin@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Signed-off-by: Mustafa <mustafa.cetin@intel.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Signed-off-by: alexsin368 <alex.sin@intel.com> * MariaDB Vector integrations for retriever & dataprep services (#1645) * Add MariaDB Vector third-party service MariaDB Vector was introduced since MariaDB Server 11.7 Signed-off-by: Razvan-Liviu Varzaru <razvan@mariadb.org> * Add retriever MariaDB Vector integration Signed-off-by: Razvan-Liviu Varzaru <razvan@mariadb.org> * Add dataprep MariaDB Vector integration Signed-off-by: Razvan-Liviu Varzaru <razvan@mariadb.org> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Fix CI failures - md5 is used for the primary key not as a security hash - fixed mariadb readme headers Signed-off-by: Razvan-Liviu Varzaru <razvan@mariadb.org> --------- Signed-off-by: Razvan-Liviu Varzaru <razvan@mariadb.org> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Signed-off-by: alexsin368 <alex.sin@intel.com> * update PR reviewers (#1651) Signed-off-by: chensuyue <suyue.chen@intel.com> Signed-off-by: alexsin368 <alex.sin@intel.com> * Expand test matrix, find all tests use 3rd party Dockerfiles (#1676) * Expand test matrix, find all tests use 3rd party Dockerfiles Signed-off-by: chensuyue <suyue.chen@intel.com> Signed-off-by: alexsin368 <alex.sin@intel.com> * fix the typo of README.md Comp (#1679) Update README.md for first entry of OPEA Signed-off-by: alexsin368 <alex.sin@intel.com> * Fix request handle timeout issue (#1687) Signed-off-by: lvliang-intel <liang1.lv@intel.com> Signed-off-by: alexsin368 <alex.sin@intel.com> * FEAT: Enable OPEA microservices to start as MCP servers (#1635) Signed-off-by: alexsin368 <alex.sin@intel.com> * Fix huggingface_hub API upgrade issue (#1691) * Fix huggingfacehub API upgrade issue Signed-off-by: lvliang-intel <liang1.lv@intel.com> Signed-off-by: alexsin368 <alex.sin@intel.com> * add OpenAI models instructions, fix format of commands Signed-off-by: alexsin368 <alex.sin@intel.com> * Fix dataprep opensearch ingest issue (#1697) Signed-off-by: lvliang-intel <liang1.lv@intel.com> Signed-off-by: alexsin368 <alex.sin@intel.com> * Fix embedding issue with ArangoDB due to deprecated HuggingFace API (#1694) Signed-off-by: lvliang-intel <liang1.lv@intel.com> Signed-off-by: alexsin368 <alex.sin@intel.com> * simplify ChatOpenAI instantiation Signed-off-by: alexsin368 <alex.sin@intel.com> * Revert "simplify ChatOpenAI instantiation" This reverts commit b7c4acf. Signed-off-by: alexsin368 <alex.sin@intel.com> * add back check and logic for llm_engine, set openai_key argument Signed-off-by: alexsin368 <alex.sin@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Signed-off-by: alexsin368 <alex.sin@intel.com> Signed-off-by: ZePan110 <ze.pan@intel.com> Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com> Signed-off-by: Mustafa <mustafa.cetin@intel.com> Signed-off-by: Razvan-Liviu Varzaru <razvan@mariadb.org> Signed-off-by: chensuyue <suyue.chen@intel.com> Signed-off-by: lvliang-intel <liang1.lv@intel.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Ying Hu <ying.hu@intel.com> Co-authored-by: ZePan110 <ze.pan@intel.com> Co-authored-by: Liang Lv <liang1.lv@intel.com> Co-authored-by: Mustafa <109312699+MSCetin37@users.noreply.github.com> Co-authored-by: Razvan Liviu Varzaru <45736827+RazvanLiviuVarzaru@users.noreply.github.com> Co-authored-by: chen, suyue <suyue.chen@intel.com> Co-authored-by: Spycsh <39623753+Spycsh@users.noreply.github.com>

Fix huggingfacehub API upgrade issue

55f4e07

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

lvliang-intel requested review from Spycsh, ftian1, letonghan, lkk12014402 and minmin-intel as code owners May 13, 2025 01:54

[pre-commit.ci] auto fixes from pre-commit.com hooks

bb623d9

for more information, see https://pre-commit.ci

This was referenced May 13, 2025

[Bug] CodeGen UT test fail on the xeon opea-project/GenAIExamples#1933

Closed

[Bug]DocIndexRetriever UT test fail opea-project/GenAIExamples#1934

Closed

[Bug] SearchQnA UT test fail opea-project/GenAIExamples#1935

Closed

letonghan approved these changes May 13, 2025

View reviewed changes

lvliang-intel added 3 commits May 13, 2025 10:47

update endpoint url

d8e2fc0

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

Merge branch 'fix_hugingfacehub_api_upgrade_issue' of https://github.…

c5b0e09

…com/lvliang-intel/GenAIComps into fix_hugingfacehub_api_upgrade_issue Signed-off-by: lvliang-intel <liang1.lv@intel.com>

update model id for new api requirement

99c9a24

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

lianhao reviewed May 13, 2025

View reviewed changes

comps/embeddings/src/integrations/tei.py Outdated Show resolved Hide resolved

lianhao reviewed May 13, 2025

View reviewed changes

comps/embeddings/src/integrations/tei.py Outdated Show resolved Hide resolved

fix api access issue

0a0c946

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

Spycsh approved these changes May 13, 2025

View reviewed changes

lvliang-intel and others added 3 commits May 13, 2025 11:48

fix ovms url

fe78620

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

remove huggingface_hub for ovms

8a48286

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

[pre-commit.ci] auto fixes from pre-commit.com hooks

4957653

for more information, see https://pre-commit.ci

chensuyue merged commit 2259b9c into opea-project:main May 13, 2025
20 of 23 checks passed

lianhao mentioned this pull request May 13, 2025

[Bug] embedding-usvc failed with helm charts deploy opea-project/GenAIExamples#1937

Closed

10 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Fix huggingface_hub API upgrade issue#1691

Fix huggingface_hub API upgrade issue#1691
chensuyue merged 9 commits intoopea-project:mainfrom
lvliang-intel:fix_hugingfacehub_api_upgrade_issue

lvliang-intel commented May 13, 2025

Uh oh!

Uh oh!

Uh oh!

codecov bot commented May 13, 2025 •

edited

Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

Conversation

lvliang-intel commented May 13, 2025

Description

Issues

Type of change

Dependencies

Tests

Uh oh!

Uh oh!

Uh oh!

codecov bot commented May 13, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

codecov bot commented May 13, 2025 •

edited

Loading