Skip to content

codetrans: add vLLM as default inference engine#881

Merged
poussa merged 1 commit intoopea-project:mainfrom
lianhao:codetrans_vllm
Mar 25, 2025
Merged

codetrans: add vLLM as default inference engine#881
poussa merged 1 commit intoopea-project:mainfrom
lianhao:codetrans_vllm

Conversation

@lianhao
Copy link
Copy Markdown
Collaborator

@lianhao lianhao commented Mar 19, 2025

Description

codetrans: add vLLM as default inference engine

Issues

Fixes #858

Type of change

List the type of change like below. Please delete options that are not relevant.

  • New feature (non-breaking change which adds new functionality)

Dependencies

List the newly introduced 3rd party dependency if exists.

Tests

CI on xeon, manually on Gaudi

@lianhao lianhao requested a review from yongfengdu as a code owner March 19, 2025 05:45
@lianhao lianhao requested a review from poussa March 19, 2025 05:45
@lianhao
Copy link
Copy Markdown
Collaborator Author

lianhao commented Mar 19, 2025

Please hold this until PR #882 to get landed in first

@lianhao lianhao marked this pull request as draft March 19, 2025 09:49
@lianhao lianhao marked this pull request as ready for review March 19, 2025 12:31
@lianhao
Copy link
Copy Markdown
Collaborator Author

lianhao commented Mar 19, 2025

Please hold this until PR #882 to get landed in first

It's ready for merge now

Signed-off-by: Lianhao Lu <lianhao.lu@intel.com>
@poussa poussa merged commit 9e63ce8 into opea-project:main Mar 25, 2025
11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[ci-auto] CodeTrans: use vllm as default backend

3 participants