Skip to content

feat: Allow to install backend from file with .zip instead of .tar.gz #6519

@LazyYuuki

Description

@LazyYuuki

Problem Statement

Currently, in 0.6.10, we can only install a llama.cpp backend using .tar.gz and not .zip which is how llama.cpp built is distributed.

Feature Idea

Allow user to just install directly from .zip file instead

Metadata

Metadata

Assignees

Labels

No labels
No labels

Projects

Status

Done

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions