Skip to content

feat: Enhance Llama.cpp backend management with persistence #5886

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 10 commits into from
Jul 24, 2025
Merged

feat: Enhance Llama.cpp backend management with persistence #5886

Show file tree
Hide file tree
Changes from 8 commits
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
2ee9296
feat: Enhance Llama.cpp backend management with persistence
qnixsynapse Jul 24, 2025
d052ce5
fix: cortex models migration should be done once
louis-jan Jul 24, 2025
54e1e5e
feat: Optimize Llama.cpp backend preference storage and UI updates
qnixsynapse Jul 24, 2025
33c66e0
Revert "fix: provider settings should be refreshed on page load (#5887)"
louis-jan Jul 24, 2025
c4f9619
fix: add loader version backend llamacpp
urmauur Jul 24, 2025
118c292
fix: wrong key name
louis-jan Jul 24, 2025
8daf0fa
fix: model setting issues
louis-jan Jul 24, 2025
ffd3b21
fix: virtual dom hub
louis-jan Jul 24, 2025
81ce2dc
chore: cleanup
louis-jan Jul 24, 2025
e6e29f0
chore: hide device ofload setting
urmauur Jul 24, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
26 changes: 1 addition & 25 deletions extensions/llamacpp-extension/settings.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -60,19 +60,7 @@
}
},
{
"key": "ctx_size",
"title": "Context Size",
"description": "Size of the prompt context (0 = loaded from model).",
"controllerType": "input",
"controllerProps": {
"value": 8192,
"placeholder": "8192",
"type": "number",
"textAlign": "right"
}
},
{
"key": "context_shift",
"key": "ctx_shift",
"title": "Context Shift",
"description": "Allow model to cut text in the beginning to accommodate new text in its memory",
"controllerType": "checkbox",
Expand Down Expand Up @@ -116,18 +104,6 @@
"textAlign": "right"
}
},
{
"key": "n_gpu_layers",
"title": "GPU Layers",
"description": "Number of model layers to offload to the GPU (-1 for all layers, 0 for CPU only).",
"controllerType": "input",
"controllerProps": {
"value": -1,
"placeholder": "-1",
"type": "number",
"textAlign": "right"
}
},
{
"key": "device",
"title": "Devices for Offload",
Expand Down
Loading
Loading