localai 3.5.1

[BrewTestBot]

Created by brew bump

---

Created with brew bump-formula-pr.

release notes

What's Changed
Bug fixes :bug:

fix: make sure to turn down all processes on exit by @mudler in fix: make sure to turn down all processes on exit mudler/LocalAI#6200
fix(p2p): automatically install llama-cpp for p2p workers by @mudler in fix(p2p): automatically install llama-cpp for p2p workers mudler/LocalAI#6199
Point to LocalAI-examples repo for llava by @mauromorales in Point to LocalAI-examples repo for llava mudler/LocalAI#6241
fix: runtime capability detection for backends by @sozercan in fix: runtime capability detection for backends mudler/LocalAI#6149
fix(chat): use proper finish_reason for tool/function calling by @imkira in fix(chat): use proper finish_reason for tool/function calling mudler/LocalAI#6243
fix(rocm): Rename tag suffix for hipblas whisper build to match backend config by @KingJ in fix(rocm): Rename tag suffix for hipblas whisper build to match backend config mudler/LocalAI#6247
fix(llama-cpp): correctly calculate embeddings by @mudler in fix(llama-cpp): correctly calculate embeddings mudler/LocalAI#6259

Exciting New Features 🎉

feat(launcher): show welcome page by @mudler in feat(launcher): show welcome page mudler/LocalAI#6234
feat: support HF_ENDPOINT env for the HuggingFace endpoint by @qxo in feat: support HF_ENDPOINT env for the HuggingFace endpoint mudler/LocalAI#6220

🧠 Models

chore(model gallery): add nousresearch_hermes-4-14b by @mudler in chore(model gallery): add nousresearch_hermes-4-14b mudler/LocalAI#6197
chore(model gallery): add MiniCPM-V-4.5-8b-q4_K_M by @M0Rf30 in chore(model gallery): add MiniCPM-V-4.5-8b-q4_K_M mudler/LocalAI#6205
chore(model-gallery): :arrow_up: update checksum by @localai-bot in chore(model-gallery): ⬆️ update checksum mudler/LocalAI#6211
feat(whisper): Add diarization (tinydiarize) by @richiejp in feat(whisper): Add diarization (tinydiarize) mudler/LocalAI#6184
chore(model gallery): add baidu_ernie-4.5-21b-a3b-thinking by @mudler in chore(model gallery): add baidu_ernie-4.5-21b-a3b-thinking mudler/LocalAI#6267
chore(model gallery): add aquif-ai_aquif-3.5-8b-think by @mudler in chore(model gallery): add aquif-ai_aquif-3.5-8b-think mudler/LocalAI#6269
chore(model gallery): add qwen3-stargate-sg1-uncensored-abliterated-8b-i1 by @mudler in chore(model gallery): add qwen3-stargate-sg1-uncensored-abliterated-8b-i1 mudler/LocalAI#6270
chore(model gallery): add k2-think-i1 by @mudler in chore(model gallery): add k2-think-i1 mudler/LocalAI#6288
chore(model gallery): add holo1.5-72b by @mudler in chore(model gallery): add holo1.5-72b mudler/LocalAI#6289
chore(model gallery): add holo1.5-7b by @mudler in chore(model gallery): add holo1.5-7b mudler/LocalAI#6290
chore(model gallery): add holo1.5-3b by @mudler in chore(model gallery): add holo1.5-3b mudler/LocalAI#6291
chore(model gallery): add alibaba-nlp_tongyi-deepresearch-30b-a3b by @mudler in chore(model gallery): add alibaba-nlp_tongyi-deepresearch-30b-a3b mudler/LocalAI#6295
chore(model gallery): add webwatcher-7b by @mudler in chore(model gallery): add webwatcher-7b mudler/LocalAI#6297
chore(model gallery): add webwatcher-32b by @mudler in chore(model gallery): add webwatcher-32b mudler/LocalAI#6298
chore(model gallery): add websailor-32b by @mudler in chore(model gallery): add websailor-32b mudler/LocalAI#6299
chore(model gallery): add websailor-7b by @mudler in chore(model gallery): add websailor-7b mudler/LocalAI#6300

📖 Documentation and examples

chore(docs): add MacOS dmg download button by @mudler in chore(docs): add MacOS dmg download button mudler/LocalAI#6233

👒 Dependencies

chore(deps): bump github.com/opencontainers/image-spec from 1.1.0 to 1.1.1 by @dependabot[bot] in chore(deps): bump github.com/opencontainers/image-spec from 1.1.0 to 1.1.1 mudler/LocalAI#6223
chore(deps): bump actions/stale from 9.1.0 to 10.0.0 by @dependabot[bot] in chore(deps): bump actions/stale from 9.1.0 to 10.0.0 mudler/LocalAI#6227
chore(deps): bump go.opentelemetry.io/otel/exporters/prometheus from 0.50.0 to 0.60.0 by @dependabot[bot] in chore(deps): bump go.opentelemetry.io/otel/exporters/prometheus from 0.50.0 to 0.60.0 mudler/LocalAI#6226
chore(deps): bump oras.land/oras-go/v2 from 2.5.0 to 2.6.0 by @dependabot[bot] in chore(deps): bump oras.land/oras-go/v2 from 2.5.0 to 2.6.0 mudler/LocalAI#6225
chore(deps): bump github.com/swaggo/swag from 1.16.3 to 1.16.6 by @dependabot[bot] in chore(deps): bump github.com/swaggo/swag from 1.16.3 to 1.16.6 mudler/LocalAI#6222
chore(deps): bump actions/labeler from 5 to 6 by @dependabot[bot] in chore(deps): bump actions/labeler from 5 to 6 mudler/LocalAI#6229
feat(nvidia-gpu): bump images to cuda 12.8 by @mudler in feat(nvidia-gpu): bump images to cuda 12.8 mudler/LocalAI#6239
feat(chatterbox): add MPS, and CPU, pin version by @mudler in feat(chatterbox): add MPS, and CPU, pin version mudler/LocalAI#6242

Other Changes

chore: :arrow_up: Update ggml-org/llama.cpp to 0fce7a1248b74148c1eb0d368b7e18e8bcb96809 by @localai-bot in chore: ⬆️ Update ggml-org/llama.cpp to 0fce7a1248b74148c1eb0d368b7e18e8bcb96809 mudler/LocalAI#6193
chore: :arrow_up: Update leejet/stable-diffusion.cpp to 2eb3845df5675a71565d5a9e13b7bad0881fafcd by @localai-bot in chore: ⬆️ Update leejet/stable-diffusion.cpp to 2eb3845df5675a71565d5a9e13b7bad0881fafcd mudler/LocalAI#6192
docs: :arrow_up: update docs version mudler/LocalAI by @localai-bot in docs: ⬆️ update docs version mudler/LocalAI mudler/LocalAI#6201
chore: :arrow_up: Update ggml-org/llama.cpp to fb15d649ed14ab447eeab911e0c9d21e35fb243e by @localai-bot in chore: ⬆️ Update ggml-org/llama.cpp to fb15d649ed14ab447eeab911e0c9d21e35fb243e mudler/LocalAI#6202
Fix Typos in Docs by @alizfara112 in Fix Typos in Docs mudler/LocalAI#6204
chore: :arrow_up: Update ggml-org/whisper.cpp to bb0e1fc60f26a707cabf724edcf7cfcab2a269b6 by @localai-bot in chore: ⬆️ Update ggml-org/whisper.cpp to bb0e1fc60f26a707cabf724edcf7cfcab2a269b6 mudler/LocalAI#6203
chore: :arrow_up: Update ggml-org/llama.cpp to 408ff524b40baf4f51a81d42a9828200dd4fcb6b by @localai-bot in chore: ⬆️ Update ggml-org/llama.cpp to 408ff524b40baf4f51a81d42a9828200dd4fcb6b mudler/LocalAI#6207
chore: :arrow_up: Update ggml-org/llama.cpp to c4df49a42d396bdf7344501813e7de53bc9e7bb3 by @localai-bot in chore: ⬆️ Update ggml-org/llama.cpp to c4df49a42d396bdf7344501813e7de53bc9e7bb3 mudler/LocalAI#6209
chore: ⬆️ Update leejet/stable-diffusion.cpp to d7f430cd693f2e12ecbaa0ce881746cf305c3b1f by @richiejp in chore: ⬆️ Update leejet/stable-diffusion.cpp to d7f430cd693f2e12ecbaa0ce881746cf305c3b1f mudler/LocalAI#6213
chore: :arrow_up: Update leejet/stable-diffusion.cpp to c648001030d4c2cc7c851fdaf509ee36d642dc99 by @localai-bot in chore: ⬆️ Update leejet/stable-diffusion.cpp to c648001030d4c2cc7c851fdaf509ee36d642dc99 mudler/LocalAI#6215
chore: :arrow_up: Update ggml-org/llama.cpp to 3976dfbe00f02a62c0deca32c46138e4f0ca81d8 by @localai-bot in chore: ⬆️ Update ggml-org/llama.cpp to 3976dfbe00f02a62c0deca32c46138e4f0ca81d8 mudler/LocalAI#6214
chore: :arrow_up: Update leejet/stable-diffusion.cpp to abb115cd021fc2beed826604ed1a479b6a77671c by @localai-bot in chore: ⬆️ Update leejet/stable-diffusion.cpp to abb115cd021fc2beed826604ed1a479b6a77671c mudler/LocalAI#6236
chore: :arrow_up: Update ggml-org/whisper.cpp to edea8a9c3cf0eb7676dcdb604991eb2f95c3d984 by @localai-bot in chore: ⬆️ Update ggml-org/whisper.cpp to edea8a9c3cf0eb7676dcdb604991eb2f95c3d984 mudler/LocalAI#6237
chore: :arrow_up: Update leejet/stable-diffusion.cpp to b0179181069254389ccad604e44f17a2c25b4094 by @localai-bot in chore: ⬆️ Update leejet/stable-diffusion.cpp to b0179181069254389ccad604e44f17a2c25b4094 mudler/LocalAI#6246
chore: :arrow_up: Update ggml-org/llama.cpp to 0e6ff0046f4a2983b2c77950aa75960fe4b4f0e2 by @localai-bot in chore: ⬆️ Update ggml-org/llama.cpp to 0e6ff0046f4a2983b2c77950aa75960fe4b4f0e2 mudler/LocalAI#6235
chore: ⬆️ Update leejet/stable-diffusion.cpp to fce6afcc6a3250a8e17923608922d2a99b339b47 by @richiejp in chore: ⬆️ Update leejet/stable-diffusion.cpp to fce6afcc6a3250a8e17923608922d2a99b339b47 mudler/LocalAI#6256
chore: :arrow_up: Update ggml-org/llama.cpp to 40be51152d4dc2d47444a4ed378285139859895b by @localai-bot in chore: ⬆️ Update ggml-org/llama.cpp to 40be51152d4dc2d47444a4ed378285139859895b mudler/LocalAI#6260
chore: :arrow_up: Update ggml-org/llama.cpp to aa0c461efe3603639af1a1defed2438d9c16ca0f by @localai-bot in chore: ⬆️ Update ggml-org/llama.cpp to aa0c461efe3603639af1a1defed2438d9c16ca0f mudler/LocalAI#6261
chore(aio): upgrade minicpm-v model to latest 4.5 by @M0Rf30 in chore(aio): upgrade minicpm-v model to latest 4.5 mudler/LocalAI#6262
chore: :arrow_up: Update ggml-org/llama.cpp to 0fa154e3502e940df914f03b41475a2b80b985b0 by @localai-bot in chore: ⬆️ Update ggml-org/llama.cpp to 0fa154e3502e940df914f03b41475a2b80b985b0 mudler/LocalAI#6263
chore: :arrow_up: Update ggml-org/llama.cpp to 6c019cb04e86e2dacfe62ce7666c64e9717dde1f by @localai-bot in chore: ⬆️ Update ggml-org/llama.cpp to 6c019cb04e86e2dacfe62ce7666c64e9717dde1f mudler/LocalAI#6265
chore: ⬆️ Update leejet/stable-diffusion.cpp to 0ebe6fe118f125665939b27c89f34ed38716bff8 by @richiejp in chore: ⬆️ Update leejet/stable-diffusion.cpp to 0ebe6fe118f125665939b27c89f34ed38716bff8 mudler/LocalAI#6271
chore: :arrow_up: Update ggml-org/llama.cpp to b907255f4bd169b0dc7dca9553b4c54af5170865 by @localai-bot in chore: ⬆️ Update ggml-org/llama.cpp to b907255f4bd169b0dc7dca9553b4c54af5170865 mudler/LocalAI#6287
chore: :arrow_up: Update ggml-org/llama.cpp to 8ff206097c2bf3ca1c7aa95f9d6db779fc7bdd68 by @localai-bot in chore: ⬆️ Update ggml-org/llama.cpp to 8ff206097c2bf3ca1c7aa95f9d6db779fc7bdd68 mudler/LocalAI#6292

New Contributors

@alizfara112 made their first contribution in Fix Typos in Docs mudler/LocalAI#6204
@qxo made their first contribution in feat: support HF_ENDPOINT env for the HuggingFace endpoint mudler/LocalAI#6220
@imkira made their first contribution in fix(chat): use proper finish_reason for tool/function calling mudler/LocalAI#6243
@KingJ made their first contribution in fix(rocm): Rename tag suffix for hipblas whisper build to match backend config mudler/LocalAI#6247

Full Changelog: mudler/LocalAI@v3.5.0...v3.5.1

View the full release notes at https://github.com/mudler/LocalAI/releases/tag/v3.5.1.

---

[github-actions]

🤖 An automated task has requested bottles to be published to this PR.

Caution

Please do not push to this PR branch before the bottle commits have been pushed, as this results in a state that is difficult to recover from. If you need to resolve a merge conflict, please use a merge commit. Do not force-push to this PR branch.