feat(llama.cpp): Add support to grammar triggers

[mudler]

Description

Thanks to the great upstream work in llama.cpp ( ggml-org/llama.cpp#9639 thanks 🫶 @ochafik ! ) it is now possible to enable grammars with a set of trigger words. This allows to force a special schema in answers only if a trigger word is detected as part of the text of the LLM. This, for example, allows to models that uses tags before returning the json (e.g. [TOOL_CALL], <tool_call>, ... ) to identify the function call and enable the grammar - which allows the model to output text replies or JSON.

This PR enables this feature in LocalAI, and it can be enabled in the model configuration file:

function:
  grammar:
    triggers:
    - word: "foo"
      at_start: true

Notes for Reviewers

Signed commits

• Yes, I signed my commits.

[netlify]

✅ Deploy Preview for localai ready!

Name	Link
🔨 Latest commit	d28547e
🔍 Latest deploy log	https://app.netlify.com/sites/localai/deploys/679f4a8ac1c3f100089c6cf4
😎 Deploy Preview	https://deploy-preview-4733--localai.netlify.app
📱 Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

---

To edit notification comments on pull requests, go to your Netlify site configuration.