Skip to content

Commit e8de7b5

Browse files
authored
chore(model gallery): add LocalAI-functioncall-phi-4-v0.1 (#4588)
Signed-off-by: Ettore Di Giacinto <[email protected]>
1 parent 1780cca commit e8de7b5

File tree

2 files changed

+43
-0
lines changed

2 files changed

+43
-0
lines changed

gallery/index.yaml

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -23,6 +23,22 @@
2323
- filename: phi-4-Q4_K_M.gguf
2424
uri: huggingface://bartowski/phi-4-GGUF/phi-4-Q4_K_M.gguf
2525
sha256: 009aba717c09d4a35890c7d35eb59d54e1dba884c7c526e7197d9c13ab5911d9
26+
- !!merge <<: *phi4
27+
url: "github:mudler/LocalAI/gallery/phi-4-fcall.yaml@master"
28+
name: "LocalAI-functioncall-phi-4-v0.1"
29+
icon: https://cdn-uploads.huggingface.co/production/uploads/647374aa7ff32a81ac6d35d4/Dzbdzn27KEc3K6zNNi070.png
30+
description: |
31+
A model tailored to be conversational and execute function calls with LocalAI. This model is based on phi-4.
32+
urls:
33+
- https://huggingface.co/mudler/LocalAI-functioncall-phi-4-v0.1
34+
- https://huggingface.co/mudler/LocalAI-functioncall-phi-4-v0.1-Q4_K_M-GGUF
35+
overrides:
36+
parameters:
37+
model: localai-functioncall-phi-4-v0.1-q4_k_m.gguf
38+
files:
39+
- filename: localai-functioncall-phi-4-v0.1-q4_k_m.gguf
40+
uri: huggingface://mudler/LocalAI-functioncall-phi-4-v0.1-Q4_K_M-GGUF/localai-functioncall-phi-4-v0.1-q4_k_m.gguf
41+
sha256: 0ae4e5e4ba89c16c1e810285c5c8b84416fa67f8ed7c175aa0b6fc0a103017aa
2642
- &falcon3
2743
name: "falcon3-1b-instruct"
2844
url: "github:mudler/LocalAI/gallery/falcon3.yaml@master"

gallery/phi-4-chat-fcall.yaml

Lines changed: 27 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,27 @@
1+
---
2+
name: "phi-4-chat"
3+
4+
config_file: |
5+
mmap: true
6+
template:
7+
chat_message: |
8+
<|im_start|>{{ .RoleName }}<|im_sep|>
9+
{{.Content}}<|im_end|>
10+
chat: |
11+
{{.Input}}
12+
<|im_start|>assistant<|im_sep|>
13+
completion: |
14+
{{.Input}}
15+
function: |
16+
<|im_start|>system<|im_sep|>
17+
You are an AI assistant that executes function calls, and these are the tools at your disposal:
18+
{{range .Functions}}
19+
{'type': 'function', 'function': {'name': '{{.Name}}', 'description': '{{.Description}}', 'parameters': {{toJson .Parameters}} }}
20+
{{end}}
21+
{{.Input}}<|im_end|>
22+
context_size: 4096
23+
f16: true
24+
stopwords:
25+
- <|end|>
26+
- <|endoftext|>
27+
- <|im_end|>

0 commit comments

Comments
 (0)