Skip to content

Commit e9cace1

Browse files
authored
chore(model gallery): update deepseek-r1 prompt template (#4686)
Signed-off-by: Gianluca Boiano <[email protected]>
1 parent 9409c99 commit e9cace1

File tree

2 files changed

+24
-1
lines changed

2 files changed

+24
-1
lines changed

gallery/deepseek-r1.yaml

Lines changed: 23 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,23 @@
1+
---
2+
name: "deepseek-r1"
3+
4+
config_file: |
5+
context_size: 131072
6+
mmap: true
7+
f16: true
8+
stopwords:
9+
- <|begin▁of▁sentence|>
10+
- <|end▁of▁sentence|>
11+
- <|User|>
12+
- <|Assistant|>
13+
template:
14+
chat_message: |
15+
{{if eq .RoleName "system" -}}{{.Content }}
16+
{{ end -}}
17+
{{if eq .RoleName "user" -}}<|User|>{{.Content}}
18+
{{end -}}
19+
{{if eq .RoleName "assistant" -}}<|Assistant|>{{.Content}}<|end▁of▁sentence|>{{end}}
20+
completion: |
21+
{{.Input}}
22+
chat: |
23+
{{.Input -}}<|Assistant|>

gallery/index.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5302,7 +5302,7 @@
53025302
sha256: a47782c55ef2b39b19644213720a599d9849511a73c9ebb0c1de749383c0a0f8
53035303
uri: huggingface://RichardErkhov/ContextualAI_-_archangel_sft_pythia2-8b-gguf/archangel_sft_pythia2-8b.Q4_K_M.gguf
53045304
- &deepseek-r1 ## Start DeepSeek-R1
5305-
url: "github:mudler/LocalAI/gallery/chatml.yaml@master"
5305+
url: "github:mudler/LocalAI/gallery/deepseek-r1.yaml@master"
53065306
name: "deepseek-r1-distill-qwen-1.5b"
53075307
icon: "https://avatars.githubusercontent.com/u/148330874"
53085308
urls:

0 commit comments

Comments
 (0)