File tree Expand file tree Collapse file tree 1 file changed +19
-0
lines changed Expand file tree Collapse file tree 1 file changed +19
-0
lines changed Original file line number Diff line number Diff line change 54765476 - filename: DeepSeek-R1-Distill-Llama-70B-Q4_K_M.gguf
54775477 sha256: 181a82a1d6d2fa24fe4db83a68eee030384986bdbdd4773ba76424e3a6eb9fd8
54785478 uri: huggingface://bartowski/DeepSeek-R1-Distill-Llama-70B-GGUF/DeepSeek-R1-Distill-Llama-70B-Q4_K_M.gguf
5479+ - !!merge <<: *deepseek-r1
5480+ name: "deepseek-r1-qwen-2.5-32b-ablated"
5481+ icon: https://cdn-uploads.huggingface.co/production/uploads/6587d8dd1b44d0e694104fbf/0dkt6EhZYwXVBxvSWXdaM.png
5482+ urls:
5483+ - https://huggingface.co/NaniDAO/deepseek-r1-qwen-2.5-32B-ablated
5484+ - https://huggingface.co/bartowski/deepseek-r1-qwen-2.5-32B-ablated-GGUF
5485+ description: |
5486+ DeepSeek-R1-Distill-Qwen-32B with ablation technique applied for a more helpful (and based) reasoning model.
5487+
5488+ This means it will refuse less of your valid requests for an uncensored UX. Use responsibly and use common sense.
5489+
5490+ We do not take any responsibility for how you apply this intelligence, just as we do not for how you apply your own.
5491+ overrides:
5492+ parameters:
5493+ model: deepseek-r1-qwen-2.5-32B-ablated-Q4_K_M.gguf
5494+ files:
5495+ - filename: deepseek-r1-qwen-2.5-32B-ablated-Q4_K_M.gguf
5496+ sha256: 7f33898641ebe58fe178c3517efc129f4fe37c6ca2d8b91353c4539b0c3411ec
5497+ uri: huggingface://bartowski/deepseek-r1-qwen-2.5-32B-ablated-GGUF/deepseek-r1-qwen-2.5-32B-ablated-Q4_K_M.gguf
54795498- &qwen2 ## Start QWEN2
54805499 url: "github:mudler/LocalAI/gallery/chatml.yaml@master"
54815500 name: "qwen2-7b-instruct"
You can’t perform that action at this time.
0 commit comments