Skip to content

Commit e757fcf

Browse files
committed
chore(model gallery): add huihui-ai_deepseek-r1-distill-llama-70b-abliterated
Signed-off-by: Ettore Di Giacinto <[email protected]>
1 parent e01acc8 commit e757fcf

File tree

1 file changed

+15
-0
lines changed

1 file changed

+15
-0
lines changed

gallery/index.yaml

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5848,6 +5848,21 @@
58485848
- filename: uncensoredai_UncensoredLM-DeepSeek-R1-Distill-Qwen-14B-Q4_K_M.gguf
58495849
sha256: 85b2c3e1aa4e8cc3bf616f84c7595c963d5439f3fcfdbd5c957fb22e84d10b1c
58505850
uri: huggingface://bartowski/uncensoredai_UncensoredLM-DeepSeek-R1-Distill-Qwen-14B-GGUF/uncensoredai_UncensoredLM-DeepSeek-R1-Distill-Qwen-14B-Q4_K_M.gguf
5851+
- !!merge <<: *deepseek-r1
5852+
name: "huihui-ai_deepseek-r1-distill-llama-70b-abliterated"
5853+
urls:
5854+
- https://huggingface.co/huihui-ai/DeepSeek-R1-Distill-Llama-70B-abliterated
5855+
- https://huggingface.co/bartowski/huihui-ai_DeepSeek-R1-Distill-Llama-70B-abliterated-GGUF
5856+
description: |
5857+
This is an uncensored version of deepseek-ai/DeepSeek-R1-Distill-Llama-70B created with abliteration (see remove-refusals-with-transformers to know more about it).
5858+
This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.
5859+
overrides:
5860+
parameters:
5861+
model: huihui-ai_DeepSeek-R1-Distill-Llama-70B-abliterated-Q4_K_M.gguf
5862+
files:
5863+
- filename: huihui-ai_DeepSeek-R1-Distill-Llama-70B-abliterated-Q4_K_M.gguf
5864+
sha256: 2ed91d01c4b7a0f33f578c6389d0dd6a64d071b3f7963c40b4e1e71235dc74d6
5865+
uri: huggingface://bartowski/huihui-ai_DeepSeek-R1-Distill-Llama-70B-abliterated-GGUF/huihui-ai_DeepSeek-R1-Distill-Llama-70B-abliterated-Q4_K_M.gguf
58515866
- &qwen2
58525867
url: "github:mudler/LocalAI/gallery/chatml.yaml@master" ## Start QWEN2
58535868
name: "qwen2-7b-instruct"

0 commit comments

Comments
 (0)