Skip to content

Commit ceda2e6

Browse files
authored
chore(model gallery): add huihui-jan-nano-abliterated (#5806)
Signed-off-by: Ettore Di Giacinto <[email protected]>
1 parent cea1703 commit ceda2e6

File tree

1 file changed

+16
-0
lines changed

1 file changed

+16
-0
lines changed

gallery/index.yaml

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1665,6 +1665,22 @@
16651665
- filename: Qwen-GUI-3B.i1-Q4_K_M.gguf
16661666
sha256: 39b6d842a3f5166bf01b1f50bbeb13cc2cc1ee59c3c8c09702a73c6e13b7023c
16671667
uri: huggingface://mradermacher/Qwen-GUI-3B-i1-GGUF/Qwen-GUI-3B.i1-Q4_K_M.gguf
1668+
- !!merge <<: *qwen3
1669+
name: "huihui-jan-nano-abliterated"
1670+
urls:
1671+
- https://huggingface.co/huihui-ai/Huihui-Jan-nano-abliterated
1672+
- https://huggingface.co/mradermacher/Huihui-Jan-nano-abliterated-GGUF
1673+
description: |
1674+
This is an uncensored version of Menlo/Jan-nano created with abliteration (see remove-refusals-with-transformers to know more about it). This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.
1675+
1676+
Ablation was performed using a new and faster method, which yields better results.
1677+
overrides:
1678+
parameters:
1679+
model: Huihui-Jan-nano-abliterated.Q4_K_M.gguf
1680+
files:
1681+
- filename: Huihui-Jan-nano-abliterated.Q4_K_M.gguf
1682+
sha256: 4390733f3f97ec36a24abe0b4e1b07980a4470e9ec4bf0f7d027c90be38670fa
1683+
uri: huggingface://mradermacher/Huihui-Jan-nano-abliterated-GGUF/Huihui-Jan-nano-abliterated.Q4_K_M.gguf
16681684
- &gemma3
16691685
url: "github:mudler/LocalAI/gallery/gemma.yaml@master"
16701686
name: "gemma-3-27b-it"

0 commit comments

Comments
 (0)