Skip to content

Commit de72ae7

Browse files
authored
chore(model gallery): add ds-r1-qwen3-8b-arliai-rpr-v4-small-iq-imatrix (#5708)
Signed-off-by: Ettore Di Giacinto <[email protected]>
1 parent 884c07d commit de72ae7

File tree

1 file changed

+23
-0
lines changed

1 file changed

+23
-0
lines changed

gallery/index.yaml

Lines changed: 23 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1233,6 +1233,29 @@
12331233
- filename: Q3-8B-Kintsugi-Q4_K_M.GGUF
12341234
sha256: 2eecf44c709ef02794346d84f7d69ee30059c2a71186e4d18a0861958a4a52db
12351235
uri: huggingface://allura-quants/allura-org_Q3-8B-Kintsugi-GGUF/Q3-8B-Kintsugi-Q4_K_M.GGUF
1236+
- !!merge <<: *qwen3
1237+
name: "ds-r1-qwen3-8b-arliai-rpr-v4-small-iq-imatrix"
1238+
icon: https://cdn-uploads.huggingface.co/production/uploads/6625f4a8a8d1362ebcc3851a/hIZ2ZcaDyfYLT9Yd4pfOs.jpeg
1239+
urls:
1240+
- https://huggingface.co/ArliAI/DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small
1241+
- https://huggingface.co/Lewdiculous/DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-GGUF-IQ-Imatrix
1242+
description: |
1243+
The best RP/creative model series from ArliAI yet again. This time made based on DS-R1-0528-Qwen3-8B-Fast for a smaller memory footprint.
1244+
1245+
Reduced repetitions and impersonation
1246+
1247+
To add to the creativity and out of the box thinking of RpR v3, a more advanced filtering method was used in order to remove examples where the LLM repeated similar phrases or talked for the user. Any repetition or impersonation cases that happens will be due to how the base QwQ model was trained, and not because of the RpR dataset.
1248+
1249+
Increased training sequence length
1250+
1251+
The training sequence length was increased to 16K in order to help awareness and memory even on longer chats.
1252+
overrides:
1253+
parameters:
1254+
model: DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-Q4_K_M-imat.gguf
1255+
files:
1256+
- filename: DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-Q4_K_M-imat.gguf
1257+
sha256: b40be91d3d2f2497efa849e69f0bb303956b54e658f57bc39c41dba424018d71
1258+
uri: huggingface://Lewdiculous/DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-GGUF-IQ-Imatrix/DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-Q4_K_M-imat.gguf
12361259
- &gemma3
12371260
url: "github:mudler/LocalAI/gallery/gemma.yaml@master"
12381261
name: "gemma-3-27b-it"

0 commit comments

Comments
 (0)