My abliterated models.
They're here since I really like this way of
Jailbreaking LLMs!;-D
...
See also my intelligence section.
Each model is available here in three different
quantizations [
bf16
,
q8_0
,
iq4_nl
]; ... in the usual
.gguf format!
New:
Now there are also some [
q5_k_s
,
q4_k_m
,
iq4_xs
,
iq3_m
,
q2_k
] quantizations available here.
Info: See the Help PopUps for FileInfo with Hash sums!