Hugging Face's logo

noctrex
/
Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-v2-GGUF

Image-Text-to-Text
GGUF
imatrix
conversational
Model card Files
xet
 Community
1

These are quantizations of the model Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-v2

Original model: https://huggingface.co/huihui-ai/Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-v2

Downloads last month
1,618
GGUF
Model size
24B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
Image-Text-to-Text
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for noctrex/Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-v2-GGUF

Base model

mistralai/Mistral-Small-3.1-24B-Base-2503
Finetuned
mistralai/Mistral-Small-3.2-24B-Instruct-2506
Finetuned
huihui-ai/Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-v2
Quantized
(1)
this model

Collection including noctrex/Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-v2-GGUF