Hariprasath28
/

orpheus-3b-4bit-AWQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Orpheus 3B 8-bit AWQ

This is an 8-bit AWQ quantized version of canopylabs/orpheus-3b-0.1-ft

Model Details

Base Model: canopylabs/orpheus-3b-0.1-ft
Quantization: 8-bit AWQ
Group Size: 128
Calibration Dataset: canopylabs/zac-sample-dataset (TTS-specific)
Library: auto-awq

Downloads last month: 5

Safetensors

Model size

0.9B params

Tensor type

I32

·

F16

·

Model tree for Hariprasath28/orpheus-3b-4bit-AWQ

Base model

meta-llama/Llama-3.2-3B-Instruct

Finetuned

canopylabs/orpheus-3b-0.1-pretrained

Finetuned

canopylabs/orpheus-3b-0.1-ft

Quantized

(29)

this model