Hugging Face's logo

Maverick17
/
Qwen2.5-VL-72B-Instruct-bnb-8bit

Image-to-Text
Transformers
Safetensors
qwen2_5_vl
text-generation-inference
8-bit precision
bitsandbytes
Model card Files
xet
Community

This is the 8bit BitsAndBytes quantized version of the https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct

Downloads last month
11
Safetensors
Model size
73B params
Tensor type
F32
路
BF16
路
I8
路
Inference Providers NEW
Image-to-Text
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support

Model tree for Maverick17/Qwen2.5-VL-72B-Instruct-bnb-8bit

Base model

Qwen/Qwen2.5-VL-72B-Instruct
Quantized
(32)
this model