This repository provides Q8_0 GGUF quantizations of Qwen/Qwen3-4B and Qwen/Qwen3-4B-Base.

Downloads last month
57
GGUF
Model size
4B params
Architecture
qwen3
Hardware compatibility
Log In to view the estimation

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for ddh0/Qwen3-4B

Base model

Qwen/Qwen3-4B-Base
Finetuned
Qwen/Qwen3-4B
Quantized
(173)
this model