Qwen3-0.6B-exl3 / README.md
turboderp's picture
Update README.md
ae608a6 verified
metadata
license: apache-2.0
base_model: Qwen/Qwen3-0.6B
base_model_relation: quantized
quantized_by: turboderp
tags:
  - exl3

EXL3 quants of Qwen3-0.6B

2.75 bits per weight / H5 *
3.00 bits per weight *
3.50 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
8.00 bits per weight / H8

*) Reasoning seems unstable below 3.5 bpw

image/png