metadata
license: mit
base_model: zai-org/GLM-4.5V
base_model_relation: quantized
quantized_by: turboderp
tags:
- exl3
EXL3 quants of GLM-4.5V
⚠️ Requires ExLlamaV3 v0.0.15 (or v0.0.14 dev branch)
Base bitrates:
2.00 bits per weight
3.00 bits per weight
4.00 bits per weight
Optimized:
2.13 bits per weight
2.32 bits per weight
2.55 bits per weight
2.80 bits per weight
3.07 bits per weight
3.49 bits per weight