MOPO Labs presents what to our knowledge is the first quantized GLM-4.5 with a 2-bit MLX format quantization that allows the original 355gb model to work on a 192GB Mac using LM Studio and other MLX compatible tools. Note this is a research build intended to learn more about the differences between the GLM-4.5 quantized lower versus the GLM-4.5 Air model; If you discover good tips, kindly share with [email protected] or on huggingface.

Downloads last month
76
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for monirmamoun/GLM-4.5-MLX-2bit

Base model

zai-org/GLM-4.5
Quantized
(31)
this model