mrtoots/unsloth-GLM-4.7-mlx-4Bit
Text Generation • 353B • Updated • 274 • 1
Toots' MLX Quants
Various MLX quants for testing on Mac systems.
-
-
mrtoots/unsloth-Qwen3-Coder-Next-mlx-8bit
Text Generation • 80B • Updated • 1.51k • 1 -
mrtoots/unsloth-Qwen3-Coder-30B-A3B-Instruct-mlx-8Bit
Text Generation • 31B • Updated • 288 -
mrtoots/unsloth-GLM-4.7-mlx-3Bit
Text Generation • 353B • Updated • 298 -
mrtoots/unsloth-gpt-oss-120b-mlx-8Bit
Text Generation • 117B • Updated • 122 -
mrtoots/unsloth-GLM-4.6-mlx-3Bit
Text Generation • 353B • Updated • 25 -
mrtoots/Tongyi-DeepResearch-30B-A3B-mlx-8Bit
Text Generation • 31B • Updated • 11 -
mrtoots/unsloth-GLM-4.5-MLX-3Bit
Text Generation • 353B • Updated • 74 • 1 -
mrtoots/unsloth-DeepSeek-V3.1-MLX-2Bit
Text Generation • 671B • Updated • 118 • 2 -
mrtoots/unsloth-GLM-4.5-Air-MLX-8Bit
Text Generation • 107B • Updated • 43 • 1 -
mrtoots/Wayfarer-Large-70B-Llama-3.3-mlx-8Bit
Text Generation • 71B • Updated • 26 -
mrtoots/TheDrummer-Behemoth-R1-123B-v2-MLX-8Bit
123B • Updated • 23 -
mrtoots/unsloth-GLM-4.5-MLX-2Bit
Text Generation • 353B • Updated • 8 -
mrtoots/TheDrummer-Behemoth-R1-123B-v2-MLX-4Bit
123B • Updated • 12 -
mrtoots/Wayfarer_Eris_Noctis-12B-mlx-6Bit
Text Generation • 3B • Updated • 5 -
mrtoots/TheDrummer-GLM-Steam-106B-A12B-v1-MLX-8Bit
107B • Updated • 25 -
mrtoots/L3.3-GeneticLemonade-Unleashed-70B-mlx-8Bit
Text Generation • 71B • Updated • 15 -
mrtoots/TheDrummer-GLM-Steam-106B-A12B-v1-MLX-4Bit
107B • Updated • 20 -
mrtoots/CharGen-v3-mini-mlx-fp16
Text Generation • 5B • Updated • 12 -
mrtoots/Impish_Nemo_12B-mlx-8Bit
12B • Updated • 10 • 1 -
mrtoots/CaptainErisNebula-12B-Chimera-v1.1-mlx-8Bit
12B • Updated • 1 -
mrtoots/unsloth-gpt-oss-20b-mlx-fp16
Text Generation • 21B • Updated • 112 -
mrtoots/TheDrummer-Behemoth-X-123B-v2-mlx-8Bit
123B • Updated • 153 -
mrtoots/TheDrummer-Behemoth-X-123B-v2-mlx-4Bit
123B • Updated • 37 -
mrtoots/CaptainErisNebula-12B-Chimera-v1.1-mlx-6Bit
12B • Updated • 7 -
mrtoots/Nova-70B-Llama-3.3-mlx-8Bit
Text Generation • 71B • Updated • 27 -
mrtoots/Wayfarer-2-12B-mlx-8Bit
Text Generation • 12B • Updated • 14 -
mrtoots/Nova-70B-Llama-3.3-mlx-fp16
Text Generation • 71B • Updated • 17 -
mrtoots/Wayfarer-2-12B-mlx-6Bit
Text Generation • 12B • Updated • 9 -
mrtoots/TheDrummer-Behemoth-ReduX-123B-v1-mlx-8Bit
123B • Updated • 18 -
mrtoots/unsloth-Hermes-4-405B-mlx-2Bit
Text Generation • 406B • Updated • 13 -
mrtoots/TheDrummer-Behemoth-ReduX-123B-v1-mlx-4Bit
123B • Updated • 20 -
mrtoots/unsloth-Hermes-4-405B-mlx-3Bit
Text Generation • 406B • Updated • 16 -
mrtoots/Steelskull-L3.3-Nevoria-R1-70b-mlx-8Bit
Text Generation • 71B • Updated • 16 -
mrtoots/Hermes-3-Llama-3.1-405B-mlx-2Bit
Text Generation • 406B • Updated • 21 -
mrtoots/Steelskull-L3.3-Cu-Mai-R1-70b-mlx-8Bit
Text Generation • 71B • Updated • 8 -
mrtoots/Steelskull-L3.3-MS-Nevoria-70b-mlx-8Bit
Text Generation • 71B • Updated • 27 -
mrtoots/Steelskull-L3.3-Electra-R1-70b-mlx-8Bit
Text Generation • 71B • Updated • 4 -
mrtoots/Steelskull-L3.3-Shakudo-70b-mlx-8Bit
71B • Updated • 15 -
mrtoots/BruhzWater-Sapphira-L3.3-70b-0.1-mlx-8Bit
Text Generation • 71B • Updated • 30 -
mrtoots/unsloth-Qwen3-235B-A22B-Thinking-2507-mlx-4Bit
Text Generation • 235B • Updated • 54 -
mrtoots/unsloth-Qwen3-235B-A22B-Instruct-2507-mlx-4Bit
Text Generation • 235B • Updated • 58 -
mrtoots/unsloth-Magistral-Small-2509-mlx-8Bit
24B • Updated • 35 • 1 -
mrtoots/SimpleChat-30BA3B-V2-mlx-8Bit
Text Generation • 31B • Updated • 1 • 1 -
mrtoots/unsloth-DeepSeek-V3.1-Terminus-mlx-3Bit
Text Generation • 671B • Updated • 59 • 1 -
mrtoots/unsloth-DeepSeek-V3.1-Terminus-mlx-2Bit
Text Generation • 671B • Updated • 86 • 1 -
mrtoots/unsloth-GLM-4.6-mlx-4Bit
Text Generation • 353B • Updated • 30 -
mrtoots/TheDrummer-Skyfall-31B-v4-mlx-4Bit
31B • Updated • 47 -
mrtoots/GLM-4.7-mlx-6Bit
Text Generation • 353B • Updated • 34 -
mrtoots/GLM-4.7-REAP-218B-A32B-mlx-6Bit
Text Generation • 218B • Updated • 341 • 1 -
mrtoots/GLM-4.7-REAP-218B-A32B-mlx-4Bit
Text Generation • 218B • Updated • 254