Models

AMead10/Llama-3.2-3B-Instruct-AWQ

Text Generation • 1B • Updated Sep 25, 2024 • 853 • 4

AMead10/Llama-3.2-1B-Instruct-AWQ

Text Generation • 0.7B • Updated Sep 25, 2024 • 139 • 7

PyrTools/Ministral-8B-Instruct-2410-AWQ

2B • Updated Oct 25, 2024 • 78 • 2

Qwen/Qwen2.5-Coder-32B-Instruct-GPTQ-Int4

Text Generation • 6B • Updated Nov 18, 2024 • 48.7k • 22

lmstudio-community/Qwen2.5-0.5B-Instruct-MLX-4bit

Text Generation • 77.3M • Updated Nov 13, 2024 • 2.66k • 1

unsloth/Pixtral-12B-2409-unsloth-bnb-4bit

Image-Text-to-Text • 7B • Updated Dec 4, 2024 • 1.35k • 13

MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • 24B • Updated Jun 23 • 80.1k • 7

Qwen/Qwen2.5-VL-72B-Instruct-AWQ

Image-Text-to-Text • 13B • Updated Mar 7 • 10.3k • 67

unsloth/QwQ-32B-unsloth-bnb-4bit

Text Generation • 19B • Updated Mar 7 • 652 • 47

noneUsername/QwQ-32B-abliterated-AWQ-INT4

6B • Updated Mar 8 • 31 • 5

noneUsername/QwQ-32B-abliterated-AWQ-INT4-float16

6B • Updated Mar 8 • 3

unsloth/gemma-3-4b-it-bnb-4bit

Image-Text-to-Text • 3B • Updated May 12 • 4.85k • 11

MaziyarPanahi/gemma-3-12b-it-GGUF

Text Generation • 12B • Updated Mar 12 • 156k • 11

gaunernst/gemma-3-12b-it-int4-awq

Image-Text-to-Text • 3B • Updated Apr 6 • 7.39k • 20

Orion-zhen/Qwen3-0.6B-AWQ

0.2B • Updated Apr 29 • 1.03k • 6

Qwen/Qwen3-32B-AWQ

Text Generation • 6B • Updated May 21 • 98.2k • 114

Qwen/Qwen3-14B-AWQ

Text Generation • 3B • Updated May 21 • 218k • 43

QuixiAI/Qwen3-30B-A3B-AWQ

Text Generation • 5B • Updated May 2 • 3.79k • 13

Qwen/Qwen3-8B-MLX-4bit

Text Generation • 1B • Updated Jul 7 • 816 • 6

Qwen/Qwen3-4B-MLX-4bit

Text Generation • 0.6B • Updated Aug 29 • 74.1k • 18

adamo1139/DeepSeek-V2.5-1210-AWQ

35B • Updated Sep 18 • 17 • 2

unsloth/Mistral-Small-3.2-24B-Instruct-2506-unsloth-bnb-4bit

Image-Text-to-Text • 13B • Updated Jun 23 • 6.5k • 11

mlx-community/medgemma-27b-it-4bit

Image-Text-to-Text • Updated Jul 10 • 90 • 3

mlx-community/Kimi-K2-Instruct-4bit

Text Generation • 1T • Updated Jul 11 • 3.19k • 12

NexaAI/gemma-3n-E4B-it-4bit-MLX

Image-Text-to-Text • Updated Jul 22 • 60 • 2

yanmyoaung04/deepseek-cybersecurity-model-v1.1

Text Generation • 8B • Updated Jul 23 • 6 • 2

QuantTrio/Qwen3-Coder-480B-A35B-Instruct-AWQ

Text Generation • 66B • Updated Aug 19 • 17.9k • 8

QuantTrio/Qwen3-Coder-480B-A35B-Instruct-GPTQ-Int4-Int8Mix

Text Generation • Updated Sep 5 • 4.28k • 6

lmstudio-community/Qwen3-Coder-30B-A3B-Instruct-MLX-4bit

Text Generation • 31B • Updated Jul 31 • 155k • 8

Intel/Qwen3-30B-A3B-Thinking-2507-int4-AutoRound

0.6B • Updated Sep 19 • 86 • 9