Edit Models filters

Model Tree

Qwen/Qwen2.5-0.5B-Instruct

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

109

Full-text search

Active filters: ollama, Qwen/Qwen2.5-0.5B-Instruct

Qwen/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.6B • Updated Sep 20, 2024 • 111k • 90

bartowski/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Sep 19, 2024 • 11.9k • 13

lmstudio-community/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Sep 19, 2024 • 8.86k • 6

MaziyarPanahi/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Sep 18, 2024 • 355 • 2

Hugggme/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Sep 18, 2024 • 29 • 1

second-state/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Jan 27, 2025 • 668 • 1

gaianet/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Apr 28, 2025 • 370

legraphista/Qwen2.5-0.5B-Instruct-IMat-GGUF

Text Generation • 0.5B • Updated Sep 19, 2024 • 544

DevQuasar/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Apr 28, 2025 • 46

Felladrin/gguf-Q5_K_M-Qwen2.5-0.5B-Instruct

Text Generation • 0.5B • Updated Apr 28, 2025 • 209

mukel/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.6B • Updated Apr 28, 2025 • 11

ShabaHu/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Sep 24, 2024 • 217

ShabaHu/Qwen2.5-0.5B-Instruct-Q4_0-GGUF

Text Generation • 0.5B • Updated Sep 24, 2024 • 23

mradermacher/Qwen2.5-0.5B-Instruct-GGUF

0.5B • Updated Aug 1, 2025 • 208

mradermacher/Qwen2.5-0.5B-Instruct-i1-GGUF

0.5B • Updated Oct 11, 2024 • 116 • 2

pedalnomica/Qwen2.5-0.5B-Instruct-GGUF-q2_k

Text Generation • 0.6B • Updated Sep 26, 2024 • 55

v8karlo/Qwen2.5-0.5B-Instruct-Q8_0-GGUF

Text Generation • 0.5B • Updated Oct 2, 2024 • 66

QuantFactory/Reasoning-0.5b-GGUF

0.5B • Updated Oct 7, 2024 • 76 • 2

QuantFactory/Qwen2.5-0.5b-RBase-GGUF

0.5B • Updated Oct 7, 2024 • 28 • 2

QuantFactory/Vikhr-Qwen-2.5-0.5b-Instruct-GGUF

0.5B • Updated Oct 8, 2024 • 58 • 2

ysn-rfd/Qwen2.5-0.5B-Instruct-Q8_0-GGUF

Text Generation • 0.5B • Updated Oct 25, 2024 • 6 • 1

marroyo777/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Oct 28, 2024 • 15

Volko76/Qwen2.5-0.5B-Instruct-Q5_K_M-GGUF

Text Generation • 0.5B • Updated Apr 28, 2025 • 23

Felladrin/gguf-Q8_0-Qwen2.5-0.5B-Instruct

0.5B • Updated Apr 28, 2025 • 12

ll3214/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Nov 2, 2024 • 11

Izhanjafry/Qwen2.5-0.5B-Instruct-Q8_0-GGUF

Text Generation • 0.5B • Updated Nov 5, 2024 • 1

tensorblock/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Jan 27 • 86

teka38/vicuna_DocMental-0.5b-v3.1-gguf

0.5B • Updated Nov 13, 2024 • 1

ystemsrx/Qwen2.5-Interpreter

Text Generation • 0.5B • Updated Jan 18, 2025 • 112 • 2

apto-as/Qwen2.5-0.5B-Instruct-Q8_0-GGUF

Text Generation • 0.5B • Updated Nov 28, 2024