Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

27,482

Full-text search

Active filters: 8-bit

Firworks/Hermes-4.3-36B-nvfp4

21B • Updated Dec 5, 2025 • 63 • 4

mlx-community/GLM-4.6V-Flash-8bit

Image-Text-to-Text • Updated Dec 8, 2025 • 57 • 2

frankdarkluo/DeepSeek-R1-Distill-Qwen-32B-GPTQ-Int8

Text Generation • 33B • Updated Dec 26, 2025 • 100 • 1

nvidia/DeepSeek-V3.2-NVFP4

Text Generation • 394B • Updated Jan 21 • 26.2k • 8

nvidia/Qwen3-235B-A22B-Instruct-2507-NVFP4

Text Generation • 120B • Updated Jan 30 • 4.32k • 6

mlx-community/HY-MT1.5-1.8B-8bit

Text Generation • 0.5B • Updated Jan 3 • 460 • 4

Firworks/atom-27b-nvfp4

18B • Updated Jan 8 • 8 • 2

Firworks/Cosmos-Reason2-8B-nvfp4

6B • Updated Jan 6 • 91 • 2

LiquidAI/LFM2.5-1.2B-Thinking-MLX-8bit

Text Generation • 0.3B • Updated 14 days ago • 3.52k • 7

AlicanKiraz0/Mihenk-LLM-14B-Turkish-Financial-Model-mlx-8Bit

15B • Updated Jan 16 • 11 • 9

lmstudio-community/GLM-4.7-Flash-MLX-8bit

Text Generation • 30B • Updated Jan 22 • 647k • 11

Firworks/Aletheia-12B-nvfp4

7B • Updated Jan 20 • 7 • 1

mlx-community/Qwen3-TTS-12Hz-0.6B-CustomVoice-8bit

Text-to-Speech • 0.5B • Updated Jan 25 • 5.05k • 11

nvidia/Qwen3-VL-235B-A22B-Instruct-NVFP4-MLPerf-Inference-Closed-V6.0

133B • Updated Feb 4 • 48.5k • 6

Firworks/SERA-32B-GA-nvfp4

19B • Updated Feb 1 • 4 • 1

DavidAU/OpenAI-gpt-oss-20B-INSTRUCT-Heretic-Uncensored-MXFP4

Text Generation • 2B • Updated 29 days ago • 36 • 4

petergilani/Qwen3-Coder-Next-8bit-g128

Text Generation • 80B • Updated about 1 month ago • 1.42k • 2

Firworks/Step-3.5-Flash-nvfp4

111B • Updated Feb 9 • 335 • 1

lmstudio-community/MiniMax-M2.5-MLX-8bit

Text Generation • 229B • Updated about 1 month ago • 131k • 2

p-e-w/gpt-oss-20b-heretic-v3

Text Generation • 2B • Updated about 1 month ago • 536 • 12

alphakek/GLM-4.7-Flash-heretic-NVFP4

Text Generation • 17B • Updated 27 days ago • 317 • 2

mlx-community/kitten-tts-nano-0.8-8bit

Text-to-Speech • 9.73M • Updated 20 days ago • 57 • 1

EricRollei/HunyuanImage-3.0-Instruct-Distil-INT8-v2

Text-to-Image • 83B • Updated 22 days ago • 136 • 4

MaziyarPanahi/LFM2-24B-A2B-GGUF

Text Generation • 24B • Updated 20 days ago • 437 • 2

olka-fi/Qwen3.5-122B-A10B-MXFP4

Text Generation • 71B • Updated 19 days ago • 5.53k • 4

txn545/Qwen3.5-27B-NVFP4

Text Generation • 17B • Updated 15 days ago • 7.16k • 1

osoleve/Qwen3.5-27B-Text-NVFP4-MTP

Text Generation • 17B • Updated 11 days ago • 9.93k • 10

festr2/GLM-5-NVFP4-MTP

435B • Updated 15 days ago • 11.9k • 2

mlx-community/Qwen3.5-2B-MLX-8bit

0.9B • Updated 14 days ago • 4.57k • 3

mlx-community/Qwen3.5-4B-MLX-8bit

2B • Updated 14 days ago • 2.32k • 2