Edit Models filters

Apps

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

56

Full-text search

Active filters: ik_llama.cpp

ubergarm/Ling-1T-GGUF

Text Generation • 1000B • Updated 3 days ago • 590 • 10

Downtown-Case/GLM-4.6-128GB-RAM-IK-GGUF

Text Generation • 357B • Updated 15 days ago • 9.11k • 14

ubergarm/GLM-4.6-GGUF

Text Generation • 357B • Updated 21 days ago • 8.51k • 26

ubergarm/DeepSeek-V3.1-GGUF

Text Generation • 671B • Updated Aug 24 • 491 • 12

ubergarm/Qwen3-Coder-480B-A35B-Instruct-GGUF

Text Generation • 480B • Updated Aug 28 • 496 • 14

NexesQuants/Llama-3.3-Nemotron-70B-Instruct-Abliterated-TA_v0.10-iMat-CQ-GGUF

71B • Updated Jul 17 • 119

ubergarm/DeepSeek-V3-0324-GGUF

Text Generation • 672B • Updated Jul 10 • 183 • 32

ubergarm/gemma-3-27b-it-qat-GGUF

Text Generation • 27B • Updated Jul 10 • 145 • 13

tdh111/bitnet-b1.58-2B-4T-GGUF

Text Generation • 3B • Updated May 16 • 372 • 8

ubergarm/Qwen3-235B-A22B-GGUF

Text Generation • 235B • Updated Jul 22 • 108 • 27

ArtusDev/Qwen3-235B-A22B-GGUF

Text Generation • 235B • Updated May 2 • 1 • 2

ubergarm/Qwen3-30B-A3B-GGUF

Text Generation • 31B • Updated Jul 10 • 41 • 20

ubergarm/DeepSeek-R1T-Chimera-GGUF

Text Generation • 672B • Updated Jul 10 • 26 • 1

ubergarm/Qwen3-14B-GGUF

Text Generation • 15B • Updated Jul 19 • 30 • 4

NexesQuants/mistral-small-3.1-24b-instruct-2503-iMat-IKLQ-GGUF

24B • Updated Jul 5 • 49

ubergarm/DeepSeek-R1-0528-GGUF

Text Generation • 672B • Updated Jul 19 • 738 • 47

NexesQuants/SicariusSicarii_Nano_Imp_1B-iMat-IKL-NXS-CQ-GGUF

1B • Updated Jul 5 • 56

NexesQuants/Gemma-3-4b_X-Ray-Abli_Linear_v1.01-iMat-IKL-NXS-CQ-GGUF

4B • Updated Jul 5 • 19

anikifoss/DeepSeek-R1-0528-DQ4_K_R4

Text Generation • 672B • Updated Jul 10 • 12 • 9

NexesQuants/Fallen-Gemma3-27B-v1-Q8_0-iMat-IKL-NXS-GGUF

27B • Updated Jul 5 • 6

NexesQuants/google_gemma-3-27b-it-qat-q4_0-unquantized-iMat-NXS-GGUF

27B • Updated Jul 5 • 60

ubergarm/Kimi-Dev-72B-GGUF

Text Generation • 73B • Updated Jul 10 • 118 • 2

ubergarm/Hunyuan-A13B-Instruct-GGUF

Text Generation • 80B • Updated Jul 10 • 105 • 13

Kebob/DeepSeek-V3-0324-IK_GGUF

671B • Updated Jul 6 • 102 • 1

Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF

671B • Updated Jul 8 • 20 • 2

Kebob/DeepSeek-R1-0528-IK_GGUF

671B • Updated Jul 6 • 8 • 1

ubergarm/DeepSeek-TNG-R1T2-Chimera-GGUF

Text Generation • 672B • Updated Jul 11 • 47 • 6

NexesQuants/gghfez_Writer-Large-2411-iMat-IKL-CQ-GGUF

123B • Updated Jul 31 • 22

ubergarm/Kimi-K2-Instruct-GGUF

Text Generation • 1T • Updated Jul 22 • 384 • 20

tachyphylaxis/DeepSeek-R1-0528-IK_GGUF

671B • Updated Jul 17