unsloth/Qwen3-8B-GGUF

Text Generation • 8B • Updated Jun 8 • 23.6k • 71

Note Modern and supports thinking

google/gemma-3-4b-it-qat-q4_0-gguf

Image-Text-to-Text • 4B • Updated Apr 11 • 3.23k • 202

Note Vision

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • 7B • Updated May 22, 2024 • 92.1k • 125

Note Old but gold

NousResearch/Hermes-3-Llama-3.2-3B-GGUF

3B • Updated Dec 18, 2024 • 1.15k • 55

Note Great for simple tasks

openbmb/MiniCPM-V-2_6-gguf

8B • Updated Feb 27 • 2.7k • 170

Note Multimodal beast

Menlo/Jan-nano-128k-gguf

Text Generation • 4B • Updated Jul 1 • 11.7k • 69

Note Great for deep research type of usecases

vikhyatk/moondream2

Image-Text-to-Text • 2B • Updated Sep 23 • 1.29M • 1.32k

Note All in one solution for vision

unsloth/orpheus-3b-0.1-ft-GGUF

Text-to-Speech • 3B • Updated Jul 9 • 1.52k • 6

Note Good TTS, supports emotion tags, easy to finetune

nvidia/parakeet-tdt-0.6b-v2

Automatic Speech Recognition • Updated Aug 17 • 393k • 1.35k

Note Great STT for its size