Models

11,620

Full-text search

Active filters: dpo

F16/z-image-turbo-flow-dpo

Feature Extraction • Updated 27 days ago • 154

sweepai/sweep-next-edit-v2-7B

Text Generation • 8B • Updated about 12 hours ago • 6

danielcherubini/Qwen3.5-DeltaCoder-9B-GGUF

Text Generation • 9B • Updated 2 days ago • 2.62k • 4

nivvis/Qwen3.5-35B-A3B-EQ-v5

Text Generation • 35B • Updated 3 days ago • 1.12k • 4

ToastyPigeon/Qwen3.5-27B-Marvin-DPO-V2

Text Generation • 28B • Updated about 10 hours ago • 37 • 4

mlabonne/NeuralDaredevil-8B-abliterated

Text Generation • 8B • Updated Jan 23 • 16.1k • • 264

danielcherubini/Qwen3.5-DeltaCoder-9B

Text Generation • Updated 2 days ago • 68 • 2

argilla/CapybaraHermes-2.5-Mistral-7B

7B • Updated Mar 4, 2024 • 203 • 73

BramVanroy/GEITje-7B-ultra-GGUF

7B • Updated Dec 6, 2024 • 224 • 10

trentmkelly/gpt-4o-distil-Llama-3.1-8B-Instruct

Text Generation • Updated Jan 30 • 6 • 1

jpacifico/Chocolatine-2-4B-Instruct-DPO-v2.1

Text Generation • 4B • Updated 4 days ago • 1.18k • 1

MuXodious/gpt-4o-distil-Llama-3.1-8B-Instruct-PaperWitch-heresy

Text Generation • 8B • Updated Feb 19 • 99 • 3

MuXodious/gpt-4o-distil-Llama-3.3-70B-Instruct-PaperWitch-heresy

Text Generation • 71B • Updated Feb 23 • 37 • 3

UVLabs/HyperLLM-4b

Text Generation • Updated 13 days ago • 235 • 4

pathcosmos/EVAFRILL-Mo-3B

Text Generation • Updated 5 days ago • 1.15k • 1

empero-ai/openNemo-9B-Claude-Opus-4.6-distill

Text Generation • Updated 7 days ago • 368 • 1

abcsk123/Code-Centric-Align

Updated 6 days ago • 52 • 1

mradermacher/Chocolatine-2-4B-Instruct-DPO-v2.1-GGUF

4B • Updated 5 days ago • 588 • 1

mradermacher/Chocolatine-2-4B-Instruct-DPO-v2.1-i1-GGUF

4B • Updated 5 days ago • 1.84k • 1

jk200201/qwen2.5-coder-7b-sql-dpo

Text Generation • Updated 5 days ago • 32 • 1

lyogavin/Anima33B-DPO-Belle-1k

Text Generation • Updated Jul 2, 2023 • 1

lyogavin/Anima33B-DPO-Belle-1k-merged

Text Generation • Updated Jul 2, 2023 • 7 • 12

daekeun-ml/Llama-2-ko-DPO-13B

Text Generation • 13B • Updated Oct 31, 2023 • 11 • 19

lewtun/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 5, 2024 • 6

alignment-handbook/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 10, 2024 • 29 • 3

alignment-handbook/zephyr-7b-dpo-qlora

Updated Jan 9, 2024 • 17 • 9

argilla/notus-7b-v1-lora

Text Generation • Updated Dec 4, 2023 • 6 • 7

argilla/notus-7b-v1-lora-adapter

Text Generation • Updated Dec 4, 2023 • 3

argilla/notus-7b-v1

Text Generation • 7B • Updated Dec 5, 2023 • 186 • 123

ContextualAI/archangel_sft_pythia1-4b

Text Generation • 1B • Updated Jan 11, 2024 • 6