Models

wirthdrew1/zephyr-7b-dpo-qlora

Updated Jan 21, 2024 • 29 • 1

mimicheng/mistral-7b-dpo-qlora-2ep

Updated Jan 19, 2024 • 16

Evan-Lin/dpo-test

Updated Jan 20, 2024 • 6

dctanner/sablo-pebble-mistral-dpo-lora-HelpSteer_binarized-2

Updated Jan 19, 2024 • 13

thobuiq/teamtrack-ai

Text Generation • 3.41M • Updated Jan 24, 2024 • 14

ondevicellm/tinyllama_moe_dpo_ultrachat_v2_epochs5

Text Generation • 6B • Updated Jan 22, 2024 • 23

metric-space/arceeai-cpt-sft-dpo-full

Text Generation • 8B • Updated Jan 20, 2024 • 17

Ram07/mistral-dpo

Text Generation • Updated Jan 21, 2024

weijie210/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 29, 2024 • 11

Evan-Lin/dpo-llama2

Updated Jan 20, 2024 • 3

Evan-Lin/dpo-llama2-deprecated

Updated Jan 22, 2024 • 6

ondevicellm/tinyllama_moe_dpo_ultrachat_v2_epochs3

Text Generation • 6B • Updated Jan 23, 2024 • 14

AlekseyKorshuk/evol-codealpaca-pairwise-sharegpt-test-dpo

Text Generation • 3B • Updated Jan 23, 2024 • 9

Evan-Lin/results

Updated Jan 22, 2024 • 2

dball/zephyr-7b-dpo-qlora

Updated Jan 25, 2024 • 28

thobuiq/openhermes-mistral-dpo-gptq

Text Generation • 3.41M • Updated Jan 24, 2024 • 8

Sharathhebbar24/chat_gpt2_dpo

Text Generation • 0.1B • Updated May 9, 2024 • 67 • 1

ayoubkirouane/Mistral-SLERP-Merged7B-DPO

Text Generation • Updated Jan 24, 2024 • 9

bartowski/zephyr-7b-dpo-full-exl2

Text Generation • Updated Jan 24, 2024 • 4 • 1

argilla/phi2-lora-distilabel-intel-orca-dpo-pairs

Text Generation • Updated Jan 25, 2024 • 11 • 2

janhq/llamacorn-1.1b-chat-GGUF

1B • Updated Jan 25, 2024 • 20 • 1

dvilasuero/phi2-lora-quantized-distilabel-intel-orca-dpo-pairs

Updated Jan 25, 2024 • 4

dlibf/zephyr-7b-dpo-full_sft3epoch

Text Generation • 7B • Updated Jan 26, 2024 • 8

dlibf/zephyr-7b-dpo-full_sft2epoch

Text Generation • 7B • Updated Jan 29, 2024 • 6

AlekseyKorshuk/evol-codealpaca-v1-sft-4e-5-dpo-3ep

Text Generation • 3B • Updated Jan 26, 2024 • 6

ondevicellm/tinyllama_mole_dpo_ep3

Text Generation • 1B • Updated Jan 26, 2024 • 17

AlekseyKorshuk/ultrachat-phi-2-dpo-chatml

Text Generation • 3B • Updated Jan 27, 2024 • 6 • 1

smangrul/mistral-dpo

Updated Jan 27, 2024 • 4

BramVanroy/GEITje-7B-ultra

Text Generation • 7B • Updated Dec 6, 2024 • 23.4k • 49

Evan-Lin/dpo-llama-chat

Updated Jan 28, 2024 • 6