Hugging Face's logo

bartowski
/
OpenHermes-2.5-Mistral-7B-16k-exl2

English
mistral
instruct
finetune
chatml
gpt4
synthetic data
distillation
Model card Files
xet
Community
bartowski commited on
Commit
f48f828
·
1 Parent(s): 9275f4c

Add 4.0 link

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -27,6 +27,8 @@ Conversion was done using wikitext-103-raw-v1-test.parquet as calibration datase
27
 
28
  Original model: https://huggingface.co/NurtureAI/OpenHermes-2.5-Mistral-7B-16k
29
 
 
 
30
  <a href="https://huggingface.co/bartowski/OpenHermes-2.5-Mistral-7B-16k-exl2/tree/6_0">6.0 bits per weight</a>
31
 
32
  <a href="https://huggingface.co/bartowski/OpenHermes-2.5-Mistral-7B-16k-exl2/tree/8_0">8.0 bits per weight</a>
 
27
 
28
  Original model: https://huggingface.co/NurtureAI/OpenHermes-2.5-Mistral-7B-16k
29
 
30
+ <a href="https://huggingface.co/bartowski/OpenHermes-2.5-Mistral-7B-16k-exl2/tree/4_0">4.0 bits per weight</a>
31
+
32
  <a href="https://huggingface.co/bartowski/OpenHermes-2.5-Mistral-7B-16k-exl2/tree/6_0">6.0 bits per weight</a>
33
 
34
  <a href="https://huggingface.co/bartowski/OpenHermes-2.5-Mistral-7B-16k-exl2/tree/8_0">8.0 bits per weight</a>