Hugging Face's logo

unsloth
/
DeepSeek-R1-Distill-Llama-70B-GGUF

Text Generation
Transformers
GGUF
English
llama
deepseek
unsloth
llama-3
meta
imatrix
conversational
Model card Files
xet
Community
2
danielhanchen commited on
Commit
045cd05
·
verified ·
1 Parent(s): 3f97ef3

Upload folder using huggingface_hub

Browse files
Files changed (8) hide show
  1. .gitattributes +7 -0
  2. DeepSeek-R1-Distill-Llama-70B-Q4_K_S.gguf +3 -0
  3. DeepSeek-R1-Distill-Llama-70B-Q5_K_S.gguf +3 -0
  4. DeepSeek-R1-Distill-Llama-70B-UD-Q5_K_XL.gguf +3 -0
  5. UD-Q6_K_XL/DeepSeek-R1-Distill-Llama-70B-UD-Q6_K_XL-00001-of-00002.gguf +3 -0
  6. UD-Q6_K_XL/DeepSeek-R1-Distill-Llama-70B-UD-Q6_K_XL-00002-of-00002.gguf +3 -0
  7. UD-Q8_K_XL/DeepSeek-R1-Distill-Llama-70B-UD-Q8_K_XL-00001-of-00002.gguf +3 -0
  8. UD-Q8_K_XL/DeepSeek-R1-Distill-Llama-70B-UD-Q8_K_XL-00002-of-00002.gguf +3 -0
.gitattributes CHANGED
@@ -60,3 +60,10 @@ DeepSeek-R1-Distill-Llama-70B-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
60
  DeepSeek-R1-Distill-Llama-70B-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
61
  DeepSeek-R1-Distill-Llama-70B-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
62
  DeepSeek-R1-Distill-Llama-70B-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
60
  DeepSeek-R1-Distill-Llama-70B-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
61
  DeepSeek-R1-Distill-Llama-70B-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
62
  DeepSeek-R1-Distill-Llama-70B-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
63
+ DeepSeek-R1-Distill-Llama-70B-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
64
+ DeepSeek-R1-Distill-Llama-70B-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
65
+ DeepSeek-R1-Distill-Llama-70B-UD-Q5_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
66
+ UD-Q6_K_XL/DeepSeek-R1-Distill-Llama-70B-UD-Q6_K_XL-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
67
+ UD-Q6_K_XL/DeepSeek-R1-Distill-Llama-70B-UD-Q6_K_XL-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
68
+ UD-Q8_K_XL/DeepSeek-R1-Distill-Llama-70B-UD-Q8_K_XL-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
69
+ UD-Q8_K_XL/DeepSeek-R1-Distill-Llama-70B-UD-Q8_K_XL-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Distill-Llama-70B-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8edb362096781223c5efe7f2024749bb91032301d2517a84a3084686a20fd1ce
3
+ size 40347222688
DeepSeek-R1-Distill-Llama-70B-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:acaa898c4e4ed8e183ef22b767902a4f3f2a1735343002d2c2747eb1f685bb8f
3
+ size 48657449632
DeepSeek-R1-Distill-Llama-70B-UD-Q5_K_XL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:74dba0362592f858706fa0f2c301ec1b40474df40593c88bf9fd089b499887f5
3
+ size 49973478048
UD-Q6_K_XL/DeepSeek-R1-Distill-Llama-70B-UD-Q6_K_XL-00001-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f8b68da3fb158a918e33058fb5a4bc4c7471d3cba8e6050318e7d14138ce3cdb
3
+ size 49958216864
UD-Q6_K_XL/DeepSeek-R1-Distill-Llama-70B-UD-Q6_K_XL-00002-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a42dd8db3273514993575320bc9c46ba7415e774b99b999fd50ebbef4c5d1f72
3
+ size 11201847008
UD-Q8_K_XL/DeepSeek-R1-Distill-Llama-70B-UD-Q8_K_XL-00001-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c6c5f4c7ca993d832328fbedfb9ee6f7ba7aeebc1a2d69a4d9949806088d21e
3
+ size 49859838176
UD-Q8_K_XL/DeepSeek-R1-Distill-Llama-70B-UD-Q8_K_XL-00002-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:07188815c0dbe7ed7f044cc439cea3ccd7e836b9c9c3536fa523e2dfc046aecc
3
+ size 31371281024