Hugging Face's logo

tiiuae
/
Falcon-H1-7B-Instruct-GGUF

Transformers
GGUF
falcon-h1
conversational
Model card Files
xet
Community
1
ybelkada commited on
Commit
b4e25c8
·
verified ·
1 Parent(s): 50594fe

Add files using upload-large-folder tool

Browse files
Files changed (12) hide show
  1. .gitattributes +6 -0
  2. Falcon-H1-7B-Instruct-Q4_0.gguf +3 -0
  3. Falcon-H1-7B-Instruct-Q4_1.gguf +3 -0
  4. Falcon-H1-7B-Instruct-Q4_K.gguf +3 -0
  5. Falcon-H1-7B-Instruct-Q4_K_M.gguf +3 -0
  6. Falcon-H1-7B-Instruct-Q4_K_S.gguf +3 -0
  7. Falcon-H1-7B-Instruct-Q5_0.gguf +3 -0
  8. Falcon-H1-7B-Instruct-Q5_1.gguf +3 -0
  9. Falcon-H1-7B-Instruct-Q5_K.gguf +3 -0
  10. Falcon-H1-7B-Instruct-Q5_K_M.gguf +3 -0
  11. Falcon-H1-7B-Instruct-Q5_K_S.gguf +3 -0
  12. Falcon-H1-7B-Instruct-Q6_K.gguf +3 -0
.gitattributes CHANGED
@@ -63,3 +63,9 @@ Falcon-H1-7B-Instruct-Q3_K.gguf filter=lfs diff=lfs merge=lfs -text
63
  Falcon-H1-7B-Instruct-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
64
  Falcon-H1-7B-Instruct-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
65
  Falcon-H1-7B-Instruct-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
63
  Falcon-H1-7B-Instruct-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
64
  Falcon-H1-7B-Instruct-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
65
  Falcon-H1-7B-Instruct-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
66
+ Falcon-H1-7B-Instruct-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
67
+ Falcon-H1-7B-Instruct-Q4_K.gguf filter=lfs diff=lfs merge=lfs -text
68
+ Falcon-H1-7B-Instruct-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
69
+ Falcon-H1-7B-Instruct-Q5_K.gguf filter=lfs diff=lfs merge=lfs -text
70
+ Falcon-H1-7B-Instruct-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
71
+ Falcon-H1-7B-Instruct-Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-7B-Instruct-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c11628e3e5c29c646265646e39958abd5ed78f8f19d3c8a791eb4cab499e1214
3
+ size 4379778400
Falcon-H1-7B-Instruct-Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e2b44c83e98fad2d65dd5b16e0c673b44df9577532f0b628be6d93259f6f078
3
+ size 4828837408
Falcon-H1-7B-Instruct-Q4_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:38bb7a4ded5d4fe9e6d5f0fc493738784729120e362b96c2d9180ddd1be226f3
3
+ size 4598345056
Falcon-H1-7B-Instruct-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:38bb7a4ded5d4fe9e6d5f0fc493738784729120e362b96c2d9180ddd1be226f3
3
+ size 4598345056
Falcon-H1-7B-Instruct-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4d4a7b12b569f5cf805b0c89cb5ace853f00f258ce049f73fed53b1b05ce3483
3
+ size 4403764576
Falcon-H1-7B-Instruct-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ee5adf45344469dd0cfb46d7461d727328271b1a4079e022e30583dffdf89f01
3
+ size 5277896416
Falcon-H1-7B-Instruct-Q5_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:848c1d8077d57057f605f14414016021b80d01879a5b58ea6d12ab5056a88923
3
+ size 5726955424
Falcon-H1-7B-Instruct-Q5_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d8de3e4613948a08ed6a6e7a5b2d70409e9f5d178e8d7b576cab4cd21f6c25d6
3
+ size 5390491360
Falcon-H1-7B-Instruct-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d8de3e4613948a08ed6a6e7a5b2d70409e9f5d178e8d7b576cab4cd21f6c25d6
3
+ size 5390491360
Falcon-H1-7B-Instruct-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a69c7a3acef4eb786aa6d975e86367cfd74d51bfea45167c1b2a2349641f5787
3
+ size 5277896416
Falcon-H1-7B-Instruct-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cb974ebf3a9d59eb4b9bbe0a63f3ff95773373668a9b24e4c9a24f30b9eb2358
3
+ size 6232146816