bartowski
/

granite-20b-code-instruct-GGUF

Text Generation

Model card Files Files and versions

granite-20b-code-instruct-GGUF

406 GB

2 contributors

History: 18 commits

bartowski's picture

Upload granite-20b-code-instruct-Q3_K_XL.gguf with huggingface_hub

71f01b2 verified over 1 year ago

granite-20b-code-instruct-f32.gguf
Llamacpp quants over 1 year ago
.gitattributes

4.17 kB

Upload granite-20b-code-instruct-Q3_K_XL.gguf with huggingface_hub over 1 year ago
README.md

12.9 kB

Update README.md (#1) over 1 year ago
granite-20b-code-instruct-IQ1_M.gguf

4.91 GB
xet

Llamacpp quants over 1 year ago
granite-20b-code-instruct-IQ1_S.gguf

4.52 GB
xet

Llamacpp quants over 1 year ago
granite-20b-code-instruct-IQ2_M.gguf

7.05 GB
xet

Llamacpp quants over 1 year ago
granite-20b-code-instruct-IQ2_S.gguf

6.53 GB
xet

Llamacpp quants over 1 year ago
granite-20b-code-instruct-IQ2_XS.gguf

6.16 GB
xet

Llamacpp quants over 1 year ago
granite-20b-code-instruct-IQ2_XXS.gguf

5.57 GB
xet

Llamacpp quants over 1 year ago
granite-20b-code-instruct-IQ3_M.gguf

9.59 GB
xet

Llamacpp quants over 1 year ago
granite-20b-code-instruct-IQ3_S.gguf

8.93 GB
xet

Llamacpp quants over 1 year ago
granite-20b-code-instruct-IQ3_XS.gguf

8.66 GB
xet

Llamacpp quants over 1 year ago
granite-20b-code-instruct-IQ3_XXS.gguf

8.06 GB
xet

Llamacpp quants over 1 year ago
granite-20b-code-instruct-IQ4_NL.gguf

11.6 GB
xet

Llamacpp quants over 1 year ago
granite-20b-code-instruct-IQ4_XS.gguf

10.9 GB
xet

Upload granite-20b-code-instruct-IQ4_XS.gguf with huggingface_hub over 1 year ago
granite-20b-code-instruct-Q2_K.gguf

7.93 GB
xet

Llamacpp quants over 1 year ago
granite-20b-code-instruct-Q3_K_L.gguf

11.7 GB
xet

Llamacpp quants over 1 year ago
granite-20b-code-instruct-Q3_K_M.gguf

10.6 GB
xet

Llamacpp quants over 1 year ago
granite-20b-code-instruct-Q3_K_S.gguf

8.93 GB
xet

Llamacpp quants over 1 year ago
granite-20b-code-instruct-Q3_K_XL.gguf

11.8 GB
xet

Upload granite-20b-code-instruct-Q3_K_XL.gguf with huggingface_hub over 1 year ago
granite-20b-code-instruct-Q4_0.gguf

11.6 GB
xet

Upload granite-20b-code-instruct-Q4_0.gguf with huggingface_hub over 1 year ago
granite-20b-code-instruct-Q4_0_4_4.gguf

11.6 GB
xet

Upload granite-20b-code-instruct-Q4_0_4_4.gguf with huggingface_hub over 1 year ago
granite-20b-code-instruct-Q4_0_4_8.gguf

11.6 GB
xet

Upload granite-20b-code-instruct-Q4_0_4_8.gguf with huggingface_hub over 1 year ago
granite-20b-code-instruct-Q4_0_8_8.gguf

11.6 GB
xet

Upload granite-20b-code-instruct-Q4_0_8_8.gguf with huggingface_hub over 1 year ago
granite-20b-code-instruct-Q4_K_L.gguf

12.9 GB
xet

Upload granite-20b-code-instruct-Q4_K_L.gguf with huggingface_hub over 1 year ago
granite-20b-code-instruct-Q4_K_M.gguf

12.8 GB
xet

Upload granite-20b-code-instruct-Q4_K_M.gguf with huggingface_hub over 1 year ago
granite-20b-code-instruct-Q4_K_S.gguf

11.7 GB
xet

Upload granite-20b-code-instruct-Q4_K_S.gguf with huggingface_hub over 1 year ago
granite-20b-code-instruct-Q5_K_L.gguf

14.9 GB
xet

Upload granite-20b-code-instruct-Q5_K_L.gguf with huggingface_hub over 1 year ago
granite-20b-code-instruct-Q5_K_M.gguf

14.8 GB
xet

Upload granite-20b-code-instruct-Q5_K_M.gguf with huggingface_hub over 1 year ago
granite-20b-code-instruct-Q5_K_S.gguf

14 GB
xet

Upload granite-20b-code-instruct-Q5_K_S.gguf with huggingface_hub over 1 year ago
granite-20b-code-instruct-Q6_K.gguf

16.6 GB
xet

Upload granite-20b-code-instruct-Q6_K.gguf with huggingface_hub over 1 year ago
granite-20b-code-instruct-Q6_K_L.gguf

16.7 GB
xet

Upload granite-20b-code-instruct-Q6_K_L.gguf with huggingface_hub over 1 year ago
granite-20b-code-instruct-Q8_0.gguf

21.5 GB
xet

Upload granite-20b-code-instruct-Q8_0.gguf with huggingface_hub over 1 year ago
granite-20b-code-instruct.imatrix

8.95 MB
xet

Llamacpp quants over 1 year ago