unsloth
/

granite-4.0-h-small-GGUF

Model card Files Files and versions

granite-4.0-h-small-GGUF

537 GB

2 contributors

History: 95 commits

danielhanchen's picture

Update params

4e40885 verified 18 days ago

BF16
Upload folder using huggingface_hub 18 days ago
.gitattributes

3.55 kB

Upload folder using huggingface_hub 23 days ago
README.md

35.8 kB

Update README.md 22 days ago
granite-4.0-h-small-IQ4_NL.gguf

18.4 GB
xet

Upload folder using huggingface_hub 18 days ago
granite-4.0-h-small-IQ4_XS.gguf

17.4 GB
xet

Upload folder using huggingface_hub 18 days ago
granite-4.0-h-small-Q2_K.gguf

12 GB
xet

Upload folder using huggingface_hub 18 days ago
granite-4.0-h-small-Q2_K_L.gguf

12 GB
xet

Upload folder using huggingface_hub 18 days ago
granite-4.0-h-small-Q3_K_M.gguf

15.5 GB
xet

Upload folder using huggingface_hub 18 days ago
granite-4.0-h-small-Q3_K_S.gguf

14.2 GB
xet

Upload folder using huggingface_hub 18 days ago
granite-4.0-h-small-Q4_0.gguf

18.5 GB
xet

Upload folder using huggingface_hub 18 days ago
granite-4.0-h-small-Q4_1.gguf

20.3 GB
xet

Upload folder using huggingface_hub 18 days ago
granite-4.0-h-small-Q4_K_M.gguf

19.6 GB
xet

Upload folder using huggingface_hub 18 days ago
granite-4.0-h-small-Q4_K_S.gguf

18.5 GB
xet

Upload folder using huggingface_hub 18 days ago
granite-4.0-h-small-Q5_K_M.gguf

22.9 GB
xet

Upload folder using huggingface_hub 18 days ago
granite-4.0-h-small-Q5_K_S.gguf

22.3 GB
xet

Upload folder using huggingface_hub 18 days ago
granite-4.0-h-small-Q6_K.gguf

26.5 GB
xet

Upload folder using huggingface_hub 18 days ago
granite-4.0-h-small-Q8_0.gguf

34.3 GB
xet

Upload folder using huggingface_hub 18 days ago
granite-4.0-h-small-UD-IQ1_M.gguf

10.1 GB
xet

Upload folder using huggingface_hub 18 days ago
granite-4.0-h-small-UD-IQ1_S.gguf

9.59 GB
xet

Upload folder using huggingface_hub 18 days ago
granite-4.0-h-small-UD-IQ2_M.gguf

11.6 GB
xet

Upload folder using huggingface_hub 18 days ago
granite-4.0-h-small-UD-IQ2_XXS.gguf

10.9 GB
xet

Upload folder using huggingface_hub 18 days ago
granite-4.0-h-small-UD-IQ3_XXS.gguf

13.7 GB
xet

Upload folder using huggingface_hub 18 days ago
granite-4.0-h-small-UD-Q2_K_XL.gguf

12.4 GB
xet

Upload folder using huggingface_hub 18 days ago
granite-4.0-h-small-UD-Q3_K_XL.gguf

14.6 GB
xet

Upload folder using huggingface_hub 18 days ago
granite-4.0-h-small-UD-Q4_K_XL.gguf

18.8 GB
xet

Upload folder using huggingface_hub 18 days ago
granite-4.0-h-small-UD-Q5_K_XL.gguf

23.1 GB
xet

Upload folder using huggingface_hub 18 days ago
granite-4.0-h-small-UD-Q6_K_XL.gguf

27.9 GB
xet

Upload folder using huggingface_hub 18 days ago
granite-4.0-h-small-UD-Q8_K_XL.gguf

38.1 GB
xet

Upload folder using huggingface_hub 18 days ago
granite-4.0-h-small-UD-TQ1_0.gguf

8.71 GB
xet

Upload folder using huggingface_hub 18 days ago
imatrix_unsloth.gguf_file

108 MB
xet

Upload folder using huggingface_hub 18 days ago
params

93 Bytes

Update params 18 days ago
template

7.08 kB

Update template 18 days ago