unsloth
/

Falcon-H1-1.5B-Instruct-GGUF

Model card Files Files and versions

Falcon-H1-1.5B-Instruct-GGUF

26.2 GB

1 contributor

History: 30 commits

danielhanchen's picture

Upload folder using huggingface_hub

18b2d36 verified 4 months ago

.gitattributes

3.11 kB

Upload folder using huggingface_hub 4 months ago
Falcon-H1-1.5B-Instruct-BF16.gguf

3.11 GB
xet

Upload folder using huggingface_hub 4 months ago
Falcon-H1-1.5B-Instruct-IQ4_NL.gguf

916 MB
xet

Upload folder using huggingface_hub 4 months ago
Falcon-H1-1.5B-Instruct-IQ4_XS.gguf

876 MB
xet

Upload folder using huggingface_hub 4 months ago
Falcon-H1-1.5B-Instruct-Q2_K.gguf

612 MB
xet

Upload folder using huggingface_hub 4 months ago
Falcon-H1-1.5B-Instruct-Q2_K_L.gguf

644 MB
xet

Upload folder using huggingface_hub 4 months ago
Falcon-H1-1.5B-Instruct-Q3_K_M.gguf

765 MB
xet

Upload folder using huggingface_hub 4 months ago
Falcon-H1-1.5B-Instruct-Q3_K_S.gguf

725 MB
xet

Upload folder using huggingface_hub 4 months ago
Falcon-H1-1.5B-Instruct-Q4_0.gguf

916 MB
xet

Upload folder using huggingface_hub 4 months ago
Falcon-H1-1.5B-Instruct-Q4_1.gguf

1 GB
xet

Upload folder using huggingface_hub 4 months ago
Falcon-H1-1.5B-Instruct-Q4_K_M.gguf

945 MB
xet

Upload folder using huggingface_hub 4 months ago
Falcon-H1-1.5B-Instruct-Q4_K_S.gguf

918 MB
xet

Upload folder using huggingface_hub 4 months ago
Falcon-H1-1.5B-Instruct-Q5_K_M.gguf

1.11 GB
xet

Upload folder using huggingface_hub 4 months ago
Falcon-H1-1.5B-Instruct-Q5_K_S.gguf

1.09 GB
xet

Upload folder using huggingface_hub 4 months ago
Falcon-H1-1.5B-Instruct-Q6_K.gguf

1.28 GB
xet

Upload folder using huggingface_hub 4 months ago
Falcon-H1-1.5B-Instruct-Q8_0.gguf

1.66 GB
xet

Upload folder using huggingface_hub 4 months ago
Falcon-H1-1.5B-Instruct-UD-IQ1_M.gguf

462 MB
xet

Upload folder using huggingface_hub 4 months ago
Falcon-H1-1.5B-Instruct-UD-IQ1_S.gguf

435 MB
xet

Upload folder using huggingface_hub 4 months ago
Falcon-H1-1.5B-Instruct-UD-IQ2_M.gguf

591 MB
xet

Upload folder using huggingface_hub 4 months ago
Falcon-H1-1.5B-Instruct-UD-IQ2_XXS.gguf

504 MB
xet

Upload folder using huggingface_hub 4 months ago
Falcon-H1-1.5B-Instruct-UD-IQ3_XXS.gguf

657 MB
xet

Upload folder using huggingface_hub 4 months ago
Falcon-H1-1.5B-Instruct-UD-Q2_K_XL.gguf

659 MB
xet

Upload folder using huggingface_hub 4 months ago
Falcon-H1-1.5B-Instruct-UD-Q3_K_XL.gguf

802 MB
xet

Upload folder using huggingface_hub 4 months ago
Falcon-H1-1.5B-Instruct-UD-Q4_K_XL.gguf

962 MB
xet

Upload folder using huggingface_hub 4 months ago
Falcon-H1-1.5B-Instruct-UD-Q5_K_XL.gguf

1.11 GB
xet

Upload folder using huggingface_hub 4 months ago
Falcon-H1-1.5B-Instruct-UD-Q6_K_XL.gguf

1.41 GB
xet

Upload folder using huggingface_hub 4 months ago
Falcon-H1-1.5B-Instruct-UD-Q8_K_XL.gguf

2.06 GB
xet

Upload folder using huggingface_hub 4 months ago
README.md

5.73 kB

Upload folder using huggingface_hub 4 months ago
imatrix_unsloth.dat

2.02 MB
xet

Upload folder using huggingface_hub 4 months ago