unsloth
/

gemma-3-12b-it-GGUF

Model card Files Files and versions

gemma-3-12b-it-GGUF

200 GB

2 contributors

History: 57 commits

danielhanchen's picture

Create template

d15e4c7 verified 4 months ago

File

gemma-3-12b-it-Q4_K_M.gguf

0 Bytes

.gitattributes

3.64 kB

Upload folder using huggingface_hub 7 months ago
README.md

25 kB

Update README.md 9 months ago
config.json

1.67 kB

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-BF16.gguf

23.5 GB
xet

Add files using upload-large-folder tool 8 months ago
gemma-3-12b-it-IQ4_NL.gguf

6.89 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-IQ4_XS.gguf

6.55 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-Q2_K.gguf

4.77 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-Q2_K_L.gguf

4.77 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-Q3_K_M.gguf

6.01 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-Q3_K_S.gguf

5.46 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-Q4_0.gguf

6.91 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-Q4_1.gguf

7.56 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-Q4_K_M.gguf

7.3 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-Q4_K_S.gguf

6.94 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-Q5_K_M.gguf

8.45 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-Q5_K_S.gguf

8.23 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-Q6_K.gguf

9.66 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-Q8_0.gguf

12.5 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-UD-IQ1_M.gguf

3.25 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-UD-IQ1_S.gguf

3.06 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-UD-IQ2_M.gguf

4.37 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-UD-IQ2_XXS.gguf

3.6 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-UD-IQ3_XXS.gguf

4.83 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-UD-Q2_K_XL.gguf

4.86 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-UD-Q3_K_XL.gguf

6.14 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-UD-Q4_K_XL.gguf

7.43 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-UD-Q5_K_XL.gguf

8.46 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-UD-Q6_K_XL.gguf

10.6 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-UD-Q8_K_XL.gguf

14.4 GB
xet

Upload folder using huggingface_hub 7 months ago
imatrix_unsloth.dat

7.43 MB
xet

Upload folder using huggingface_hub 7 months ago
mmproj-BF16.gguf

854 MB
xet

Upload folder using huggingface_hub 7 months ago
mmproj-F16.gguf

854 MB
xet

Upload folder using huggingface_hub 7 months ago
mmproj-F32.gguf

1.68 GB
xet

Upload folder using huggingface_hub 7 months ago
params

201 Bytes

Update params 9 months ago
template

476 Bytes

Create template 4 months ago