Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
eaddario
/
Hammer2.1-7b-GGUF
like
2
Text Generation
GGUF
eaddario/imatrix-calibration
English
quant
experimental
conversational
arxiv:
2410.04587
arxiv:
2406.17415
License:
cc-by-nc-4.0
Model card
Files
Files and versions
xet
Community
1
Deploy
Use this model
main
Hammer2.1-7b-GGUF
113 GB
1 contributor
History:
87 commits
eaddario
Update README.md
d90bfcf
verified
8 months ago
imatrix
Regenerate importance matrices
9 months ago
logits
Regenerate base model logits
9 months ago
scores
Add GGUF internal file structure
8 months ago
.gitattributes
Safe
1.65 kB
Update .gitattributes
11 months ago
.gitignore
Safe
6.78 kB
Update .gitignore
11 months ago
Hammer2.1-7b-F16.gguf
Safe
15.2 GB
xet
Convert to GGUF @ F16
11 months ago
Hammer2.1-7b-IQ3_M.gguf
3.48 GB
xet
Layer-wise quantization IQ3_M
8 months ago
Hammer2.1-7b-IQ3_S.gguf
3.25 GB
xet
Layer-wise quantization IQ3_S
8 months ago
Hammer2.1-7b-IQ4_NL.gguf
4.17 GB
xet
Layer-wise quantization IQ4_NL
8 months ago
Hammer2.1-7b-Q3_K_L.gguf
3.54 GB
xet
Layer-wise quantization Q3_K_L
8 months ago
Hammer2.1-7b-Q3_K_M.gguf
3.37 GB
xet
Layer-wise quantization Q3_K_M
8 months ago
Hammer2.1-7b-Q3_K_S.gguf
Safe
3.14 GB
xet
Layer-wise quantization Q3_K_S
8 months ago
Hammer2.1-7b-Q4_K_M.gguf
4.18 GB
xet
Layer-wise quantization Q4_K_M
8 months ago
Hammer2.1-7b-Q4_K_S.gguf
Safe
4.06 GB
xet
Layer-wise quantization Q4_K_S
8 months ago
Hammer2.1-7b-Q5_K_M.gguf
Safe
5.09 GB
xet
Layer-wise quantization Q5_K_M
8 months ago
Hammer2.1-7b-Q5_K_S.gguf
4.96 GB
xet
Layer-wise quantization Q5_K_S
8 months ago
Hammer2.1-7b-Q6_K.gguf
Safe
6.23 GB
xet
Layer-wise quantization Q6_K
8 months ago
Hammer2.1-7b-Q8_0.gguf
7.27 GB
xet
Layer-wise quantization Q8_0
8 months ago
README.md
Safe
16.1 kB
Update README.md
8 months ago