Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
second-state
/
llm-compiler-7b-GGUF
like
1
Follow
Second State
251
Text Generation
Transformers
GGUF
code
llama
License:
other
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
llm-compiler-7b-GGUF
64.4 GB
1 contributor
History:
6 commits
apepkuss79
Update README.md
fbf86fa
verified
over 1 year ago
.gitattributes
Safe
2.34 kB
Update models
over 1 year ago
README.md
Safe
4.19 kB
Update README.md
over 1 year ago
config.json
Safe
641 Bytes
Upload config.json with huggingface_hub
over 1 year ago
llm-compiler-7b-Q2_K.gguf
2.53 GB
xet
Update models
over 1 year ago
llm-compiler-7b-Q3_K_L.gguf
3.6 GB
xet
Update models
over 1 year ago
llm-compiler-7b-Q3_K_M.gguf
3.3 GB
xet
Update models
over 1 year ago
llm-compiler-7b-Q3_K_S.gguf
2.95 GB
xet
Update models
over 1 year ago
llm-compiler-7b-Q4_0.gguf
3.83 GB
xet
Update models
over 1 year ago
llm-compiler-7b-Q4_K_M.gguf
4.08 GB
xet
Update models
over 1 year ago
llm-compiler-7b-Q4_K_S.gguf
3.86 GB
xet
Update models
over 1 year ago
llm-compiler-7b-Q5_0.gguf
4.65 GB
xet
Update models
over 1 year ago
llm-compiler-7b-Q5_K_M.gguf
4.78 GB
xet
Update models
over 1 year ago
llm-compiler-7b-Q5_K_S.gguf
4.65 GB
xet
Update models
over 1 year ago
llm-compiler-7b-Q6_K.gguf
Safe
5.53 GB
xet
Update models
over 1 year ago
llm-compiler-7b-Q8_0.gguf
7.16 GB
xet
Update models
over 1 year ago
llm-compiler-7b-f16.gguf
13.5 GB
xet
Update models
over 1 year ago
