Hugging Face's logo

ubergarm
/
DeepSeek-V3.1-GGUF

Text Generation
GGUF
mla
imatrix
deepseek_v3
conversational
ik_llama.cpp
Model card Files
xet
Community
5
DeepSeek-V3.1-GGUF

Commit History

Upload folder using huggingface_hub
42eb5f1
verified

ubergarm commited on

Add amazing new smol-IQ4_KSS
37c60ea

ubergarm commited on

Add bf16 baseline PPL
45f94db

ubergarm commited on

Upload folder using huggingface_hub
0ebff27
verified

ubergarm commited on

Add IQ2_KT
76e2324

ubergarm commited on

Upload folder using huggingface_hub
5ce5c08
verified

ubergarm commited on

Show "pure" Q4_0 for comparison
09ada9d

ubergarm commited on

Upload folder using huggingface_hub
1c6be34
verified

ubergarm commited on

Add IQ3_K
f794d72

ubergarm commited on

Upload folder using huggingface_hub
c0b0178
verified

ubergarm commited on

Uploading IQ4_KS and IQ4_K
031204a

ubergarm commited on

Okay the initial set is done
9fb301c

ubergarm commited on

Add IQ2_KS and more perplexity graph data
09ebb22

ubergarm commited on

Upload folder using huggingface_hub
7a974a1
verified

ubergarm commited on

Upload folder using huggingface_hub
5ef35ac
verified

ubergarm commited on

Add IQ1_KT
3e93ef4

ubergarm commited on

Upload folder using huggingface_hub
b01718a
verified

ubergarm commited on

add perplexity graph and upload more
2932dea

ubergarm commited on

Upload folder using huggingface_hub
8db025f
verified

ubergarm commited on

Upload folder using huggingface_hub
9c3c7bb
verified

ubergarm commited on

Uploading IQ2_KL and preparing IQ3_KS
e36bccf

ubergarm commited on

Add baseline Q8_0 perplexity
5758fb7

ubergarm commited on

Preparing IQ2_KL 231.206 GiB (2.960 BPW)
3cd82d5

ubergarm commited on

Upload folder using huggingface_hub
4971e3b
verified

ubergarm commited on

Add IQ1_S and some perplexity measurements.
8cd32c9

ubergarm commited on

Upload imatrix-DeepSeek-V3.1-Q8_0.dat with huggingface_hub
ddb6c8e
verified

ubergarm commited on

Add note to use `--chat-template deepseek3` for now
c0a0267

ubergarm commited on

Upload folder using huggingface_hub
049d0b2
verified

ubergarm commited on

Uploading iq5_k
1bfdad0

ubergarm commited on

Upload imatrix-DeepSeek-V3.1-Q8_0.dat with huggingface_hub
db827cc
verified

ubergarm commited on

initial commit
86255df

ubergarm commited on

initial commit
3ed8bb9
verified

ubergarm commited on