Mungert
/

Llama-3.2-3B-Instruct-GGUF

Text Generation

Model card Files Files and versions

Llama-3.2-3B-Instruct-GGUF

62.7 GB

1 contributor

History: 1 commit

Mungert's picture

Super-squash history to reclaim storage

33c4f3d verified 3 months ago

.gitattributes

3.9 kB

Super-squash history to reclaim storage 3 months ago
Llama-3.2-3B-Instruct-bf16-q4_k.gguf

2.48 GB
xet

Super-squash history to reclaim storage 3 months ago
Llama-3.2-3B-Instruct-bf16-q6_k.gguf

3.11 GB
xet

Super-squash history to reclaim storage 3 months ago
Llama-3.2-3B-Instruct-bf16-q8_0.gguf

3.79 GB
xet

Super-squash history to reclaim storage 3 months ago
Llama-3.2-3B-Instruct-bf16.gguf

6.43 GB
xet

Super-squash history to reclaim storage 3 months ago
Llama-3.2-3B-Instruct-f16-q4_k.gguf

2.48 GB
xet

Super-squash history to reclaim storage 3 months ago
Llama-3.2-3B-Instruct-f16-q6_k.gguf

3.11 GB
xet

Super-squash history to reclaim storage 3 months ago
Llama-3.2-3B-Instruct-f16-q8_0.gguf

3.79 GB
xet

Super-squash history to reclaim storage 3 months ago
Llama-3.2-3B-Instruct-iq2_m.gguf

1.33 GB
xet

Super-squash history to reclaim storage 3 months ago
Llama-3.2-3B-Instruct-iq2_s.gguf

1.28 GB
xet

Super-squash history to reclaim storage 3 months ago
Llama-3.2-3B-Instruct-iq2_xs.gguf

1.14 GB
xet

Super-squash history to reclaim storage 3 months ago
Llama-3.2-3B-Instruct-iq2_xxs.gguf

1.07 GB
xet

Super-squash history to reclaim storage 3 months ago
Llama-3.2-3B-Instruct-iq3_m.gguf

1.55 GB
xet

Super-squash history to reclaim storage 3 months ago
Llama-3.2-3B-Instruct-iq3_s.gguf

1.49 GB
xet

Super-squash history to reclaim storage 3 months ago
Llama-3.2-3B-Instruct-iq3_xs.gguf

1.42 GB
xet

Super-squash history to reclaim storage 3 months ago
Llama-3.2-3B-Instruct-iq3_xxs.gguf

1.35 GB
xet

Super-squash history to reclaim storage 3 months ago
Llama-3.2-3B-Instruct-iq4_nl.gguf

1.92 GB
xet

Super-squash history to reclaim storage 3 months ago
Llama-3.2-3B-Instruct-iq4_xs.gguf

1.83 GB
xet

Super-squash history to reclaim storage 3 months ago
Llama-3.2-3B-Instruct-q2_k_s.gguf

1.22 GB
xet

Super-squash history to reclaim storage 3 months ago
Llama-3.2-3B-Instruct-q3_k_m.gguf

1.63 GB
xet

Super-squash history to reclaim storage 3 months ago
Llama-3.2-3B-Instruct-q3_k_s.gguf

1.49 GB
xet

Super-squash history to reclaim storage 3 months ago
Llama-3.2-3B-Instruct-q4_0.gguf

2.01 GB
xet

Super-squash history to reclaim storage 3 months ago
Llama-3.2-3B-Instruct-q4_1.gguf

2.19 GB
xet

Super-squash history to reclaim storage 3 months ago
Llama-3.2-3B-Instruct-q4_k_m.gguf

2.02 GB
xet

Super-squash history to reclaim storage 3 months ago
Llama-3.2-3B-Instruct-q4_k_s.gguf

1.93 GB
xet

Super-squash history to reclaim storage 3 months ago
Llama-3.2-3B-Instruct-q5_k_m.gguf

2.32 GB
xet

Super-squash history to reclaim storage 3 months ago
Llama-3.2-3B-Instruct-q5_k_s.gguf

2.27 GB
xet

Super-squash history to reclaim storage 3 months ago
Llama-3.2-3B-Instruct-q6_k_m.gguf

2.64 GB
xet

Super-squash history to reclaim storage 3 months ago
Llama-3.2-3B-Instruct-q8_0.gguf

3.42 GB
xet

Super-squash history to reclaim storage 3 months ago
Llama-3.2-3B-Instruct.imatrix

2.99 MB
xet

Super-squash history to reclaim storage 3 months ago
README.md

53.7 kB

Super-squash history to reclaim storage 3 months ago