TheBloke
/

h2ogpt-oasst1-512-30B-GGML

Model card Files Files and versions

h2ogpt-oasst1-512-30B-GGML

201 GB

1 contributor

History: 15 commits

TheBloke's picture

New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48

d6368a2 over 2 years ago

.gitattributes

1.48 kB

initial commit over 2 years ago
README.md

15.2 kB

New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48 over 2 years ago
h2ogptq-oasst1-512-30B.ggml.q4_0.bin

20.3 GB
xet

Updated GGMLs for latest llama.cpp May 12th quantisation methods. over 2 years ago
h2ogptq-oasst1-512-30B.ggml.q4_1.bin

24.4 GB
xet

Updated GGMLs for latest llama.cpp May 12th quantisation methods. over 2 years ago
h2ogptq-oasst1-512-30B.ggml.q5_0.bin

22.4 GB
xet

Updated GGMLs for latest llama.cpp May 12th quantisation methods. over 2 years ago
h2ogptq-oasst1-512-30B.ggml.q5_1.bin

24.4 GB
xet

Updated GGMLs for latest llama.cpp May 12th quantisation methods. over 2 years ago
h2ogptq-oasst1-512-30B.ggml.q8_0.bin

36.6 GB
xet

Updated GGMLs for latest llama.cpp May 12th quantisation methods. over 2 years ago
h2ogptq-oasst1-512-30B.ggmlv3.q4_0.bin

18.3 GB
xet

New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48 over 2 years ago
h2ogptq-oasst1-512-30B.ggmlv3.q4_1.bin

20.3 GB
xet

New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48 over 2 years ago
h2ogptq-oasst1-512-30B.ggmlv3.q8_0.bin

34.6 GB
xet

New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48 over 2 years ago