jojo1899
/

Llama-2-13b-chat-hf-ov-int4

Text Generation

Model card Files Files and versions

Llama-2-13b-chat-hf-ov-int4

6.72 GB

1 contributor

History: 7 commits

jojo1899's picture

Improved quantization using Openvino 2024.5.0rc1

0869f09 12 months ago

.gitattributes

1.52 kB

initial commit over 1 year ago
README.md

977 Bytes

Improved quantization using Openvino 2024.5.0rc1 12 months ago
config.json

801 Bytes

Improved quantization using Openvino 2024.5.0rc1 12 months ago
generation_config.json

193 Bytes

Improved quantization using Openvino 2024.5.0rc1 12 months ago
openvino_model.bin

6.71 GB
xet

Improved quantization using Openvino 2024.5.0rc1 12 months ago
openvino_model.xml

3.16 MB

Improved quantization using Openvino 2024.5.0rc1 12 months ago
special_tokens_map.json

414 Bytes

Improved quantization using Openvino 2024.5.0rc1 12 months ago
tokenizer.json

3.62 MB

Quantized using nncf 2.13.0 12 months ago
tokenizer.model

500 kB
xet

Improved quantization using Openvino 2024.5.0rc1 12 months ago
tokenizer_config.json

1.83 kB

Quantized using nncf 2.13.0 12 months ago