TheBloke
/

Mistral-7B-Instruct-v0.1-AWQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Resources

View closed (1)

Update README.md

#7 opened almost 2 years ago by

Inference Speed Compared to ExLlama?

#6 opened almost 2 years ago by

32g Version

#5 opened almost 2 years ago by

How to use this AWQ model from Python code gives an error.

#4 opened almost 2 years ago by

AWQ models with transformer pipeline

#3 opened about 2 years ago by

Prompt for RAG

#2 opened about 2 years ago by