TheBloke
/

Mistral-7B-Instruct-v0.1-AWQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

TheBloke commited on Sep 27, 2023

Commit

e810603

·

1 Parent(s): 6644757

Update README.md

Files changed (1) hide show

README.md +2 -5

README.md CHANGED Viewed

@@ -92,15 +92,12 @@ Models are released as sharded safetensors files.
 Requires:
 - Transformers from [commit 72958fcd3c98a7afdc61f953aa58c544ebda2f79](https://github.com/huggingface/transformers/commit/72958fcd3c98a7afdc61f953aa58c544ebda2f79)
-- [AutoAWQ](https://github.com/casper-hansen/AutoAWQ) from [PR #79](https://github.com/casper-hansen/AutoAWQ/pull/79).
 ```shell
 pip3 install git+https://github.com/huggingface/transformers.git@72958fcd3c98a7afdc61f953aa58c544ebda2f79
-git clone https://github.com/casper-hansen/AutoAWQ
-cd AutoAWQ
-git checkout mistral
-pip3 install .
 ```
 ### You can then try the following example code

 Requires:
 - Transformers from [commit 72958fcd3c98a7afdc61f953aa58c544ebda2f79](https://github.com/huggingface/transformers/commit/72958fcd3c98a7afdc61f953aa58c544ebda2f79)
+- [AutoAWQ](https://github.com/casper-hansen/AutoAWQ) from [commit 1c5ccc791fa2cb0697db3b4070df1813f1736208](https://github.com/casper-hansen/AutoAWQ/commit/1c5ccc791fa2cb0697db3b4070df1813f1736208).
 ```shell
 pip3 install git+https://github.com/huggingface/transformers.git@72958fcd3c98a7afdc61f953aa58c544ebda2f79
+pip3 install git@https://github.com/casper-hansen/AutoAWQ.git@1c5ccc791fa2cb0697db3b4070df1813f1736208
 ```
 ### You can then try the following example code