billatsectorflow
/

Qwen2.5-72B-Instruct-GPTQ-Int4-128K

Text Generation

4-bit precision

Model card Files Files and versions

billatsectorflow commited on Sep 25, 2024

Commit

458efa4

·

verified ·

1 Parent(s): 6a13298

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -11,7 +11,7 @@ tags:
 ---
 ---
-## Simple config.json modification of original model to enable 128K context window, necessary as per: https://huggingface.co/Qwen/Qwen2.5-72B-Instruct-GPTQ-Int4#processing-long-texts
 ---

 ---
 ---
+## Simple config.json modification of original model to enable 128K context window (rope scaling factor of 4.0), necessary as per: https://huggingface.co/Qwen/Qwen2.5-72B-Instruct-GPTQ-Int4#processing-long-texts
 ---