LnL-AI
/

Yi-6B-gptq-4bit

Text Generation

4-bit precision

Model card Files Files and versions

LiuRuiLin commited on Mar 29, 2024

Commit

12f77ad

·

verified ·

1 Parent(s): 3b8e6d7

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -2,7 +2,7 @@
 license: unknown
 ---
-This is TinyLlama/TinyLlama-1.1B-Chat-v1.0 quantized with AutoGPTQ in 4-bit.
 **Quantize config:**
 "bits": 4,
@@ -14,5 +14,5 @@ This is TinyLlama/TinyLlama-1.1B-Chat-v1.0 quantized with AutoGPTQ in 4-bit.
 "true_sequential": true,
 "model_name_or_path": null,
 "model_file_base_name": null,
-"checkpoint_format": "gptq",
 "quant_method": "gptq"

 license: unknown
 ---
+This is 01-ai/Yi-6B quantized with AutoGPTQ in 4-bit.
 **Quantize config:**
 "bits": 4,
 "true_sequential": true,
 "model_name_or_path": null,
 "model_file_base_name": null,
+"is_marlin_format": true,
 "quant_method": "gptq"