Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

LnL-AI
/
Yi-6B-gptq-4bit

Text Generation
Transformers
llama
4-bit precision
gptq
Model card Files Files and versions
xet
Community
Yi-6B-gptq-4bit
3.93 GB
  • 3 contributors
History: 11 commits
LiuRuiLin
Update README.md
12f77ad verified over 1 year ago
  • .gitattributes
    1.52 kB
    initial commit over 1 year ago
  • README.md
    391 Bytes
    Update README.md over 1 year ago
  • cal_data_size.txt
    56 Bytes
    init over 1 year ago
  • config.json
    1.03 kB
    init over 1 year ago
  • gptq_model-4bit-128g.safetensors
    3.93 GB
    xet
    init over 1 year ago
  • quant.py
    6.45 kB
    add quant.py over 1 year ago
  • quantize_config.json
    267 Bytes
    init over 1 year ago
  • test.py
    622 Bytes
    Update test.py over 1 year ago
  • tokenizer.json
    3.56 MB
    init over 1 year ago
  • tokenizer.model
    1.03 MB
    xet
    init over 1 year ago