RedHatAI
/

Qwen2.5-0.5B-quantized.w8a8

Text Generation

8-bit precision

compressed-tensors

Model card Files Files and versions

Qwen2.5-0.5B-quantized.w8a8 / evaluate_qwen2.5_w4a16.sh

Commit History

Upload folder using huggingface_hub

1a552f6
verified

alexmarques commited on Oct 9, 2024