@wenhuach on Hugging Face: "AutoRound(https://github.com/intel/auto-round) has been integrated into…"

Hugging Face

Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Back to feed

wenhuach

posted an update Apr 30

Post

1941

AutoRound(https://github.com/intel/auto-round) has been integrated into Transformers, allowing you to run AutoRound-formatted models directly in the upcoming release. Additionally, we are actively working on supporting the GGUF double-quant format, e.g. q4_k_s, stay tuned!

https://huggingface.co/blog/autoround

In this post

wenhuach wenhua cheng