Hugging Face's logo

numen-tech
/
gemma-2-2b-it-w4a16g128asym

Text Generation
MLC-LLM
conversational
4-bit precision
Model card Files
xet
Community

4-bit OmniQuant quantized version of gemma-2-2b-it.

Downloads last month
-
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for numen-tech/gemma-2-2b-it-w4a16g128asym

Base model

google/gemma-2-2b
Finetuned
google/gemma-2-2b-it
Quantized
(166)
this model