Source: https://huggingface.co/agentica-org/DeepScaleR-1.5B-Preview
quant_config = {
"zero_point": True,
"q_group_size": 128,
"w_bit": 4,
"version": "GEMM",
}
- Downloads last month
- -
Source: https://huggingface.co/agentica-org/DeepScaleR-1.5B-Preview
quant_config = {
"zero_point": True,
"q_group_size": 128,
"w_bit": 4,
"version": "GEMM",
}