| license: apache-2.0 | |
| pipeline_tag: text-generation | |
| Source: https://huggingface.co/agentica-org/DeepScaleR-1.5B-Preview | |
| ```python | |
| quant_config = { | |
| "zero_point": True, | |
| "q_group_size": 128, | |
| "w_bit": 4, | |
| "version": "GEMM", | |
| } | |
| ``` |
| license: apache-2.0 | |
| pipeline_tag: text-generation | |
| Source: https://huggingface.co/agentica-org/DeepScaleR-1.5B-Preview | |
| ```python | |
| quant_config = { | |
| "zero_point": True, | |
| "q_group_size": 128, | |
| "w_bit": 4, | |
| "version": "GEMM", | |
| } | |
| ``` |