OpenCodeReasoning-Nemotron-1.1-32B-AWQ
Method
Quantised using casper-hansen/AutoAWQ and the following configs:
quant_config = { "zero_point": True, "q_group_size": 128, "w_bit": 4, "version": "GEMM" }
- Downloads last month
- 1
Model tree for cpatonn/OpenCodeReasoning-Nemotron-1.1-32B-AWQ-4bit
Base model
Qwen/Qwen2.5-32B
Finetuned
Qwen/Qwen2.5-32B-Instruct