RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w8a8 Text Generation • 24B • Updated Sep 22 • 70 • 1
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autoround-int4-gs128-asym Text Generation • 4B • Updated Mar 21
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autoround-int4-gs128-sym Text Generation • 4B • Updated Mar 21
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autogptq-int4-gs128-asym Text Generation • 4B • Updated Mar 21
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autogptq-int4-gs128-sym Text Generation • 4B • Updated Mar 21 • 1
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autoawq-int4-gs128-asym Text Generation • 4B • Updated Mar 21 • 1
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autoawq-int4-gs128-sym Text Generation • 4B • Updated Mar 21
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autoround-int8-gs128-asym Text Generation • 7B • Updated Mar 27
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autoround-int8-gs128-sym Text Generation • 7B • Updated Mar 27
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autogptq-int8-gs128-asym Text Generation • 7B • Updated Mar 27
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autogptq-int8-gs128-sym Text Generation • 7B • Updated Mar 27 • 2