IQuest-Coder-V1-7B-Thinking
Collection
Quantized versions of IQuest-Coder-V1-7B-Thinking (GGUF, FP8, INT4, INT8,mlx-8bit). • 5 items • Updated
This repository contains GGUF quantized versions of IQuestLab/IQuest-Coder-V1-7B-Thinking.
Please refer to the original model page for usage instructions.
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
16-bit
Base model
IQuestLab/IQuest-Coder-V1-7B-Thinking