Update README.md
Browse files
README.md
CHANGED
|
@@ -36,7 +36,9 @@ tags:
|
|
| 36 |
|
| 37 |
## EXL3 Quants of unsloth/Magistral-Small-2509
|
| 38 |
|
| 39 |
-
EXL3 quants of [unsloth/Magistral-Small-2509](https://huggingface.co/
|
|
|
|
|
|
|
| 40 |
|
| 41 |
### Quants
|
| 42 |
| Quant(Revision) | Bits per Weight | Head Bits |
|
|
|
|
| 36 |
|
| 37 |
## EXL3 Quants of unsloth/Magistral-Small-2509
|
| 38 |
|
| 39 |
+
EXL3 quants of [unsloth/Magistral-Small-2509](https://huggingface.co/mistralai/Magistral-Small-2509) using <a href="https://github.com/turboderp-org/exllamav3/">exllamav3</a> for quantization.
|
| 40 |
+
|
| 41 |
+
Based on the HF conversion of the base Magistral model by [unsloth](https://huggingface.co/unsloth): [unsloth/Magistral-Small-2509](https://huggingface.co/unsloth/Magistral-Small-2509)
|
| 42 |
|
| 43 |
### Quants
|
| 44 |
| Quant(Revision) | Bits per Weight | Head Bits |
|