ModelCloud/Marin-32B-Base-GPTQMODEL-W4A16

This 4bit W4A16 model has been quantized by @Qubitum at ModelCloud using GPT-QModel.

SPDX-License-Identifier: NonCommercial-ModelCloud
Copyright (c) 2024–2025 ModelCloud.ai
Released for non-profit use only.
Commercial use requires permission from [@qubitium](https://x.com/qubitium).

| Metric                         |   Marin  |
|--------------------------------|----------|
| arc_challenge :: acc,none      |   0.5725 |
| arc_challenge :: acc_norm,none |   0.6007 |
| mmlu_stem :: acc,none          |   0.667  |

Downloads last month: 7

Safetensors

Model size

33B params

Tensor type

BF16

I32

F32

Model tree for ModelCloud/Marin-32B-Base-GPTQMODEL-W4A16

Base model

marin-community/marin-32b-base

Quantized

(2)

this model

Collection including ModelCloud/Marin-32B-Base-GPTQMODEL-W4A16

Vortex

Collection

ModelCloud optimized and validated quants that pass/meet strict quality assurance on multiple benchmarks. No one quantize • 24 items • Updated about 6 hours ago • 10