---
name: comma-v0.1-2t-MLX-Q8
base_model: common-pile/comma-v0.1-2t
license: apache-2.0
tags:
- Comma
- MLX
- EleutherAI
- Llama
- Meta
pipeline_tag: text-generation
size:
- 7440657364
- 7.35GB
datasets: common-pile/comma_v0.1_training_dataset
tasks:
- text-generation
- text-to-text
- text2text-generation
language: en
library_name: mlx
funded_by:
- Mozilla Foundation
- Sutter Hill Ventures
- Natural Sciences and Engineering Research Council of Canada (NSERC-CSE)
hardware_type: 50% 64 H100s / 50% LLNL El Capitan
training_time: 18 days @ 700W
co2_emitted:  17102 lb/7757kg CO2eq
get_started_code: uvx --from mlx-lm mlx_lm.generate --model "darkshapes/comma-v0.1-2t-MLX-Q8"
  --prompt 'Test prompt'
---
> [!IMPORTANT]
> Original Model Link : [https://huggingface.co/common-pile/comma-v0.1-2t](https://huggingface.co/common-pile/comma-v0.1-2t)
> 

```
name: comma-v0.1-2t-MLX-Q8
base_model: common-pile/comma-v0.1-2t
license: apache-2.0
tags:
- Comma
- MLX
- EleutherAI
- Llama
- Meta
pipeline_tag: text-generation
size:
- 7440657364
- 7.35GB
datasets: common-pile/comma_v0.1_training_dataset
tasks :
 - text-generation
 - text-to-text
 - text2text-generation
language: en
library_name: mlx
funded_by:
- Mozilla Foundation
- Sutter Hill Ventures
- Natural Sciences and Engineering Research Council of Canada (NSERC-CSE)
hardware_type: 50% 64 H100s / 50% LLNL El Capitan
training_time: 18 days @ 700W
co2_emitted: 17102 lb/7757kg CO2eq
get_started_code: uvx --from mlx-lm mlx_lm.generate --model "darkshapes/comma-v0.1-2t-MLX-Q8" --prompt 'Test prompt'
```

# comma-v0.1-2t-MLX-Q8
Comma v0.1-2T is a 7 billion parameter transformer model trained on openly licensed text from the Common Pile.
This repo is a quantized model that lowers memory requirement from 14GB to 7GB, increasing speed and availability at the sacrifice of some accuracy.

> [!WARNING]
> MLX is a framework for METAL graphics supported by Apple computers with ARM M-series processors (M1/M2/M3/M4)

> [!NOTE]
> Generation using uv https://docs.astral.sh/uv/**:
> ```
> uvx --from mlx-lm mlx_lm.generate --model “darkshapes/comma-v0.1-2t-ML-Q8" --prompt 'Test prompt'
>```

> [!NOTE]
> Generation using pip:
> ```
> pipx --from mlx-lm mlx_lm.generate --model “darkshapes/comma-v0.1-2t-ML-Q8" --prompt 'Test prompt'
> ```