---
datasets:
- HuggingFaceH4/ultrachat_200k
base_model:
- meta-llama/Llama-3.2-1B-Instruct
library_name: transformers
---

## meta-llama/Llama-3.2-1B-Instruct - W4A16 Compression

This is a compressed model using [llmcompressor](https://github.com/vllm-project/llm-compressor).

## Compression Configuration

- Base Model: meta-llama/Llama-3.2-1B-Instruct
- Compression Scheme: W4A16
- Dataset: HuggingFaceH4/ultrachat_200k
- Dataset Split: train_sft
- Number of Samples: 512
- Preprocessor: chat
- Maximum Sequence Length: 131072

## Sample Output

#### Prompt: 

```
<|begin_of_text|><|start_header_id|>system<|end_header_id|>

Cutting Knowledge Date: December 2023
Today Date: 28 Nov 2024

<|eot_id|><|start_header_id|>user<|end_header_id|>

Who is Alan Turing?<|eot_id|>
```

#### Output: 

```
<|begin_of_text|><|begin_of_text|><|start_header_id|>system<|end_header_id|>

Cutting Knowledge Date: December 2023
Today Date: 28 Nov 2024

<|eot_id|><|start_header_id|>user<|end_header_id|>

Who is Alan Turing?<|eot_id|><|start_header_id|>assistant<|end_header_id|>

Alan Turing (1912-1954) was a British mathematician, computer scientist, logician, and philosopher. He is widely recognized for his groundbreaking work in computer science, artificial intelligence, and cryptography. He is often referred to as the "father of computer science" and is considered one of the most influential figures in the development of modern computing.

Turing's most notable contributions include:

1. **The Turing Machine**: In 1936, Turing proposed a theoretical model of a machine that could simulate the behavior of a human thinker, which laid the foundation for modern computer architecture.
2. **Codebreaking during
```

## Evaluation

<TODO>