Llama-3.3-70B-o1 Thinker Model

This model was fine-tuned on CoT-style reasoning traces. The model will respond with a thinking trace between the <|begin_of_thought|> and <|end_of_thought|> tags. The final answer will be between the <|begin_of_solution|> and <|end_of_solution|> tags.

Compared to the base Llama model, this thinker model has a tendency to generate a large number of tokens. So, if you are benchmarking make sure you have the full generated text in the reponse, ending with the <|end_of_solution|> tag. For most queries, you will need to set the max_tokens to at least 8192.

The GGUF quants for the model are available here - Llama-3.3-70B-o1-gguf

The model was trained using QLoRA fine-tuning. You can find the adapter here - Llama-3.3-70B-o1-lora.

Evaluation results

Model	AIME 2024 pass@1
Llama-3.3-70B-o1	46.7
Llama-3.3-70B	30.0
Sky-T1-32B-Preview	43.3
o1-preview	40.0
QwQ	50.0

• Developed by: codelion
• License: apache-2.0
• Finetuned from model : unsloth/llama-3.3-70b-instruct-bnb-4bit

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.