Granite 3.3 8b Instruct FP8

This repository contains the FP8 version of Granite-3.3-8b-Instruct.

Please reference the base model's full model card here: https://huggingface.co/ibm-granite/granite-3.3-8b-instruct

Downloads last month
74
Safetensors
Model size
8B params
Tensor type
BF16
·
F8_E4M3
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ibm-granite/granite-3.3-8b-instruct-FP8

Quantized
(33)
this model

Collection including ibm-granite/granite-3.3-8b-instruct-FP8