Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

27,481

Full-text search

Active filters: 8-bit

ethzanalytics/gpt-j-8bit-KILT_WoW_10k_steps

Text Generation • Updated Nov 27, 2022 • 4

Norod78/gpt-fluentui-flat-svg

Text Generation • 0.2B • Updated Mar 19, 2023 • 11 • 21

byoussef/whisper-large-v2-ko-PEFT

Automatic Speech Recognition • 2B • Updated Aug 25, 2025 • 4

BreadAi/MuseCan-1-2

Text Generation • 0.2B • Updated Aug 5, 2023 • 7

ybelkada/bloom-560m-8bit

Text Generation • Updated Apr 12, 2023 • 6

ybelkada/bloom-1b7-8bit

Text Generation • 2B • Updated Apr 17, 2023 • 453 • 6

thes41d/fr-boris-8bit

Text Generation • Updated May 20, 2023 • 3

RajuKandasamy/dolly-v2-3b-8bit

Text Generation • Updated Apr 15, 2023 • 7

RajuKandasamy/dolly-v2-7b-8bit

Text Generation • Updated Apr 15, 2023 • 3

KumaTea/twitter-int8

Feature Extraction • 6B • Updated Feb 8, 2025 • 1

KumaTea/twitter-int4

Feature Extraction • 3B • Updated Feb 8, 2025 • 1

seongcho/GenerAd-AI

Text Generation • Updated Apr 21, 2023

Linus4Lyf/Llama-1epoch-Plato

Text Generation • Updated Apr 21, 2023 • 3

Linus4Lyf/Llama-5epoch-Plato

Text Generation • Updated Apr 22, 2023 • 4

Linus4Lyf/Llama-10epoch-Plato

Text Generation • Updated Apr 22, 2023 • 4

ethzanalytics/dolly-v2-12b-sharded-8bit

Text Generation • Updated Apr 29, 2023 • 7 • 4

ethzanalytics/dolly-v2-7b-sharded-8bit

Text Generation • Updated Jun 28, 2023 • 9 • 1

Linus4Lyf/Llama-10epoch-Plato-3epoch-Beauvoir_The_Second_Sex

Text Generation • Updated Apr 25, 2023 • 4

vvsotnikov/stablelm-7b-sft-v7-epoch-3-8bit

Text Generation • Updated Apr 25, 2023 • 1

Linus4Lyf/Llama-10epoch-Plato-3epoch-Hume_A_Treatise_Of_Human_Nature

Text Generation • Updated Apr 26, 2023 • 4

Linus4Lyf/Llama-10epoch-Plato-3epoch-Kant_Metaphysics_Of_Morals

Text Generation • Updated Apr 26, 2023 • 4 • 1

emrik/bloom7b-vigogne

Text Generation • Updated Apr 26, 2023 • 3

Linus4Lyf/Llama-10epoch-Plato-3epoch-Rousseau_Emile

Text Generation • Updated Apr 27, 2023 • 4

Linus4Lyf/Llama-10epoch-Plato-3epoch-Sina_A_Compendium_On_The_Soul

Text Generation • Updated Apr 27, 2023 • 4

pszemraj/long-t5-tglobal-xl-16384-book-summary-8bit

Summarization • 3B • Updated Dec 29, 2025 • 18

ethzanalytics/stablelm-tuned-alpha-7b-sharded-8bit

Text Generation • Updated May 4, 2023 • 2 • 2

Sepehrasg/sepi-lora

Text Generation • Updated Apr 28, 2023

Linus4Lyf/Llama-10epoch-Plato-3epoch-Wollstonecraft_Thoughts_On_The_Education_Of_Daughters

Text Generation • Updated Apr 28, 2023 • 4

ek826/instruct-gpt-j-fp16-8bit

Text Generation • Updated May 18, 2023 • 1

Ransaka/mbart-large-cc25-8bit

1B • Updated Oct 2, 2023