#
Inference Providers

Please refer to the Inference Providers Documentation for detailed information.

##
What is HF-Inference API?

HF-Inference API is one of the many providers available on the Hugging Face Hub. It is deployed by Hugging Face ourselves, using text-generation-inference for LLMs for instance. This service used to be called “Inference API (serverless)” prior to Inference Providers.

For more details about the HF-Inference API, check out it’s dedicated page.

##
What technology do you use to power the HF-Inference API?

The HF-Inference API is powered by Inference Endpoints under the hood.

##
Why don’t I see an inference widget, or why can’t I use the API?

For some tasks, there might not be support by any Inference Provider, and hence, there is no widget.

##
How can I see my usage?

To check usage across all providers, check out your billing page.

To check your HF-Inference usage specifically, check out the Inference Dashboard. The dashboard shows both your serverless and dedicated endpoints usage.

##
Is there programmatic access to Inference Providers?

Yes! We provide client wrappers in both JS and Python:

- JS (`@huggingface/inference`)
- Python (`huggingface_hub`)

< > Update on GitHub