Model Catalog
113 items
Applied Filters
none
rednote-hilab /
dots.ocr
7
Deployed 7 times
Image-Text-to-Text
vLLM
Accelerated vLLM
GPU 1x Nvidia L4
$ 0.8
nanonets /
Nanonets-OCR-s
2
Deployed 2 times
Image-Text-to-Text
vLLM
Accelerated vLLM
GPU 1x Nvidia L40S
$ 1.8
Qwen /
Qwen3-Embedding-8B-GGUF
1
Deployed 1 time
Feature Extraction
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 1x Nvidia T4
$ 0.5
Qwen /
Qwen3-Embedding-4B-GGUF
1
Deployed 1 time
Feature Extraction
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 1x Nvidia T4
$ 0.5
Qwen /
Qwen3-Embedding-0.6B-GGUF
3
Deployed 3 times
Feature Extraction
Llama.cpp
Accelerated llama.cpp
F16
CPU 2x Intel Sapphire Rapids
$ 0.067
ibm-granite /
granite-4.0-micro
19
Deployed 19 times
Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia L4
$ 0.8
Qwen /
Qwen3-Next-80B-A3B-Instruct
16
Deployed 16 times
Text Generation
vLLM
Accelerated vLLM
GPU 4x Nvidia A100
$ 10
Qwen /
Qwen3-Next-80B-A3B-Thinking
8
Deployed 8 times
Text Generation
vLLM
Accelerated vLLM
GPU 4x Nvidia A100
$ 10
swiss-ai /
Apertus-8B-Instruct-2509
31
Deployed 31 times
Text Generation
SGLang
Accelerated SGLang
GPU 1x Nvidia L4
$ 0.8
google /
embeddinggemma-300m
26
Deployed 26 times
Sentence Similarity
TEI
Accelerated Text Embeddings Inference
CPU 2x Intel Sapphire Rapids
$ 0.067
onnx-community /
embeddinggemma-300m-ONNX
12
Deployed 12 times
Sentence Similarity
TEI
Accelerated Text Embeddings Inference
CPU 2x Intel Sapphire Rapids
$ 0.067
openai /
gpt-oss-120b
202
Deployed 202 times
Text Generation
vLLM
Accelerated vLLM
GPU 2x Nvidia H100
$ 9
openai /
gpt-oss-20b
311
Deployed 311 times
Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia H100
$ 4.5
Qwen /
Qwen3-32B
57
Deployed 57 times
Text Generation
vLLM
Accelerated vLLM
GPU 2x Nvidia A100
$ 5
ibm-granite /
granite-3.3-8b-instruct
20
Deployed 20 times
Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia L40S
$ 1.8
Qwen /
Qwen3-Embedding-0.6B
117
Deployed 117 times
Feature Extraction
TEI
Accelerated Text Embeddings Inference
GPU 1x Nvidia L4
$ 0.8
Qwen /
Qwen3-Embedding-4B
90
Deployed 90 times
Feature Extraction
TEI
Accelerated Text Embeddings Inference
GPU 1x Nvidia L4
$ 0.8
Qwen /
Qwen3-Embedding-8B
139
Deployed 139 times
Feature Extraction
TEI
Accelerated Text Embeddings Inference
GPU 1x Nvidia L4
$ 0.8
nomic-ai /
nomic-embed-text-v1.5
28
Deployed 28 times
Sentence Similarity
TEI
Accelerated Text Embeddings Inference
CPU 8x Intel Sapphire Rapids
$ 0.268
HuggingFaceTB /
SmolLM3-3B
8
Deployed 8 times
Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia L4
$ 0.8
Qwen /
Qwen3-1.7B
72
Deployed 72 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
unsloth /
DeepSeek-R1-GGUF
41
Deployed 41 times
Text Generation
Llama.cpp
Accelerated llama.cpp
IQ2_XXS
GPU 8x Nvidia A100
$ 20
ggml-org /
InternVL3-14B-Instruct-GGUF
16
Deployed 16 times
Image-Text-to-Text
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 1x Nvidia L4
$ 0.8
ggml-org /
Qwen2.5-VL-3B-Instruct-GGUF
30
Deployed 30 times
Image-Text-to-Text
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 1x Nvidia T4
$ 0.5
ggml-org /
Qwen2.5-VL-7B-Instruct-GGUF
33
Deployed 33 times
Image-Text-to-Text
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 1x Nvidia T4
$ 0.5
ggml-org /
SmolVLM2-2.2B-Instruct-GGUF
21
Deployed 21 times
Image-Text-to-Text
Llama.cpp
Accelerated llama.cpp
F16
GPU 1x Nvidia T4
$ 0.5
BAAI /
bge-multilingual-gemma2
9
Deployed 9 times
Sentence Embeddings
GPU 1x Nvidia L40S
$ 1.8
ggml-org /
jina-reranker-v1-turbo-en-GGUF
7
Deployed 7 times
Text Ranking
Llama.cpp
Accelerated llama.cpp
F16
CPU 8x Intel Sapphire Rapids
$ 0.268
cross-encoder /
ms-marco-MiniLM-L12-v2
20
Deployed 20 times
Text Ranking
CPU 1x Intel Sapphire Rapids
$ 0.033
BAAI /
bge-reranker-base
27
Deployed 27 times
Text Ranking
TEI
Accelerated Text Embeddings Inference
GPU 1x Nvidia T4
$ 0.5
stablediffusionapi /
anything-v5
36
Deployed 36 times
Text-to-Image
GPU 1x Nvidia L4
$ 0.8
stable-diffusion-v1-5 /
stable-diffusion-v1-5
62
Deployed 62 times
Text-to-Image
GPU 1x Nvidia T4
$ 0.5
stabilityai /
stable-diffusion-2-1
64
Deployed 64 times
Text-to-Image
GPU 1x Nvidia L4
$ 0.8
stabilityai /
stable-diffusion-xl-base-1.0
90
Deployed 90 times
Text-to-Image
GPU 1x Nvidia L4
$ 0.8
prompthero /
openjourney
16
Deployed 16 times
Text-to-Image
GPU 1x Nvidia L4
$ 0.8
Linaqruf /
animagine-xl-2.0
45
Deployed 45 times
Text-to-Image
GPU 1x Nvidia L4
$ 0.8
black-forest-labs /
FLUX.1-schnell
151
Deployed 151 times
Text-to-Image
GPU 1x Nvidia L40S
$ 1.8
thenlper /
gte-large
14
Deployed 14 times
Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
CPU 4x Intel Sapphire Rapids
$ 0.134
sentence-transformers /
paraphrase-multilingual-MiniLM-L12-v2
18
Deployed 18 times
Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
GPU 1x Nvidia L4
$ 0.8
sentence-transformers /
all-mpnet-base-v2
64
Deployed 64 times
Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
CPU 2x Intel Sapphire Rapids
$ 0.067
sentence-transformers /
all-MiniLM-L6-v2
302
Deployed 302 times
Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
CPU 1x Intel Sapphire Rapids
$ 0.033
mixedbread-ai /
mxbai-embed-large-v1
24
Deployed 24 times
Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
GPU 1x Nvidia L4
$ 0.8
intfloat /
multilingual-e5-large-instruct
43
Deployed 43 times
Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
GPU 1x Nvidia T4
$ 0.5
intfloat /
multilingual-e5-large
39
Deployed 39 times
Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
GPU 1x Nvidia T4
$ 0.5
beethogedeon /
gte-Qwen2-7B-instruct-Q4_K_M-GGUF
21
Deployed 21 times
Sentence Embeddings
Llama.cpp
Accelerated llama.cpp
Q4_K_M
CPU 8x Intel Sapphire Rapids
$ 0.268
BAAI /
bge-large-en-v1.5
70
Deployed 70 times
Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
GPU 1x Nvidia L4
$ 0.8
BAAI /
bge-base-en-v1.5
64
Deployed 64 times
Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
CPU 4x Intel Sapphire Rapids
$ 0.134
Qwen /
Qwen2.5-VL-7B-Instruct
184
Deployed 184 times
Image-Text-to-Text
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
meta-llama /
Llama-3.2-11B-Vision-Instruct
40
Deployed 40 times
Image-Text-to-Text
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
google /
paligemma2-10b-mix-448
Image-Text-to-Text
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
google /
paligemma2-10b-mix-224
2
Deployed 2 times
Image-Text-to-Text
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
google /
paligemma2-3b-mix-448
12
Deployed 12 times
Image-Text-to-Text
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
google /
gemma-3-12b-it
172
Deployed 172 times
Image-Text-to-Text
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
google /
gemma-3-27b-it
200
Deployed 200 times
Image-Text-to-Text
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia A100
$ 2.5
openai /
whisper-large-v3-turbo
171
Deployed 171 times
Automatic Speech Recognition
GPU 1x Nvidia L4
$ 0.8
openai /
whisper-large-v3
160
Deployed 160 times
Automatic Speech Recognition
GPU 1x Nvidia L4
$ 0.8
mistralai /
Mistral-Small-24B-Instruct-2501
29
Deployed 29 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L4
$ 3.8
Qwen /
Qwen2.5-Coder-7B-Instruct
50
Deployed 50 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
Qwen /
QwQ-32B
51
Deployed 51 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L4
$ 3.8
mistralai /
Mixtral-8x7B-v0.1
14
Deployed 14 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 2x Nvidia A100
$ 5
Qwen /
Qwen2.5-72B-Instruct
31
Deployed 31 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia A100
$ 10
mistralai /
Mistral-Nemo-Instruct-2407
28
Deployed 28 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L4
$ 3.8
Qwen /
Qwen2.5-14B-Instruct
125
Deployed 125 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 2x Nvidia A100
$ 5
microsoft /
phi-4
67
Deployed 67 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
ibm-granite /
granite-3.1-8b-base
25
Deployed 25 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
meta-llama /
Llama-2-70b-chat-hf
11
Deployed 11 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L40S
$ 8.3
meta-llama /
Llama-3.1-8B
81
Deployed 81 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
mistralai /
Mistral-7B-Instruct-v0.3
295
Deployed 295 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
HuggingFaceTB /
SmolLM2-1.7B
13
Deployed 13 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
microsoft /
Phi-3-mini-128k-instruct
72
Deployed 72 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
openchat /
openchat-3.5-0106
25
Deployed 25 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
HuggingFaceH4 /
zephyr-7b-beta
43
Deployed 43 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
meta-llama /
Llama-3.1-8B-Instruct
348
Deployed 348 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
Intel /
neural-chat-7b-v3-3
7
Deployed 7 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
Qwen /
Qwen2.5-7B-Instruct
199
Deployed 199 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
Qwen /
Qwen2.5-Math-72B-Instruct
6
Deployed 6 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia A100
$ 10
Qwen /
Qwen2.5-14B-Instruct-1M
20
Deployed 20 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 2x Nvidia A100
$ 5
meta-llama /
Meta-Llama-3-8B-Instruct
71
Deployed 71 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
meta-llama /
Llama-2-13b-chat-hf
14
Deployed 14 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
meta-llama /
Llama-2-7b-hf
23
Deployed 23 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
bartowski /
Qwen2.5-Coder-32B-Instruct-GGUF
50
Deployed 50 times
Text Generation
Llama.cpp
Accelerated llama.cpp
Q4_K_M
GPU 1x Nvidia L4
$ 0.8
Qwen /
Qwen2.5-Coder-32B-Instruct
94
Deployed 94 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L4
$ 3.8
microsoft /
Phi-3-mini-4k-instruct
45
Deployed 45 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
meta-llama /
Llama-3.1-70B
22
Deployed 22 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L40S
$ 8.3
meta-llama /
Llama-3.2-3B-Instruct
94
Deployed 94 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
qihoo360 /
TinyR1-32B-Preview
5
Deployed 5 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L4
$ 3.8
simplescaling /
s1.1-32B
1
Deployed 1 time
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L4
$ 3.8
meta-llama /
Llama-2-13b-hf
8
Deployed 8 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
mistralai /
Mixtral-8x22B-Instruct-v0.1
17
Deployed 17 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 8x Nvidia A100
$ 20
Intel /
neural-chat-7b-v3-1
7
Deployed 7 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
meta-llama /
Llama-3.1-70B-Instruct
62
Deployed 62 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L40S
$ 8.3
bartowski /
QwQ-32B-Preview-GGUF
2
Deployed 2 times
Text Generation
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 1x Nvidia L40S
$ 1.8
mistralai /
Mistral-7B-v0.3
33
Deployed 33 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
meta-llama /
Llama-3.2-3B
23
Deployed 23 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
deepseek-ai /
DeepSeek-R1-Distill-Llama-70B
105
Deployed 105 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L40S
$ 8.3
RekaAI /
reka-flash-3
1
Deployed 1 time
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
HuggingFaceTB /
SmolLM2-1.7B-Instruct
33
Deployed 33 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
meta-llama /
Llama-3.2-1B
28
Deployed 28 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
berkeley-nest /
Starling-LM-7B-alpha
5
Deployed 5 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
lmsys /
vicuna-7b-v1.5
5
Deployed 5 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
meta-llama /
Llama-2-70b-hf
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L40S
$ 8.3
meta-llama /
Meta-Llama-3-70B-Instruct
3
Deployed 3 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia A100
$ 10
Qwen /
Qwen2.5-Math-7B-Instruct
2
Deployed 2 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
Tesslate /
Tessa-T1-32B
4
Deployed 4 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia A100
$ 2.5
deepseek-ai /
DeepSeek-R1-Distill-Qwen-32B
128
Deployed 128 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L4
$ 3.8
meta-llama /
Llama-2-7b-chat-hf
45
Deployed 45 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
lmstudio-community /
Llama-3.3-70B-Instruct-GGUF
47
Deployed 47 times
Text Generation
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 4x Nvidia L4
$ 3.8
meta-llama /
Llama-3.2-1B-Instruct
40
Deployed 40 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
meta-llama /
Meta-Llama-3-70B
9
Deployed 9 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia A100
$ 10
meta-llama /
Meta-Llama-3-8B
30
Deployed 30 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
mistralai /
Mixtral-8x7B-Instruct-v0.1
124
Deployed 124 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 2x Nvidia A100
$ 5
unsloth /
DeepSeek-R1-GGUF
45
Deployed 45 times
Text Generation
Llama.cpp
Accelerated llama.cpp
IQ1_S
GPU 4x Nvidia L40S
$ 8.3
Qwen /
Qwen2.5-Coder-14B-Instruct
23
Deployed 23 times
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8