-
-
-
-
-
-
Inference Providers
Active filters:
aqlm
ISTA-DASLab/Meta-Llama-3-8B-Instruct-AQLM-2Bit-1x16
Text Generation
•
2B
•
Updated
•
280
•
12
ISTA-DASLab/Meta-Llama-3-8B-AQLM-2Bit-1x16
Text Generation
•
2B
•
Updated
•
10
•
7
ISTA-DASLab/Meta-Llama-3-70B-AQLM-2Bit-1x16
Text Generation
•
11B
•
Updated
•
2
•
14
ISTA-DASLab/Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16
Text Generation
•
11B
•
Updated
•
16
•
20
ISTA-DASLab/Phi-3-mini-128k-instruct-AQLM-1x16
Text Generation
•
0.7B
•
Updated
•
1
•
1
ISTA-DASLab/Phi-3-mini-4k-instruct-AQLM-1x16
Text Generation
•
0.7B
•
Updated
•
1
galqiwi/test-upload
Text Generation
•
1B
•
Updated
ISTA-DASLab/Llama-2-7b-AQLM-PV-2Bit-1x16-hf
Text Generation
•
1B
•
Updated
•
6
ISTA-DASLab/Llama-2-13b-AQLM-PV-2Bit-1x16-hf
Text Generation
•
2B
•
Updated
•
1
ISTA-DASLab/Llama-2-70b-AQLM-PV-2Bit-1x16-hf
Text Generation
•
9B
•
Updated
•
1
ISTA-DASLab/Mistral-7B-v0.1-AQLM-PV-2Bit-1x16-hf
Text Generation
•
1B
•
Updated
•
2
ISTA-DASLab/Phi-3-mini-4k-instruct-AQLM-PV-2Bit-1x16-hf
Text Generation
•
0.7B
•
Updated
•
6
•
2
ISTA-DASLab/Llama-2-7b-AQLM-PV-2Bit-2x8-hf
Text Generation
•
2B
•
Updated
•
8
ISTA-DASLab/Meta-Llama-3-8B-AQLM-PV-2Bit-1x16
Text Generation
•
2B
•
Updated
•
2
•
3
ISTA-DASLab/Meta-Llama-3-70B-AQLM-PV-2Bit-1x16
Text Generation
•
11B
•
Updated
•
8
•
4
TechxGenus/deepseek-coder-7b-instruct-v1.5-PV
Text Generation
•
1B
•
Updated
•
1
justheuristic/test-1bit
Text Generation
•
0.9B
•
Updated
ISTA-DASLab/Llama-2-7b-AQLM-PV-1Bit-1x16-hf
Text Generation
•
0.9B
•
Updated
•
2
ISTA-DASLab/Meta-Llama-3-8B-AQLM-PV-1Bit-1x16
Text Generation
•
2B
•
Updated
•
2
ISTA-DASLab/Llama-2-13b-AQLM-2Bit-2x8-hf
Text Generation
•
4B
•
Updated
•
14
ISTA-DASLab/Meta-Llama-3-70B-AQLM-PV-1Bit-1x16
Text Generation
•
7B
•
Updated
•
1
•
1
syrinenoamen/victorgoose_dpo_aqlmQ32
Text Generation
•
0.7B
•
Updated
ISTA-DASLab/Phi-3-medium-4k-instruct-AQLM-PV-1Bit-1x16-hf
Text Generation
•
1B
•
Updated
•
2
ISTA-DASLab/Phi-3-medium-4k-instruct-AQLM-PV-2Bit-1x16-hf
Text Generation
•
2B
•
Updated
•
4
ISTA-DASLab/Qwen2-72B-Instruct-AQLM-PV-2bit-1x16
Text Generation
•
12B
•
Updated
•
1
•
1
ISTA-DASLab/Qwen2-72B-Instruct-AQLM-PV-1bit-1x16
Text Generation
•
7B
•
Updated
•
1
ISTA-DASLab/Qwen2-72B-AQLM-PV-2bit-1x16
Text Generation
•
12B
•
Updated
•
3
ISTA-DASLab/Qwen2-72B-AQLM-PV-1bit-1x16
Text Generation
•
12B
•
Updated
•
1
azhiboedova/Meta-Llama-3.1-8B-Instruct-AQLM-2Bit-1x16
Text Generation
•
2B
•
Updated
•
4
•
13
ISTA-DASLab/Meta-Llama-3.1-8B-AQLM-PV-1Bit-1x16-hf
Text Generation
•
2B
•
Updated
•
1