Qwen3-Next-80B-A3B-Instruct
Huang Yuyang
fastllm
AI & ML interests
llm
Recent Activity
new activity
about 1 month ago
fastllm/Qwen3-Next-80B-A3B-Instruct-UD-Q2_K_S:CPU only build is getting ~21t/s!
new activity
about 1 month ago
fastllm/Qwen3-Next-80B-A3B-Instruct-UD-Q2_K_S:support via transformers ,probably not gguf,not tested
updated
a model
about 1 month ago
fastllm/Qwen3-Next-80B-A3B-Instruct-int4g-fp16-mixed
Organizations
None yet
models
32
fastllm/Qwen3-Next-80B-A3B-Instruct-int4g-fp16-mixed
81B
•
Updated
•
76
•
3
fastllm/Qwen3-Next-80B-A3B-Instruct-UD-Q6_K_L
81B
•
Updated
•
31
•
3
fastllm/Qwen3-Next-80B-A3B-Instruct-UD-Q5_K_L
81B
•
Updated
•
14
•
1
fastllm/Qwen3-Next-80B-A3B-Instruct-UD-Q5_K_M
81B
•
Updated
•
7
fastllm/Qwen3-Next-80B-A3B-Instruct-UD-Q4_K_L
81B
•
Updated
•
454
fastllm/Qwen3-Next-80B-A3B-Instruct-UD-Q4_K_M
81B
•
Updated
•
124
•
4
fastllm/Qwen3-Next-80B-A3B-Instruct-UD-Q3_K_L
81B
•
Updated
•
9
fastllm/Qwen3-Next-80B-A3B-Instruct-UD-Q3_K_M
81B
•
Updated
•
20
fastllm/Qwen3-Next-80B-A3B-Instruct-UD-Q2_K_M
81B
•
Updated
•
11
•
2
fastllm/Qwen3-Next-80B-A3B-Instruct-UD-Q2_K_S
81B
•
Updated
•
28
•
4
datasets
0
None public yet