404 Not Found when using Qwen models with HuggingFaceInferenceAPI

#130
by Milkfish033 - opened

Hi everyone,

I’m getting a 404 Not Found error when using LlamaIndex’s HuggingFaceInferenceAPI with several Qwen models.

What I tried

llm = HuggingFaceInferenceAPI(model_name="Qwen/Qwen2.5-Coder-7B-Instruct")

I also tried

"mistralai/Mistral-7B-Instruct-v0.3",
"meta-llama/Meta-Llama-3-8B-Instruct",
"meta-llama/Llama-3.1-8B-Instruct",
"Qwen/Qwen2.5-7B-Instruct",

But all of them return same error: 404 not found

Sign up or log in to comment