GGUF
draft
speculative-decoding

GLM-4.5-Air?

#1
by phi0112358 - opened

Hello, is there any chance you could create a draft model for the smaller GLM-4.5-Air? That would be extremely helpful.

Thx

Hello, is there any chance you could create a draft model for the smaller GLM-4.5-Air? That would be extremely helpful.

Thx

I think this should work for it too as AFAIK it uses the same vocab?

Hello, I can confirm that it works on 4.5 Air.

Thanks for your work @jukofyork

Sign up or log in to comment