jukofyork

/

GLM-4.5-DRAFT-0.6B-v3.0-GGUF

like 17

Hello, is there any chance you could create a draft model for the smaller GLM-4.5-Air? That would be extremely helpful.

Thx

I think this should work for it too as AFAIK it uses the same vocab?

Hello, I can confirm that it works on 4.5 Air.

Thanks for your work @jukofyork

Related:

https://huggingface.co/ubergarm/GLM-4.5-Air-GGUF/discussions/6

Specifically starting at this post:

https://huggingface.co/ubergarm/GLM-4.5-Air-GGUF/discussions/6#68b1f98df634e7d107ccfb1f