Update tokenization_kimi.py

#56
by lfu - opened

Pass added_tokens_decoder to the base class so that the non-special added tokens will be saved during save_pretrained.

Moonshot AI org

LGTM, thanks!

bigmoyan changed pull request status to merged

Sign up or log in to comment