Update tokenization_kimi.py

#56

by lfu - opened Sep 3, 2025

←

lfu

Sep 3, 2025

Pass added_tokens_decoder to the base class so that the non-special added tokens will be saved during save_pretrained.

Moonshot AI org Nov 4, 2025

LGTM, thanks!

bigmoyan changed pull request status to merged Nov 4, 2025

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment