xlm-v-base / tokenizer.json

tokenizer: add fast variant

45637ff over 2 years ago

61.4 MB

This file is stored with Xet . It is too big to display, but you can still download it.

( Raw pointer file )

SHA256:: 43f949ef0c0b1ac18c506551109383d4a8a2bd48956ced0cc95cfd9120d42dca
Pointer size:: 133 Bytes
Size of remote file:: 61.4 MB
Xet backed hash:: 1d01e4258710a17cb01346e6f779de3f171fc9acea2bad1a8d3228c8a65857d0

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.