Hugging Face's logo

Spaces:
mponty
/
some_tokenization
Sleeping

App Files Community
mponty commited on
Commit
9805197
·
verified ·
1 Parent(s): 96b0faa

Update requirements.txt

Browse files
Files changed (1) hide show
  1. requirements.txt +2 -1
requirements.txt CHANGED
@@ -1,3 +1,4 @@
1
  nltk
2
  word-piece-tokenizer
3
- tiktoken
 
 
1
  nltk
2
  word-piece-tokenizer
3
+ tiktoken
4
+ transformers