Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

tamang0000
/
assamese-tokenizer-50k

Transformers
LLM
Multilingual
Transformer
Non-English
Tokenizer
Indian
Assamese
Model card Files Files and versions
xet
Community
assamese-tokenizer-50k
1.91 MB
  • 1 contributor
History: 6 commits
tamang0000's picture
tamang0000
Update README.md
7fa3768 verified over 1 year ago
  • .gitattributes
    1.52 kB
    initial commit over 1 year ago
  • README.md
    1.25 kB
    Update README.md over 1 year ago
  • special_tokens_map.json
    125 Bytes
    Upload folder using huggingface_hub over 1 year ago
  • tokenizer.json
    1.9 MB
    Upload folder using huggingface_hub over 1 year ago
  • tokenizer_config.json
    1.14 kB
    Upload folder using huggingface_hub over 1 year ago