Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
huggingface 's Collections
DistilBERT release

DistilBERT release

updated Apr 17, 2024

Original DistilBERT model, checkpoints obtained from using teacher-student learning from the original BERT checkpoints.

Upvote
29

  • distilbert/distilbert-base-cased

    Fill-Mask • 65.8M • Updated May 6, 2024 • 120k • • 53

  • distilbert/distilbert-base-uncased

    Fill-Mask • 67M • Updated May 6, 2024 • 12.6M • • 779

  • distilbert/distilbert-base-multilingual-cased

    Fill-Mask • 0.1B • Updated May 6, 2024 • 838k • • 219

  • distilbert/distilbert-base-uncased-finetuned-sst-2-english

    Text Classification • 67M • Updated Dec 19, 2023 • 4.96M • • 836

  • distilbert/distilbert-base-uncased-distilled-squad

    Question Answering • 66.4M • Updated May 6, 2024 • 93.1k • • 118

  • distilbert/distilbert-base-cased-distilled-squad

    Question Answering • 65.2M • Updated May 6, 2024 • 214k • • 262
Upvote
29
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs