DistilBERT

Also written: distilbert-base-uncased, distilbert-base-cased

A smaller, faster version of BERT with 6 layers, made by distillation (training a small model to imitate a larger one). It is a common choice for fine-tuning a text classifier, such as a message router for Priya's inbox.