BERT

Also written: bert-base-uncased, BertConfig

A pretrained encoder transformer trained by hiding words in text and guessing them. It can fill in masked words directly with a `fill-mask` pipeline, and it uses a WordPiece tokenizer with a 30,522-token vocabulary. Smaller models such as DistilBERT are derived from it.