Skip to content

Glossary: NLP with Transformers

fill-mask

Also written: [MASK]

A pipeline task where the model guesses the likeliest words for a hidden word marked `[MASK]`. It works out of the box with BERT because of how BERT was pretrained.

Where the book teaches it

Related terms

BERTSpecial tokens