Skip to content

Glossary: NLP with Transformers

Dropout

A training technique that randomly switches off some units. It is on only during training, which is why `model.eval()` turns it off for predicting.

Where the book teaches it

Related terms

Logits