Glossary: NLP with Transformers
Dropout
A training technique that randomly switches off some units. It is on only during training, which is why `model.eval()` turns it off for predicting.
Glossary: NLP with Transformers
A training technique that randomly switches off some units. It is on only during training, which is why `model.eval()` turns it off for predicting.