Skip to content

Glossary: NLP with Transformers

Epoch

Also written: epochs, num_train_epochs

One full pass over the training data. DistilBERT was fine-tuned for 3 epochs, while the small from-scratch model reached its best score at epoch 14.

Where the book teaches it

Related terms

Early stopping