Glossary: NLP with Transformers
Epoch
Also written: epochs, num_train_epochs
One full pass over the training data. DistilBERT was fine-tuned for 3 epochs, while the small from-scratch model reached its best score at epoch 14.
Glossary: NLP with Transformers
Also written: epochs, num_train_epochs
One full pass over the training data. DistilBERT was fine-tuned for 3 epochs, while the small from-scratch model reached its best score at epoch 14.