Glossary: NLP with Transformers
Checkpoint
Also written: checkpoints
A saved copy of a model's weights, either at some point during training or the pretrained starting point such as `distilbert/distilbert-base-uncased`. Training checkpoints also hold optimizer state, so the `runs/` folder gets large.