Skip to content

Glossary: NLP with Transformers

Checkpoint

Also written: checkpoints

A saved copy of a model's weights, either at some point during training or the pretrained starting point such as `distilbert/distilbert-base-uncased`. Training checkpoints also hold optimizer state, so the `runs/` folder gets large.

Where the book teaches it

Related terms

Trainer, TrainingArguments