Skip to content

Glossary: Transformers Basics

Checkpoint

Also written: tiny_gpt.pt

A saved file holding a model's weights, along with anything needed to use them, such as the list of characters the tokenizer knows. It lets training be resumed or the model be reloaded later for generation or fine-tuning.

Where the book teaches it

Related terms

state_dictweights_only