Skip to content

Glossary: Fine-tuning LLMs

Checkpoint

Also written: checkpoints

A saved snapshot of the adapter and optimizer state taken during training. If a run stops you can resume from the latest one, and the trainer can reload the one with the lowest validation loss.

Where the book teaches it

Related terms

Validation lossAdapter