Skip to content

Glossary: Transformers Basics

Fine-tuning

Also written: fine-tune, fine-tuned

Continuing to train a pretrained model on a smaller, targeted dataset, usually with a lower learning rate. Fine-tuning on Jo's blurbs teaches the model her style.

Where the book teaches it

Related terms

PretrainingInstruction tuning (SFT)Base model