Skip to content

Glossary: Transformers Basics

Instruction tuning (SFT)

Also written: instruction tuning, SFT, supervised fine-tuning

Fine-tuning on thousands of examples of instructions paired with good responses. Afterward the model answers instead of just continuing the text.

Where the book teaches it

Related terms

Fine-tuningBase modelRLHF (reinforcement learning from human feedback)