Skip to content

Glossary: Fine-tuning LLMs

SFTTrainer

Also written: SFTConfig

TRL's trainer for supervised fine-tuning. It applies the chat template, masks the prompt, batches examples and runs the training loop, configured with `SFTConfig` and PEFT's `LoraConfig`.

Where the book teaches it

Related terms

TRLSupervised fine-tuning (SFT)PEFT (parameter-efficient fine-tuning)