Skip to content

Glossary: Fine-tuning LLMs

RLHF

Also written: reinforcement learning from human feedback

An older preference-tuning approach that trains a separate reward model on comparisons and then uses reinforcement learning. DPO gets a similar result with one ordinary training loop.

Where the book teaches it

Related terms

DPO (direct preference optimization)Preference tuning