Preference tuning
Also written: preference optimization
Tuning a model with human comparisons of pairs of answers so it prefers the better ones, done with RLHF or DPO after instruction tuning.
Where the book teaches it
Related terms
RLHF (reinforcement learning from human feedback)DPO (direct preference optimization)Instruction tuning (SFT)