Reward model
A model trained on human comparisons of answers to score how good an answer is. In RLHF, reinforcement learning uses its scores to push the language model toward better answers.
Where the book teaches it
Related terms
RLHF (reinforcement learning from human feedback)DPO (direct preference optimization)