RLHF (reinforcement learning from human feedback)
Also written: RLHF, reinforcement learning from human feedback
Human comparisons of answers train a reward model, and reinforcement learning then nudges the language model toward high-scoring answers. It is part of what turns a base model into an assistant.
Where the book teaches it
Related terms
Reward modelDPO (direct preference optimization)Instruction tuning (SFT)