RLHF
Also written: reinforcement learning from human feedback
An older preference-tuning approach that trains a separate reward model on comparisons and then uses reinforcement learning. DPO gets a similar result with one ordinary training loop.
Also written: reinforcement learning from human feedback
An older preference-tuning approach that trains a separate reward model on comparisons and then uses reinforcement learning. DPO gets a similar result with one ordinary training loop.