Chosen and rejected

Also written: chosen, rejected

The better and worse answers to the same prompt in a preference pair. For Priya's DPO run, the chosen answer is her real reply and the rejected one is the untuned model's draft.