Glossary: Fine-tuning LLMs

Rewards (in DPO logs)

Also written: rewards/margins, rewards/accuracies, rewards

For each answer, beta times how much more likely the model makes it than the reference does. `rewards/margins` is chosen minus rejected, and `rewards/accuracies` is the fraction of pairs where the chosen reward is higher.