Skip to content

Glossary: Evaluating LLM Apps

Pairwise judging

Also written: pairwise

Showing a judge two answers to the same question and asking it to pick the better one or call a tie. It should be run in both orders.

Where the book teaches it

Related terms

Position biasLLM-as-judgeInconsistent verdict