Skip to content

Glossary: Evaluating LLM Apps

LLM-as-judge

Also written: judge, LLM judge

Using a model, with a rubric, as a grader for things code can't check, such as reasoning and support from sources. It costs money, varies between runs and has biases, so it must itself be checked.

Where the book teaches it

Related terms

RubricCalibrationPosition bias