Skip to content

Glossary: Evaluating LLM Apps

Calibration

Also written: calibrate, calibrated, calibrating

Checking a grader such as the judge against trusted human labels and adjusting it until they agree. Priya compared the judge with her own labels of 80 answers.

Where the book teaches it

Related terms

Cohen's kappaConfusion matrixLLM-as-judge