Skip to content

Glossary: Evaluating LLM Apps

Length bias

Also written: verbosity bias

A judge's tendency to prefer longer answers. It can be tested by padding correct answers with filler and checking whether the padded version wins.

Where the book teaches it

Related terms

Position biasSelf-preferencePairwise judging