Skip to content

Glossary: Evaluating LLM Apps

McNemar's test

Also written: mcnemar

A paired test that compares two versions using only the discordant cases and gives a p-value. It asks whether the split of wins looks like coin tosses.

Where the book teaches it

Related terms

Discordant casep-valuePaired comparison