Skip to content

Glossary: Evaluating LLM Apps

Unanswerable case

Also written: unanswerable, answerable

A test case whose question the help docs don't cover (`answerable: false`), so the right behavior is to say "I don't know" and invent nothing. It is one of the hardest behaviors for an app to get right, yet is often underrepresented in test sets.

Where the book teaches it

Related terms

Refusal checkEdge caseMust-pass case