Skip to content

Glossary: Evaluating LLM Apps

pass^k

Also written: pass^5, pass to the k

The share of cases that pass on all k tries, which is what a customer who asks repeatedly experiences. It is always at or below the average pass rate.

Where the book teaches it

Related terms

Flaky case