Skip to content

Glossary: Evaluating LLM Apps

Offline / online evaluation

Also written: offline, online evaluation, online

Offline evaluation runs a fixed test set before release. Online evaluation measures quality on real traffic after release.

Where the book teaches it

Related terms

EvalTraceA/B test