Skip to content

Glossary: Evaluating LLM Apps

Response cache

Also written: cache

A folder of saved model replies, one JSON file per distinct request, so reruns are free and give identical results.

Where the book teaches it

Related terms

HashCache missDemo mode (EVAL_DEMO)