Skip to content

Glossary: AI System Design

Semantic cache

Reusing a stored answer for a similar past question, found by embedding lookup. It can return a confidently wrong answer to a near-miss question like a $40 versus $60 order.

Where the book teaches it

Related terms

Exact response cachePrompt cacheEmbedding