Skip to content

Glossary: Building with LLMs Basics

Prompt caching

Also written: caching

Reusing the provider's processed version of the start of a prompt for a few minutes, so repeated requests such as Priya's policies are faster and cheaper. Claude needs a `cache_control` marker; OpenAI caches automatically.

Where the book teaches it

Related terms

Cache breakpointCache read / writePrefix cache