Glossary: Building with LLMs Basics
Prompt caching
Also written: caching
Reusing the provider's processed version of the start of a prompt for a few minutes, so repeated requests such as Priya's policies are faster and cheaper. Claude needs a `cache_control` marker; OpenAI caches automatically.