Glossary: RAG Beyond the Basics

Prompt caching

Also written: prompt cache

The API stores a request's long, unchanging beginning for 5 minutes and later reads it at a tenth of the input price; writing costs 1.25 times. Claude 5.5 models only cache prompts of at least 512 tokens.