Skip to content

Glossary: RAG Basics

Prompt caching

Also written: cached prefix, cache reads

A feature where the model provider stores an unchanged start of your prompt and charges much less to reuse it. It doesn't help the RAG prompt, since sources change per question, but it does cut long-context costs.

Where the book teaches it

Related terms

Long contextToken