Skip to content

Glossary: RAG Beyond the Basics

Long context

Also written: search="all", long_context

Skipping retrieval and putting every document the user may see into the prompt, cached for reuse. It scored as well as the shipped configuration here but cost over three times as much.

Where the book teaches it

Related terms

Prompt cachingcache_control