Glossary: RAG Beyond the Basics
Budget
Also written: context budget, character budget
The maximum number of characters of sources the prompt may hold (4,000 by default). It keeps prompts cheap and focused, but chunks that don't fit are cut.
Glossary: RAG Beyond the Basics
Also written: context budget, character budget
The maximum number of characters of sources the prompt may hold (4,000 by default). It keeps prompts cheap and focused, but chunks that don't fit are cut.