Skip to content

Glossary: RAG Beyond the Basics

k

Also written: top k, top-k

The number of chunks put into the prompt after reranking (5 by default, 8 in the shipped configuration). More chunks catch more evidence but add tokens and noise.

Where the book teaches it

Related terms

PoolBudget