Glossary: RAG Beyond the Basics
k
Also written: top k, top-k
The number of chunks put into the prompt after reranking (5 by default, 8 in the shipped configuration). More chunks catch more evidence but add tokens and noise.
Glossary: RAG Beyond the Basics
Also written: top k, top-k
The number of chunks put into the prompt after reranking (5 by default, 8 in the shipped configuration). More chunks catch more evidence but add tokens and noise.