Skip to content

Glossary: Running Open Models Locally

RAG (retrieval-augmented generation)

Also written: RAG

A technique that first finds the text relevant to a question (retrieval) and then has the model answer from it (generation). For example, it can answer questions from Kettle & Crane's handbook by retrieving the matching rules.

Where the book teaches it

Related terms

EmbeddingChunkCosine similarity