Skip to content

Glossary: Running Open Models Locally

Chunk

Also written: chunks

A small piece of a larger whole. In retrieval it is one rule or passage of a document stored for search, such as one handbook rule; in streaming it is one piece of a reply sent as the model writes it.

Where the book teaches it

Related terms

StreamingRAG (retrieval-augmented generation)