Skip to content

Glossary: RAG Basics

Token

Also written: tokens

The small pieces of text a model reads and bills by. English averages about four characters per token.

Where the book teaches it

Related terms

TokenizerBudget