Skip to content

Glossary: RAG Beyond the Basics

Token

Also written: tokens, tokens_in, tokens_out

The unit of text a model reads and writes, roughly a short word or word piece. Prices and caching limits are counted in tokens, and output tokens cost five times as much as input here.

Where the book teaches it

Related terms

Prompt caching