Glossary: RAG Beyond the Basics
Token
Also written: tokens, tokens_in, tokens_out
The unit of text a model reads and writes, roughly a short word or word piece. Prices and caching limits are counted in tokens, and output tokens cost five times as much as input here.