Skip to content

Glossary: LLMs in Production

Token

Also written: tokens, tokenizer, input tokens, output tokens

The chunk of text models read and write, and the unit of billing. Each model family splits text differently, so the same prompt is 3,146 tokens for Claude and 2,038 for OpenAI.

Where the book teaches it

Related terms

Thinking tokens