Skip to content

Glossary: LLMs in Production

Thinking tokens

Also written: thinking

The model's hidden reasoning before it answers. They're billed as output tokens even though the user never sees them, and they delay the first visible text.

Where the book teaches it

Related terms

EffortTime to first token (TTFT)