Skip to content

Glossary: Building with LLMs Basics

max_tokens

Also written: max_output_tokens, Max tokens

Your cap on how many tokens a reply may use, thinking included. Claude calls it `max_tokens` and OpenAI calls it `max_output_tokens`; a low cap can cut a reply off or leave no visible text.

Where the book teaches it

Related terms

ThinkingStop reasonContext window