Glossary: Building with LLMs Basics
max_tokens
Also written: max_output_tokens, Max tokens
Your cap on how many tokens a reply may use, thinking included. Claude calls it `max_tokens` and OpenAI calls it `max_output_tokens`; a low cap can cut a reply off or leave no visible text.