Glossary: Building with LLMs Basics
Context window
The most tokens a model can handle in one request, counting everything you send plus everything it writes back. Current models allow about 1 million tokens, but filling it costs money and time.
Glossary: Building with LLMs Basics
The most tokens a model can handle in one request, counting everything you send plus everything it writes back. Current models allow about 1 million tokens, but filling it costs money and time.