Glossary: Building with LLMs Basics
Rate limit
Also written: rate limits, RPM, requests per minute
The most requests or tokens per minute a provider lets you send, per model. Going over returns a 429, usually with a `retry-after` header.
Glossary: Building with LLMs Basics
Also written: rate limits, RPM, requests per minute
The most requests or tokens per minute a provider lets you send, per model. Going over returns a 429, usually with a `retry-after` header.