Glossary: AI Security and Guardrails
Rate limit
Also written: rate limiting, rate limits
A cap on how many requests a user can make in a given period, used to stop abuse and runaway cost. A token bucket is one common way to enforce it.
Glossary: AI Security and Guardrails
Also written: rate limiting, rate limits
A cap on how many requests a user can make in a given period, used to stop abuse and runaway cost. A token bucket is one common way to enforce it.