Skip to content

Glossary: LLMs in Production

Per-user limits

Also written: UserLimits, user limits

Caps on how many questions an individual may ask per hour and how many dollars they may cost per day. A customer asks a handful, a script hundreds; blocked users get HTTP 429.

Where the book teaches it

Related terms

Daily budgetSliding window