Skip to content

Glossary: LLMs in Production

Sliding window

A limit over the last N minutes rather than a clock period. UserLimits drops request times older than an hour so the limit covers the last 60 minutes.

Where the book teaches it

Related terms

dequeRetry budget