Glossary: LLMs in Production

deque

Also written: collections.deque

A Python list-like structure that is fast to trim from the front. UserLimits uses one per user to hold recent request times.