Glossary: LLMs in Production

asyncio.Lock

Also written: Lock

A lock that lets one task at a time run the block inside it. The rate limiter uses it to hand out start times one by one.