Glossary: LLMs in Production

Event loop

The scheduler inside asyncio that switches between waiting tasks. Blocking calls such as time.sleep stall it; Jupyter already runs one.