Glossary: LLMs in Production

asyncio.shield

Also written: shield

Protects a shared task from cancellation. If one waiting client disconnects, the work keeps running for the others.