Glossary: LLMs in Production

Retry storm

Retries from many clients, or from several layers each retrying, multiplying load on a service that is already struggling.