Skip to content

Glossary: LLMs in Production

Exponential backoff

Also written: backoff

A retry strategy that waits longer after each failed attempt, with the maximum wait doubling each time. Adding full jitter, a random wait between zero and that maximum, keeps many clients from retrying in sync.

Where the book teaches it

Related terms

Full jitterRetry storm