Skip to content

Glossary: Building with LLMs Basics

Exponential backoff

Also written: backoff

Doubling the wait after each failed attempt (1 second, then 2, then 4) so a struggling service gets breathing room.

Where the book teaches it

Related terms

JitterRate limitretry-after