Glossary: Building with LLMs Basics
Exponential backoff
Also written: backoff
Doubling the wait after each failed attempt (1 second, then 2, then 4) so a struggling service gets breathing room.
Glossary: Building with LLMs Basics
Also written: backoff
Doubling the wait after each failed attempt (1 second, then 2, then 4) so a struggling service gets breathing room.