Glossary: Building with LLMs Basics
Jitter
A small random extra wait added to a backoff so many clients that failed together don't all retry at the same moment.
Glossary: Building with LLMs Basics
A small random extra wait added to a backoff so many clients that failed together don't all retry at the same moment.