Glossary: LLMs in Production

Full jitter

Also written: jitter

Waiting a random time between 0 and the backoff limit, so many clients spread their retries out instead of retrying in waves.