Skip to content

Glossary: LLMs in Production

retry-after

Also written: Retry-After

A response header saying how many seconds to wait before retrying. The gateway uses it as the minimum wait, and the gate sends it with a 503.

Where the book teaches it

Related terms

HTTP status codesLoad shedding