Skip to content

Glossary: LLMs in Production

ModelError

The single error type the gateway raises for every provider failure, carrying an HTTP status, a retryable flag and a try_another flag.

Where the book teaches it

Related terms

Model gatewayRetryable error