Skip to content

Glossary: LLMs in Production

Fallback

Also written: fallbacks, fallback chain

Sending a request to a different model, ideally from another provider, when the first fails. Haiku is first and GPT-6 Luna second at Kettle & Crane.

Where the book teaches it

Related terms

Circuit breakerGraceful degradation