Skip to content

Glossary: LLMs in Production

Cascade

Also written: cascades

Sending every request to a cheap model first and passing it to a stronger model or a person only when the first answer looks unreliable. At Kettle & Crane Haiku answers first and Sonnet takes the unsure ones.

Where the book teaches it

Related terms

RoutingHandoff