Skip to content

Glossary: AI System Design

Escalation

Also written: escalate, escalation rate

Sending a hard request to a bigger, costlier model (or a person) by rule. In the support assistant, 10% of conversations escalate to Sonnet 5.5, which makes the escalation rate the biggest cost lever.

Where the book teaches it

Related terms

RouterModel gateway