Skip to content

Glossary: AI System Design

Router

Also written: routing, cascade

The part of the gateway that picks a model per request: by job, by cascade (try small, escalate when unsure) or by customer.

Where the book teaches it

Related terms

Model gatewayAllow-listEscalation