Glossary: LLMs in Production

Routing

Also written: route

Choosing the model and settings, such as effort, for each job, so the cheapest option that passes its eval does the work.