Model gateway

Also written: gateway

The one module or service that talks to model providers, adding retries, fallbacks, caching, budgets per product and cost tracking.