Model gateway
Also written: gateway
The one place in your code that talks to model providers, so retries, fallbacks, caching, timing and cost tracking are written once. No other code calls an SDK directly.
Also written: gateway
The one place in your code that talks to model providers, so retries, fallbacks, caching, timing and cost tracking are written once. No other code calls an SDK directly.