Glossary: LLMs in Production

LiteLLM

An open-source proxy service that can serve as a model gateway instead of a module in your own app.