Glossary: LLMs in Production

OpenTelemetry (OTel)

Also written: OpenTelemetry, OTel, opentelemetry-sdk

The open standard, supported by most monitoring tools, for traces, metrics and logs. The gateway wraps each model call in an OTel span.