Skip to content

Glossary: LLMs in Production

Guardrails

Also written: guardrail

Metrics that must not get worse by more than an agreed amount during a rollout, such as error % or p95 seconds. If one does, you roll back.

Where the book teaches it

Related terms

Gradual rolloutShadow test