Skip to content

Glossary: Serving LLMs at Scale

Alert rule

Also written: alerts.yml, for duration

A Prometheus rule that fires when an expression stays true for a set `for` time, such as p95 TTFT above 2 seconds for 5 minutes. Keep the list short so people don't learn to ignore alerts.

Where the book teaches it

Related terms

PrometheusAlertmanagerSLO (service-level objective)