Glossary: Serving LLMs at Scale
Alert rule
Also written: alerts.yml, for duration
A Prometheus rule that fires when an expression stays true for a set `for` time, such as p95 TTFT above 2 seconds for 5 minutes. Keep the list short so people don't learn to ignore alerts.