Skip to content

Glossary: LLMs in Production

p50, p95

Also written: p50, p95, p99, median

The time that 50% (median) or 95% of requests beat, so 1 in 20 is slower than p95. Set targets and alerts on p95 because an average hides a slow tail.

Where the book teaches it

Related terms

Percentiles