Skip to content

Glossary: AI System Design

p95

Also written: 95th percentile, percentile, percentiles, p50, p99

The value 95% of requests beat, so 1 in 20 is slower. Targets use percentiles because averages hide the slow requests users remember.

Where the book teaches it

Related terms

Latency budgetTTFT (time to first token)