Skip to content

Glossary: LLMs in Production

Percentiles

Also written: percentile

Values below which a given share of measurements fall, such as p95. They describe latency better than averages.

Where the book teaches it

Related terms

p50, p95