Skip to content

Glossary: Serving LLMs at Scale

Histogram

Also written: histogram_quantile

A metric that counts values in buckets (under 0.1 s, under 0.25 s...). PromQL can estimate percentiles from the buckets.

Where the book teaches it

Related terms

PercentilePromQLPrometheus