Skip to content

Glossary: Serving LLMs at Scale

PromQL

Also written: rate(), promtool

Prometheus's query language. For example, rate(x[5m]) turns a counter into a per-second rate.

Where the book teaches it

Related terms

PrometheusHistogram