Skip to content
50FiftyPage

Glossary: Serving LLMs at Scale

Calibration set

Also written: calibration

A small sample of text used by methods like AWQ and GPTQ to guide quantization. FP8 'dynamic' schemes need none.

Where the book teaches it

Related terms

AWQ (activation-aware weight quantization)GPTQ