Glossary: Serving LLMs at Scale

GQA (grouped-query attention)

Also written: GQA

A design where several query heads share one key-value head, so the KV cache is smaller. Qwen3-8B has 32 attention heads but stores only 8 KV heads.