Skip to content

Glossary: Serving LLMs at Scale

SGLang

Also written: sglang serve

An open-source GPU serving engine from the LMSYS group, known for RadixAttention and fast structured output.

Where the book teaches it

Related terms

vLLMRadixAttention