Skip to content
50
FiftyPage
Books
Learning paths
Book packs
Playground
Glossary
Blog
Sign in
Glossary: Serving LLMs at Scale
TensorRT-LLM
NVIDIA's serving engine: fast, but with more setup.
Where the book teaches it
Chapter 6: vLLM and other engines
Related terms
vLLM