Skip to content

Glossary: Serving LLMs at Scale

Safetensors

The standard weights file format on Hugging Face, used by vLLM and SGLang.

Where the book teaches it

Related terms

GGUF