Skip to content

Glossary: Serving LLMs at Scale

GGUF

The model file format used by llama.cpp.

Where the book teaches it

Related terms

Safetensors