Glossary: Serving LLMs at Scale

Checkpoint

Also written: checkpoints

A published set of model weight files. Model makers and groups such as Red Hat AI publish quantized checkpoints.