Skip to content

Glossary: Serving LLMs at Scale

Volume

Also written: -v, hf-cache

A folder mounted into a container, used to bring in model weights or keep downloaded ones between restarts.

Where the book teaches it

Related terms

ContainerCold start