Glossary: Serving LLMs at Scale
Volume
Also written: -v, hf-cache
A folder mounted into a container, used to bring in model weights or keep downloaded ones between restarts.
Glossary: Serving LLMs at Scale
Also written: -v, hf-cache
A folder mounted into a container, used to bring in model weights or keep downloaded ones between restarts.