Glossary: Serving LLMs at Scale

Hugging Face

Also written: HF_TOKEN

The site where open models are downloaded. HF_TOKEN is an access token needed only for gated models.