Glossary: Serving LLMs at Scale

Environment variable

Also written: LLM_BASE_URL, LLAMA_ARG_PORT

A named setting read by a program from its surroundings. Writing NAME=value before a command sets it for that command only.