Glossary: Serving LLMs at Scale

Host addresses (127.0.0.1, 0.0.0.0)

Also written: 127.0.0.1, 0.0.0.0, --host

127.0.0.1 means this machine only, which is where llama-server listens by default. 0.0.0.0 means all network interfaces, so anyone who can reach the port can use the server; add an API key when you use it.