Glossary: Running Open Models Locally

llama serve

Also written: llama-server, llama.cpp server

The llama.cpp command that keeps a model loaded and answers HTTP requests in OpenAI's format, plus a browser chat page. By default it listens on `127.0.0.1:9931`.