Skip to content

Glossary: Running Open Models Locally

Ollama

A tool that downloads, runs and serves local models: one install, one command to pull a model, and a server that starts by itself on port 11434.

Where the book teaches it

Related terms

llama.cppModelfile