Skip to content

Glossary: Building with LLMs Basics

Ollama

A free tool that downloads and runs open-weight models on your own computer. It runs a local server with an OpenAI-compatible API, so the `openai` package can talk to it.

Where the book teaches it

Related terms

Open-weight modelBase URL