Skip to content

Glossary: Running Open Models Locally

Apple Silicon

Also written: M-series Mac

Apple's own processors (such as the MacBook Air M5) in which CPU and GPU share one pool of memory. Ollama uses the GPU on them automatically, and llama.cpp does too when built for Metal.

Where the book teaches it

Related terms

Unified memoryCUDAMLX