Skip to content

Glossary: Running Open Models Locally

VRAM

Also written: video RAM

A graphics card's own memory, such as 16 GB on an RTX 5060 Ti. If a model doesn't fit, engines split layers between GPU and CPU and speed drops sharply.

Where the book teaches it

Related terms

Unified memoryollama ps