Glossary: Running Open Models Locally
VRAM
Also written: video RAM
A graphics card's own memory, such as 16 GB on an RTX 5060 Ti. If a model doesn't fit, engines split layers between GPU and CPU and speed drops sharply.
Glossary: Running Open Models Locally
Also written: video RAM
A graphics card's own memory, such as 16 GB on an RTX 5060 Ti. If a model doesn't fit, engines split layers between GPU and CPU and speed drops sharply.