Skip to content

Glossary: Running Open Models Locally

CUDA

Also written: ROCm, Vulkan, Metal

Systems for programming GPUs that llama.cpp can use: CUDA is NVIDIA's, Metal is Apple's, ROCm is AMD's and Vulkan works across vendors. You pick the build that matches your hardware.

Where the book teaches it

Related terms

llama.cppVRAM