Skip to content

Glossary: Running Open Models Locally

cmake

Also written: build from source

A build tool used to compile llama.cpp from its source code (`cmake -B build`, then `cmake --build build`). Add `-DGGML_CUDA=ON` to build for an NVIDIA card.

Where the book teaches it

Related terms

llama.cppCUDA