Skip to content

Glossary: Fine-tuning LLMs

GGUF

The single-file model format used by llama.cpp and Ollama. You convert a merged model to it with llama.cpp's `convert_hf_to_gguf.py`.

Where the book teaches it

Related terms

llama.cppOllamaq8_0Safetensors