GGUF

Also written: .gguf

A single-file format that holds a model's weights plus the settings needed to run them. llama.cpp, Ollama and LM Studio all use it, and a file like `Qwen3.5-0.8B-Q4_K_M.gguf` is the model file layer of a local setup.