Skip to content

Glossary: Running Open Models Locally

Quantizer (Unsloth, Bartowski)

Also written: Unsloth, Bartowski, ggml-org, community quantizers

Well-known publishers who create GGUF versions of other people's models on Hugging Face. They and `ggml-org` (the llama.cpp team) are trusted sources.

Where the book teaches it

Related terms

GGUFHugging Face