llama.cpp
A C++ program for running GGUF models fast on ordinary CPUs and GPUs. Its repository includes the converter script that makes GGUF files.
A C++ program for running GGUF models fast on ordinary CPUs and GPUs. Its repository includes the converter script that makes GGUF files.