GGUF
The single-file model format used by llama.cpp and Ollama. You convert a merged model to it with llama.cpp's `convert_hf_to_gguf.py`.
The single-file model format used by llama.cpp and Ollama. You convert a merged model to it with llama.cpp's `convert_hf_to_gguf.py`.