Ollama
Also written: ollama create, ollama run
A free tool that downloads, stores and runs GGUF models behind a local API. `ollama create name -f Modelfile` registers a model and `ollama run name "..."` sends it one message.
Also written: ollama create, ollama run
A free tool that downloads, stores and runs GGUF models behind a local API. `ollama create name -f Modelfile` registers a model and `ollama run name "..."` sends it one message.