Glossary: Running Open Models Locally

Load duration

Also written: prompt eval rate, eval rate, total duration, --verbose

Timings Ollama prints with `--verbose`: load duration is the time to read the model into memory, prompt eval rate is how fast the prompt was read, and eval rate is how fast the reply was written, in tokens per second.