Skip to content

Glossary: Running Open Models Locally

--fit

Also written: fit

A llama.cpp setting, on by default, that shrinks the context to fit the free memory it can see. It can guess too high if the real limit is hidden (such as a container cap), so set `-c` yourself.

Where the book teaches it

Related terms

Context lengthContainer