Skip to content

Glossary: Running Open Models Locally

Temperature

A setting for how random the model's word choices are. 0 always picks the most likely next token, giving repeatable replies useful for testing.

Where the book teaches it

Related terms

Modelfilenum_ctx