Skip to content

Glossary: Running Open Models Locally

Threads

Also written: -t, num_thread

Parallel lines of work a program runs, normally one per CPU core. On the busy 2-core test machine, one thread was nine times faster than two because the threads kept waiting on each other.

Where the book teaches it

Related terms

llama benchDecode