Skip to content

Glossary: Running Open Models Locally

Constrained decoding

An engine feature that blocks any token that would break your JSON schema as the reply is written. The output always parses and matches the shape, though the model can still pick a wrong allowed value.

Where the book teaches it

Related terms

GrammarJSON modeJSON schema