Skip to content

Glossary: Running Open Models Locally

Grammar

A set of rules, built from your JSON schema, that says which tokens may come next. The engine uses it to block tokens that would break the schema.

Where the book teaches it

Related terms

Constrained decodingJSON schema