Skip to content

Glossary: LLMs in Production

Prompt layout rule

Also written: layout rule

Order a prompt from what never changes to what changes most (tools, instructions, reference material, conversation, new question), because the cache matches from the first token. A timestamp or name near the top breaks caching.

Where the book teaches it

Related terms

Prompt cachingCache hit rate