Glossary: Building with LLMs Basics
Cache breakpoint
Also written: breakpoint
The `cache_control` marker in a prompt. Everything up to and including that block is cached, so Priya's policies go before it and the changing email goes after.
Glossary: Building with LLMs Basics
Also written: breakpoint
The `cache_control` marker in a prompt. Everything up to and including that block is cached, so Priya's policies go before it and the changing email goes after.