Skip to content

Glossary: AI System Design

Cached tokens

Also written: cached input, cache read, cache reads, cache write

Input tokens read from the provider's prompt cache, at a tenth of the input price (a twentieth for Sonnet 5.5). Storing text in the cache the first time, a cache write, costs 1.25 times the input price.

Where the book teaches it

Related terms

Fresh tokensPrompt cache