Skip to content

Glossary: LLMs in Production

Cache read / cache write

Also written: cache read, cache write, cache_read, cache_write

A cache write stores a prompt prefix at the provider and costs more than normal input (1.25 times). A cache read reuses it for about a tenth of the input price.

Where the book teaches it

Related terms

Prompt cachingCache hit rate