Glossary: Building with LLMs Basics

Cache read / write

Also written: cache read, cache write

A cache write stores a prompt prefix the first time, costing slightly more than normal input. A cache read reuses it later at a small fraction of the input price.