Prompt cache
Also written: prompt caching
A provider feature that reuses the processed start of a prompt, such as the help center, at a small fraction of the input price. Changing anything early in the prompt breaks it.
Also written: prompt caching
A provider feature that reuses the processed start of a prompt, such as the help center, at a small fraction of the input price. Changing anything early in the prompt breaks it.