Prompt caching
Reusing an identical start of a request, such as tool definitions, at a lower input price. It needs the tool list in the same order every time.
Reusing an identical start of a request, such as tool definitions, at a lower input price. It needs the tool list in the same order every time.