Prefix
The unchanging start of a request, such as the system prompt and tool definitions, which prompt caching can reuse. Anything that changes should come after it.
The unchanging start of a request, such as the system prompt and tool definitions, which prompt caching can reuse. Anything that changes should come after it.