Response cache
Also written: exact cache, ExactCache
Reusing an earlier answer instead of calling a model. An exact cache matches normalized identical questions, with the prompt version in the key and a TTL.
Also written: exact cache, ExactCache
Reusing an earlier answer instead of calling a model. An exact cache matches normalized identical questions, with the prompt version in the key and a TTL.