Cache miss
Also written: cache hit
A request the response cache has not seen before, so the model is called (and paid for) and the reply is saved. A cache hit replays the saved reply free; changing one word of a prompt causes misses.
Also written: cache hit
A request the response cache has not seen before, so the model is called (and paid for) and the reply is saved. A cache hit replays the saved reply free; changing one word of a prompt causes misses.