Skip to content

Glossary: LLMs in Production

TTL

Also written: time to live, ttl

Time to live: how long a cached item stays valid. The response cache uses one hour, so answers expire even if you forget to bump the version.

Where the book teaches it

Related terms

Response cache